Lazy Expr get_encoding_time() #153
Comments
armgilles
added a commit
that referenced
this issue
Oct 9, 2024
…153 Signed-off-by: Armand <[email protected]>
armgilles
added a commit
that referenced
this issue
Oct 16, 2024
* Try lazy + expression fonction to check perf bench #146 Signed-off-by: Armand <[email protected]> * Update code with get_transactions_out expr #146 Signed-off-by: Armand <[email protected]> * have to collect with lazy #146 Signed-off-by: Armand <[email protected]> * Lazy read_activity_vcub #148 and update notebook transactions_out Signed-off-by: Armand <[email protected]> * Update bench test with lazy vcub_keeper_py312 #148 Signed-off-by: Armand <[email protected]> * update docstring #148 Signed-off-by: Armand <[email protected]> * collect lazy df to be a fair bench #146 Signed-off-by: Armand <[email protected]> * collect lazy df to be a fair bench #146 Signed-off-by: Armand <[email protected]> * collect lazy df to be a fair bench #146 Signed-off-by: Armand <[email protected]> * Update transactions_in to be lazy and expr fonction #149 Signed-off-by: Armand <[email protected]> * Try to improve bench test on big result Signed-off-by: Armand <[email protected]> * lazy and Expr function for transactions_all function #150 Signed-off-by: Armand <[email protected]> * try to fix bad perf on big dataset lazy Signed-off-by: Armand <[email protected]> * try to fix bad perf on big dataset lazy Signed-off-by: Armand <[email protected]> * try to fix bad perf on big dataset lazy Signed-off-by: Armand <[email protected]> * Lazy expr for get_consecutive_no_transactions_out #151 Signed-off-by: Armand <[email protected]> * Lazy transform_json_api_bdx_station_data_to_df function #152 Signed-off-by: Armand <[email protected]> * Encoding time in Expr function and process_data_cluster in lazy mode #153 Signed-off-by: Armand <[email protected]> * add todo for ML with pandas Signed-off-by: Armand <[email protected]> * Adapt code for pipeline bench lazy Signed-off-by: Armand <[email protected]> * Try new lazy for pipeline bench Signed-off-by: Armand <[email protected]> * Try new lazy for pipeline bench Signed-off-by: Armand <[email protected]> * process data with with_columns style & lazy #161 Signed-off-by: Armand <[email protected]> * forget previous commit Signed-off-by: Armand <[email protected]> * have to collect this tests Signed-off-by: Armand <[email protected]> * Small test bench are in eager mode, big in lazy mode to faire comparaison Signed-off-by: Armand <[email protected]> * Small test bench are in eager mode, big in lazy mode to faire comparaison Signed-off-by: Armand <[email protected]> * Update notebook with with_colums style for feature creation Signed-off-by: Armand <[email protected]> * Using pipe style with lazy Signed-off-by: Armand <[email protected]> * cleaning Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]>
|
On n'utilise pas les |
armgilles
added a commit
that referenced
this issue
Nov 7, 2024
* Try lazy + expression fonction to check perf bench #146 Signed-off-by: Armand <[email protected]> * Update code with get_transactions_out expr #146 Signed-off-by: Armand <[email protected]> * have to collect with lazy #146 Signed-off-by: Armand <[email protected]> * Lazy read_activity_vcub #148 and update notebook transactions_out Signed-off-by: Armand <[email protected]> * Update bench test with lazy vcub_keeper_py312 #148 Signed-off-by: Armand <[email protected]> * update docstring #148 Signed-off-by: Armand <[email protected]> * collect lazy df to be a fair bench #146 Signed-off-by: Armand <[email protected]> * collect lazy df to be a fair bench #146 Signed-off-by: Armand <[email protected]> * collect lazy df to be a fair bench #146 Signed-off-by: Armand <[email protected]> * Update transactions_in to be lazy and expr fonction #149 Signed-off-by: Armand <[email protected]> * Try to improve bench test on big result Signed-off-by: Armand <[email protected]> * lazy and Expr function for transactions_all function #150 Signed-off-by: Armand <[email protected]> * try to fix bad perf on big dataset lazy Signed-off-by: Armand <[email protected]> * try to fix bad perf on big dataset lazy Signed-off-by: Armand <[email protected]> * try to fix bad perf on big dataset lazy Signed-off-by: Armand <[email protected]> * Lazy expr for get_consecutive_no_transactions_out #151 Signed-off-by: Armand <[email protected]> * Lazy transform_json_api_bdx_station_data_to_df function #152 Signed-off-by: Armand <[email protected]> * Encoding time in Expr function and process_data_cluster in lazy mode #153 Signed-off-by: Armand <[email protected]> * add todo for ML with pandas Signed-off-by: Armand <[email protected]> * Adapt code for pipeline bench lazy Signed-off-by: Armand <[email protected]> * Try new lazy for pipeline bench Signed-off-by: Armand <[email protected]> * Try new lazy for pipeline bench Signed-off-by: Armand <[email protected]> * process data with with_columns style & lazy #161 Signed-off-by: Armand <[email protected]> * forget previous commit Signed-off-by: Armand <[email protected]> * have to collect this tests Signed-off-by: Armand <[email protected]> * Small test bench are in eager mode, big in lazy mode to faire comparaison Signed-off-by: Armand <[email protected]> * Small test bench are in eager mode, big in lazy mode to faire comparaison Signed-off-by: Armand <[email protected]> * Update notebook with with_colums style for feature creation Signed-off-by: Armand <[email protected]> * Using pipe style with lazy Signed-off-by: Armand <[email protected]> * cleaning Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]>
armgilles
added a commit
that referenced
this issue
Nov 7, 2024
* Try lazy + expression fonction to check perf bench #146 Signed-off-by: Armand <[email protected]> * Update code with get_transactions_out expr #146 Signed-off-by: Armand <[email protected]> * have to collect with lazy #146 Signed-off-by: Armand <[email protected]> * Lazy read_activity_vcub #148 and update notebook transactions_out Signed-off-by: Armand <[email protected]> * Update bench test with lazy vcub_keeper_py312 #148 Signed-off-by: Armand <[email protected]> * update docstring #148 Signed-off-by: Armand <[email protected]> * collect lazy df to be a fair bench #146 Signed-off-by: Armand <[email protected]> * collect lazy df to be a fair bench #146 Signed-off-by: Armand <[email protected]> * collect lazy df to be a fair bench #146 Signed-off-by: Armand <[email protected]> * Update transactions_in to be lazy and expr fonction #149 Signed-off-by: Armand <[email protected]> * Try to improve bench test on big result Signed-off-by: Armand <[email protected]> * lazy and Expr function for transactions_all function #150 Signed-off-by: Armand <[email protected]> * try to fix bad perf on big dataset lazy Signed-off-by: Armand <[email protected]> * try to fix bad perf on big dataset lazy Signed-off-by: Armand <[email protected]> * try to fix bad perf on big dataset lazy Signed-off-by: Armand <[email protected]> * Lazy expr for get_consecutive_no_transactions_out #151 Signed-off-by: Armand <[email protected]> * Lazy transform_json_api_bdx_station_data_to_df function #152 Signed-off-by: Armand <[email protected]> * Encoding time in Expr function and process_data_cluster in lazy mode #153 Signed-off-by: Armand <[email protected]> * add todo for ML with pandas Signed-off-by: Armand <[email protected]> * Adapt code for pipeline bench lazy Signed-off-by: Armand <[email protected]> * Try new lazy for pipeline bench Signed-off-by: Armand <[email protected]> * Try new lazy for pipeline bench Signed-off-by: Armand <[email protected]> * process data with with_columns style & lazy #161 Signed-off-by: Armand <[email protected]> * forget previous commit Signed-off-by: Armand <[email protected]> * have to collect this tests Signed-off-by: Armand <[email protected]> * Small test bench are in eager mode, big in lazy mode to faire comparaison Signed-off-by: Armand <[email protected]> * Small test bench are in eager mode, big in lazy mode to faire comparaison Signed-off-by: Armand <[email protected]> * Update notebook with with_colums style for feature creation Signed-off-by: Armand <[email protected]> * Using pipe style with lazy Signed-off-by: Armand <[email protected]> * cleaning Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]>
armgilles
added a commit
that referenced
this issue
Nov 8, 2024
* Try lazy + expression fonction to check perf bench #146 Signed-off-by: Armand <[email protected]> * Update code with get_transactions_out expr #146 Signed-off-by: Armand <[email protected]> * have to collect with lazy #146 Signed-off-by: Armand <[email protected]> * Lazy read_activity_vcub #148 and update notebook transactions_out Signed-off-by: Armand <[email protected]> * Update bench test with lazy vcub_keeper_py312 #148 Signed-off-by: Armand <[email protected]> * update docstring #148 Signed-off-by: Armand <[email protected]> * collect lazy df to be a fair bench #146 Signed-off-by: Armand <[email protected]> * collect lazy df to be a fair bench #146 Signed-off-by: Armand <[email protected]> * collect lazy df to be a fair bench #146 Signed-off-by: Armand <[email protected]> * Update transactions_in to be lazy and expr fonction #149 Signed-off-by: Armand <[email protected]> * Try to improve bench test on big result Signed-off-by: Armand <[email protected]> * lazy and Expr function for transactions_all function #150 Signed-off-by: Armand <[email protected]> * try to fix bad perf on big dataset lazy Signed-off-by: Armand <[email protected]> * try to fix bad perf on big dataset lazy Signed-off-by: Armand <[email protected]> * try to fix bad perf on big dataset lazy Signed-off-by: Armand <[email protected]> * Lazy expr for get_consecutive_no_transactions_out #151 Signed-off-by: Armand <[email protected]> * Lazy transform_json_api_bdx_station_data_to_df function #152 Signed-off-by: Armand <[email protected]> * Encoding time in Expr function and process_data_cluster in lazy mode #153 Signed-off-by: Armand <[email protected]> * add todo for ML with pandas Signed-off-by: Armand <[email protected]> * Adapt code for pipeline bench lazy Signed-off-by: Armand <[email protected]> * Try new lazy for pipeline bench Signed-off-by: Armand <[email protected]> * Try new lazy for pipeline bench Signed-off-by: Armand <[email protected]> * process data with with_columns style & lazy #161 Signed-off-by: Armand <[email protected]> * forget previous commit Signed-off-by: Armand <[email protected]> * have to collect this tests Signed-off-by: Armand <[email protected]> * Small test bench are in eager mode, big in lazy mode to faire comparaison Signed-off-by: Armand <[email protected]> * Small test bench are in eager mode, big in lazy mode to faire comparaison Signed-off-by: Armand <[email protected]> * Update notebook with with_colums style for feature creation Signed-off-by: Armand <[email protected]> * Using pipe style with lazy Signed-off-by: Armand <[email protected]> * cleaning Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]>
armgilles
added a commit
that referenced
this issue
Nov 20, 2024
* Try lazy + expression fonction to check perf bench #146 Signed-off-by: Armand <[email protected]> * Update code with get_transactions_out expr #146 Signed-off-by: Armand <[email protected]> * have to collect with lazy #146 Signed-off-by: Armand <[email protected]> * Lazy read_activity_vcub #148 and update notebook transactions_out Signed-off-by: Armand <[email protected]> * Update bench test with lazy vcub_keeper_py312 #148 Signed-off-by: Armand <[email protected]> * update docstring #148 Signed-off-by: Armand <[email protected]> * collect lazy df to be a fair bench #146 Signed-off-by: Armand <[email protected]> * collect lazy df to be a fair bench #146 Signed-off-by: Armand <[email protected]> * collect lazy df to be a fair bench #146 Signed-off-by: Armand <[email protected]> * Update transactions_in to be lazy and expr fonction #149 Signed-off-by: Armand <[email protected]> * Try to improve bench test on big result Signed-off-by: Armand <[email protected]> * lazy and Expr function for transactions_all function #150 Signed-off-by: Armand <[email protected]> * try to fix bad perf on big dataset lazy Signed-off-by: Armand <[email protected]> * try to fix bad perf on big dataset lazy Signed-off-by: Armand <[email protected]> * try to fix bad perf on big dataset lazy Signed-off-by: Armand <[email protected]> * Lazy expr for get_consecutive_no_transactions_out #151 Signed-off-by: Armand <[email protected]> * Lazy transform_json_api_bdx_station_data_to_df function #152 Signed-off-by: Armand <[email protected]> * Encoding time in Expr function and process_data_cluster in lazy mode #153 Signed-off-by: Armand <[email protected]> * add todo for ML with pandas Signed-off-by: Armand <[email protected]> * Adapt code for pipeline bench lazy Signed-off-by: Armand <[email protected]> * Try new lazy for pipeline bench Signed-off-by: Armand <[email protected]> * Try new lazy for pipeline bench Signed-off-by: Armand <[email protected]> * process data with with_columns style & lazy #161 Signed-off-by: Armand <[email protected]> * forget previous commit Signed-off-by: Armand <[email protected]> * have to collect this tests Signed-off-by: Armand <[email protected]> * Small test bench are in eager mode, big in lazy mode to faire comparaison Signed-off-by: Armand <[email protected]> * Small test bench are in eager mode, big in lazy mode to faire comparaison Signed-off-by: Armand <[email protected]> * Update notebook with with_colums style for feature creation Signed-off-by: Armand <[email protected]> * Using pipe style with lazy Signed-off-by: Armand <[email protected]> * cleaning Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]>
armgilles
added a commit
that referenced
this issue
Nov 21, 2024
* Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * dev_pandas version 1.2.2a (#113) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars read activity data (#119) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * Migre read_activity_vcub into Polars #117 Signed-off-by: Armand <[email protected]> * Add Polars Pyarrow dep in package Signed-off-by: Armand <[email protected]> * Improve migration #117 Signed-off-by: Armand <[email protected]> * Update bench test #117 Signed-off-by: Armand <[email protected]> * Fix pandas output in Bench tests #117 Signed-off-by: Armand <[email protected]> * Typo Signed-off-by: Armand <[email protected]> * forget to retour output with pandas... #117 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars get transaction out (#120) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * Add Polars dependencies to the project Signed-off-by: Armand <[email protected]> * Adding pyarrow as dep for Polars Signed-off-by: Armand <[email protected]> * Migrate get_transactions_out into Polars #116 Signed-off-by: Armand <[email protected]> * Explicite return with pandas use case #116 Signed-off-by: Armand <[email protected]> * Update bench test #116 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Migrate transactions_in in Polars #121 Signed-off-by: Armand <[email protected]> * Update test #121 Signed-off-by: Armand <[email protected]> * Update read_activity_vcub to fix mistake output_type default and type Signed-off-by: Armand <[email protected]> * Polars transactions in (#123) * Migrate transactions_in in Polars #121 Signed-off-by: Armand <[email protected]> * Update test #121 Signed-off-by: Armand <[email protected]> * Update read_activity_vcub to fix mistake output_type default and type Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars get transactions all (#125) * Migrate transactions_in in Polars #121 Signed-off-by: Armand <[email protected]> * Update test #121 Signed-off-by: Armand <[email protected]> * Update read_activity_vcub to fix mistake output_type default and type Signed-off-by: Armand <[email protected]> * Migration transactions_all into Polars #124 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars transform json api bdx station data to df (#128) * Migrate transactions_in in Polars #121 Signed-off-by: Armand <[email protected]> * Update test #121 Signed-off-by: Armand <[email protected]> * Update read_activity_vcub to fix mistake output_type default and type Signed-off-by: Armand <[email protected]> * Migrate transform_json_api_bdx_station_data_to_df and oslandia func to polars #126 Signed-off-by: Armand <[email protected]> * Update unit test & bench + data test for #126 Signed-off-by: Armand <[email protected]> * Update test with #126 Signed-off-by: Armand <[email protected]> * Update test with #126 Signed-off-by: Armand <[email protected]> * Update test with #126 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars get encoding time (#131) * Migrate transactions_in in Polars #121 Signed-off-by: Armand <[email protected]> * Update test #121 Signed-off-by: Armand <[email protected]> * Update read_activity_vcub to fix mistake output_type default and type Signed-off-by: Armand <[email protected]> * Working on #130 Signed-off-by: Armand <[email protected]> * try to remove numpy and using math to have pi #130 Signed-off-by: Armand <[email protected]> * test improve bench #130 Signed-off-by: Armand <[email protected]> * test improve bench lit #130 Signed-off-by: Armand <[email protected]> * test improve bench lit2 #130 Signed-off-by: Armand <[email protected]> * test improve bench lit as 1 #130 Signed-off-by: Armand <[email protected]> * test improve bench lit as expr #130 Signed-off-by: Armand <[email protected]> * test improve bench lit as expr with mul#130 Signed-off-by: Armand <[email protected]> * test improve bench lit as expr with no mul#130 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Increase bench dataset (#134) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * Add bench test with bigger dataset #133 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars bigger dataset bench (#135) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * dev_pandas version 1.2.2a (#113) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Migrate transactions_in in Polars #121 Signed-off-by: Armand <[email protected]> * Update test #121 Signed-off-by: Armand <[email protected]> * Update read_activity_vcub to fix mistake output_type default and type Signed-off-by: Armand <[email protected]> * Increase bench dataset (#134) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * Add bench test with bigger dataset #133 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Increase dateset bench with polars #133 Signed-off-by: Armand <[email protected]> * Update input ouput bigger fonction to polars #133 Signed-off-by: Armand <[email protected]> * Update input ouput bigger fonction to polars #133 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars get consecutive no transactions out (#132) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * dev_pandas version 1.2.2a (#113) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Migrate transactions_in in Polars #121 Signed-off-by: Armand <[email protected]> * Update test #121 Signed-off-by: Armand <[email protected]> * Update read_activity_vcub to fix mistake output_type default and type Signed-off-by: Armand <[email protected]> * Update unit test for #129 Signed-off-by: Armand <[email protected]> * still wip #129 Signed-off-by: Armand <[email protected]> * Fonction still en Pandas, but CI in Polars #129 Signed-off-by: Armand <[email protected]> * Add in test data station eq 0 #129 Signed-off-by: Armand <[email protected]> * Try a implementation of Polars migration but Slow I guess # 129 Signed-off-by: Armand <[email protected]> * Increase bench dataset (#134) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * Add bench test with bigger dataset #133 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * fix value in get_consecutive_no_transactions_out unit test Signed-off-by: Armand <[email protected]> * Try to improve perf on big dataset #129 Signed-off-by: Armand <[email protected]> * try an optimize way #129 Signed-off-by: Armand <[email protected]> * Cleaning for #129 Signed-off-by: Armand <[email protected]> * cleaning notebook #129 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars read station profile (#138) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * dev_pandas version 1.2.2a (#113) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Migrate transactions_in in Polars #121 Signed-off-by: Armand <[email protected]> * Update test #121 Signed-off-by: Armand <[email protected]> * Update read_activity_vcub to fix mistake output_type default and type Signed-off-by: Armand <[email protected]> * Increase bench dataset (#134) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * Add bench test with bigger dataset #133 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * wip #136 Signed-off-by: Armand <[email protected]> * comment read_meto, old fonction stay here just to know Signed-off-by: Armand <[email protected]> * Migrate create_station_attribute & read_stations_attributes to polars with unit test #137 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars read station profile (#140) * Update omit coverage with no visualisation code Signed-off-by: Armand <[email protected]> * migrate filter_periode to polars and add unit test Signed-off-by: Armand <[email protected]> * To pass CI test with previous commit Signed-off-by: Armand <[email protected]> * Migrate create & read station profile #136 Signed-off-by: Armand <[email protected]> * Update & cleaning notebook #136 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars read time serie activity (#142) * Migrate create_activity_time_series & create_activity_time_series into partial polars with parquet & lazyframe #141 Signed-off-by: Armand <[email protected]> * Addapt some code with read_time_serie_activity in lazyframe (not fully polars) #141 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars read time serie activity (#143) * Migrate create_activity_time_series & create_activity_time_series into partial polars with parquet & lazyframe #141 Signed-off-by: Armand <[email protected]> * Addapt some code with read_time_serie_activity in lazyframe (not fully polars) #141 Signed-off-by: Armand <[email protected]> * Addapt some code with read_time_serie_activity in lazyframe (not fully polars) #141 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Using custum breakpoint calcul, no more pandas cut and add unit test #144 (#145) Signed-off-by: Armand <[email protected]> * Bench pipeline transf (#155) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * Add benchmark for pipeline transf from json API data #154 Signed-off-by: Armand <[email protected]> * Improve speed of creation of simulated data & fix big data creation setting #154 Signed-off-by: Armand <[email protected]> * Optimise creation of simulated data and reduce volume test #154 Signed-off-by: Armand <[email protected]> * Codspeed run forever, only on small test #154 Signed-off-by: Armand <[email protected]> * Codspeed run forever, only on small test #154 Signed-off-by: Armand <[email protected]> * Codspeed previous commit ok with no new test, check with one Signed-off-by: Armand <[email protected]> * Reduce volume for #154 to run on codspeed Signed-off-by: Armand <[email protected]> * Reduce volume for #154 to run on codspeed Signed-off-by: Armand <[email protected]> * Reduce again volume for codspeed, reduce CI time Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars bench pipeline (#157) * Bench pipeline transf (#155) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * Add benchmark for pipeline transf from json API data #154 Signed-off-by: Armand <[email protected]> * Improve speed of creation of simulated data & fix big data creation setting #154 Signed-off-by: Armand <[email protected]> * Optimise creation of simulated data and reduce volume test #154 Signed-off-by: Armand <[email protected]> * Codspeed run forever, only on small test #154 Signed-off-by: Armand <[email protected]> * Codspeed run forever, only on small test #154 Signed-off-by: Armand <[email protected]> * Codspeed previous commit ok with no new test, check with one Signed-off-by: Armand <[email protected]> * Reduce volume for #154 to run on codspeed Signed-off-by: Armand <[email protected]> * Reduce volume for #154 to run on codspeed Signed-off-by: Armand <[email protected]> * Reduce again volume for codspeed, reduce CI time Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * specify timezone to be as real data #154 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Try lazy + expression fonction to check perf bench #146 (#147) * Try lazy + expression fonction to check perf bench #146 Signed-off-by: Armand <[email protected]> * Update code with get_transactions_out expr #146 Signed-off-by: Armand <[email protected]> * have to collect with lazy #146 Signed-off-by: Armand <[email protected]> * Lazy read_activity_vcub #148 and update notebook transactions_out Signed-off-by: Armand <[email protected]> * Update bench test with lazy vcub_keeper_py312 #148 Signed-off-by: Armand <[email protected]> * update docstring #148 Signed-off-by: Armand <[email protected]> * collect lazy df to be a fair bench #146 Signed-off-by: Armand <[email protected]> * collect lazy df to be a fair bench #146 Signed-off-by: Armand <[email protected]> * collect lazy df to be a fair bench #146 Signed-off-by: Armand <[email protected]> * Update transactions_in to be lazy and expr fonction #149 Signed-off-by: Armand <[email protected]> * Try to improve bench test on big result Signed-off-by: Armand <[email protected]> * lazy and Expr function for transactions_all function #150 Signed-off-by: Armand <[email protected]> * try to fix bad perf on big dataset lazy Signed-off-by: Armand <[email protected]> * try to fix bad perf on big dataset lazy Signed-off-by: Armand <[email protected]> * try to fix bad perf on big dataset lazy Signed-off-by: Armand <[email protected]> * Lazy expr for get_consecutive_no_transactions_out #151 Signed-off-by: Armand <[email protected]> * Lazy transform_json_api_bdx_station_data_to_df function #152 Signed-off-by: Armand <[email protected]> * Encoding time in Expr function and process_data_cluster in lazy mode #153 Signed-off-by: Armand <[email protected]> * add todo for ML with pandas Signed-off-by: Armand <[email protected]> * Adapt code for pipeline bench lazy Signed-off-by: Armand <[email protected]> * Try new lazy for pipeline bench Signed-off-by: Armand <[email protected]> * Try new lazy for pipeline bench Signed-off-by: Armand <[email protected]> * process data with with_columns style & lazy #161 Signed-off-by: Armand <[email protected]> * forget previous commit Signed-off-by: Armand <[email protected]> * have to collect this tests Signed-off-by: Armand <[email protected]> * Small test bench are in eager mode, big in lazy mode to faire comparaison Signed-off-by: Armand <[email protected]> * Small test bench are in eager mode, big in lazy mode to faire comparaison Signed-off-by: Armand <[email protected]> * Update notebook with with_colums style for feature creation Signed-off-by: Armand <[email protected]> * Using pipe style with lazy Signed-off-by: Armand <[email protected]> * cleaning Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Update ML pipeple to Polars #162 (#163) Signed-off-by: Armand <[email protected]> * Fix new value status from API Bordeaux, improve mapping and test #165 (#166) Signed-off-by: Armand <[email protected]> * Polars viz (#167) * Update important viz fucntion to polars #164 Signed-off-by: Armand <[email protected]> * Upate notebook with viz, some pandas are still here but it's ok #164 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Change date type into Bdx pipeline (unset time zone) #168) (#169) Signed-off-by: Armand <[email protected]> * Fix available bikes consecutive feat (#171) * Fix bad condition for consecutive_no_transactions_out and available bike in station #170 Signed-off-by: Armand <[email protected]> * Update test to test available_bike less or equal 2 is consecutive_no_transactions_out = 0 #170 Signed-off-by: Armand <[email protected]> * Small update to give same type in test #170 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * try to fix problem with old lfs notebook error #172 Signed-off-by: Armand <[email protected]> * try to fix problem with old lfs notebook error #172 Signed-off-by: Armand <[email protected]> * Bump pyproject and add dep to polars to read from cloud (#175) * Bump pyproject and add dep to polars to read from cloud Signed-off-by: Armand <[email protected]> * Fix Deprecated warning with replace to replace_strict Signed-off-by: Armand <[email protected]> * Fix Deprecated warning with check_dtype to check_dtypes Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Add manifest for notebook (#176) * Adding MANIFEST to exclude notebook Signed-off-by: Armand <[email protected]> * Exclude notebook and md files during install Signed-off-by: Armand <[email protected]> * remove .gitattributes lfs files Signed-off-by: Armand <[email protected]> * Add a blanck .gitattributes file Signed-off-by: Armand <[email protected]> * Supprimer Git LFS et exclure les notebooks du suivi LFS Signed-off-by: Armand <[email protected]> * Remove .gitattributes file Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Fix lfs (#177) * Corriger le suivi Git LFS pour les fichiers notebooks et .ipynb * Add again .gitattribute Signed-off-by: Armand <[email protected]> * Fix: Track notebooks with Git LFS * Fix: Reindex notebooks for Git LFS --------- Signed-off-by: Armand <[email protected]> * typo Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]>
armgilles
added a commit
that referenced
this issue
Nov 21, 2024
* dev version 1.2.2a (#114) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Dev polars (#178) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * dev_pandas version 1.2.2a (#113) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars read activity data (#119) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * Migre read_activity_vcub into Polars #117 Signed-off-by: Armand <[email protected]> * Add Polars Pyarrow dep in package Signed-off-by: Armand <[email protected]> * Improve migration #117 Signed-off-by: Armand <[email protected]> * Update bench test #117 Signed-off-by: Armand <[email protected]> * Fix pandas output in Bench tests #117 Signed-off-by: Armand <[email protected]> * Typo Signed-off-by: Armand <[email protected]> * forget to retour output with pandas... #117 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars get transaction out (#120) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * Add Polars dependencies to the project Signed-off-by: Armand <[email protected]> * Adding pyarrow as dep for Polars Signed-off-by: Armand <[email protected]> * Migrate get_transactions_out into Polars #116 Signed-off-by: Armand <[email protected]> * Explicite return with pandas use case #116 Signed-off-by: Armand <[email protected]> * Update bench test #116 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Migrate transactions_in in Polars #121 Signed-off-by: Armand <[email protected]> * Update test #121 Signed-off-by: Armand <[email protected]> * Update read_activity_vcub to fix mistake output_type default and type Signed-off-by: Armand <[email protected]> * Polars transactions in (#123) * Migrate transactions_in in Polars #121 Signed-off-by: Armand <[email protected]> * Update test #121 Signed-off-by: Armand <[email protected]> * Update read_activity_vcub to fix mistake output_type default and type Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars get transactions all (#125) * Migrate transactions_in in Polars #121 Signed-off-by: Armand <[email protected]> * Update test #121 Signed-off-by: Armand <[email protected]> * Update read_activity_vcub to fix mistake output_type default and type Signed-off-by: Armand <[email protected]> * Migration transactions_all into Polars #124 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars transform json api bdx station data to df (#128) * Migrate transactions_in in Polars #121 Signed-off-by: Armand <[email protected]> * Update test #121 Signed-off-by: Armand <[email protected]> * Update read_activity_vcub to fix mistake output_type default and type Signed-off-by: Armand <[email protected]> * Migrate transform_json_api_bdx_station_data_to_df and oslandia func to polars #126 Signed-off-by: Armand <[email protected]> * Update unit test & bench + data test for #126 Signed-off-by: Armand <[email protected]> * Update test with #126 Signed-off-by: Armand <[email protected]> * Update test with #126 Signed-off-by: Armand <[email protected]> * Update test with #126 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars get encoding time (#131) * Migrate transactions_in in Polars #121 Signed-off-by: Armand <[email protected]> * Update test #121 Signed-off-by: Armand <[email protected]> * Update read_activity_vcub to fix mistake output_type default and type Signed-off-by: Armand <[email protected]> * Working on #130 Signed-off-by: Armand <[email protected]> * try to remove numpy and using math to have pi #130 Signed-off-by: Armand <[email protected]> * test improve bench #130 Signed-off-by: Armand <[email protected]> * test improve bench lit #130 Signed-off-by: Armand <[email protected]> * test improve bench lit2 #130 Signed-off-by: Armand <[email protected]> * test improve bench lit as 1 #130 Signed-off-by: Armand <[email protected]> * test improve bench lit as expr #130 Signed-off-by: Armand <[email protected]> * test improve bench lit as expr with mul#130 Signed-off-by: Armand <[email protected]> * test improve bench lit as expr with no mul#130 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Increase bench dataset (#134) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * Add bench test with bigger dataset #133 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars bigger dataset bench (#135) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * dev_pandas version 1.2.2a (#113) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Migrate transactions_in in Polars #121 Signed-off-by: Armand <[email protected]> * Update test #121 Signed-off-by: Armand <[email protected]> * Update read_activity_vcub to fix mistake output_type default and type Signed-off-by: Armand <[email protected]> * Increase bench dataset (#134) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * Add bench test with bigger dataset #133 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Increase dateset bench with polars #133 Signed-off-by: Armand <[email protected]> * Update input ouput bigger fonction to polars #133 Signed-off-by: Armand <[email protected]> * Update input ouput bigger fonction to polars #133 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars get consecutive no transactions out (#132) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * dev_pandas version 1.2.2a (#113) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Migrate transactions_in in Polars #121 Signed-off-by: Armand <[email protected]> * Update test #121 Signed-off-by: Armand <[email protected]> * Update read_activity_vcub to fix mistake output_type default and type Signed-off-by: Armand <[email protected]> * Update unit test for #129 Signed-off-by: Armand <[email protected]> * still wip #129 Signed-off-by: Armand <[email protected]> * Fonction still en Pandas, but CI in Polars #129 Signed-off-by: Armand <[email protected]> * Add in test data station eq 0 #129 Signed-off-by: Armand <[email protected]> * Try a implementation of Polars migration but Slow I guess # 129 Signed-off-by: Armand <[email protected]> * Increase bench dataset (#134) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * Add bench test with bigger dataset #133 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * fix value in get_consecutive_no_transactions_out unit test Signed-off-by: Armand <[email protected]> * Try to improve perf on big dataset #129 Signed-off-by: Armand <[email protected]> * try an optimize way #129 Signed-off-by: Armand <[email protected]> * Cleaning for #129 Signed-off-by: Armand <[email protected]> * cleaning notebook #129 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars read station profile (#138) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * dev_pandas version 1.2.2a (#113) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Migrate transactions_in in Polars #121 Signed-off-by: Armand <[email protected]> * Update test #121 Signed-off-by: Armand <[email protected]> * Update read_activity_vcub to fix mistake output_type default and type Signed-off-by: Armand <[email protected]> * Increase bench dataset (#134) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * Add bench test with bigger dataset #133 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * wip #136 Signed-off-by: Armand <[email protected]> * comment read_meto, old fonction stay here just to know Signed-off-by: Armand <[email protected]> * Migrate create_station_attribute & read_stations_attributes to polars with unit test #137 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars read station profile (#140) * Update omit coverage with no visualisation code Signed-off-by: Armand <[email protected]> * migrate filter_periode to polars and add unit test Signed-off-by: Armand <[email protected]> * To pass CI test with previous commit Signed-off-by: Armand <[email protected]> * Migrate create & read station profile #136 Signed-off-by: Armand <[email protected]> * Update & cleaning notebook #136 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars read time serie activity (#142) * Migrate create_activity_time_series & create_activity_time_series into partial polars with parquet & lazyframe #141 Signed-off-by: Armand <[email protected]> * Addapt some code with read_time_serie_activity in lazyframe (not fully polars) #141 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars read time serie activity (#143) * Migrate create_activity_time_series & create_activity_time_series into partial polars with parquet & lazyframe #141 Signed-off-by: Armand <[email protected]> * Addapt some code with read_time_serie_activity in lazyframe (not fully polars) #141 Signed-off-by: Armand <[email protected]> * Addapt some code with read_time_serie_activity in lazyframe (not fully polars) #141 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Using custum breakpoint calcul, no more pandas cut and add unit test #144 (#145) Signed-off-by: Armand <[email protected]> * Bench pipeline transf (#155) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * Add benchmark for pipeline transf from json API data #154 Signed-off-by: Armand <[email protected]> * Improve speed of creation of simulated data & fix big data creation setting #154 Signed-off-by: Armand <[email protected]> * Optimise creation of simulated data and reduce volume test #154 Signed-off-by: Armand <[email protected]> * Codspeed run forever, only on small test #154 Signed-off-by: Armand <[email protected]> * Codspeed run forever, only on small test #154 Signed-off-by: Armand <[email protected]> * Codspeed previous commit ok with no new test, check with one Signed-off-by: Armand <[email protected]> * Reduce volume for #154 to run on codspeed Signed-off-by: Armand <[email protected]> * Reduce volume for #154 to run on codspeed Signed-off-by: Armand <[email protected]> * Reduce again volume for codspeed, reduce CI time Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Polars bench pipeline (#157) * Bench pipeline transf (#155) * Update for front (#111) * Fix install in front and got to be in PROD Signed-off-by: Armand <[email protected]> * Just to check in site-package on dir below ROOT_DIR Signed-off-by: Armand <[email protected]> * Update Ruff version in pre commit Signed-off-by: Armand <[email protected]> * Change check for prod with new structure and Front Signed-off-by: Armand <[email protected]> * Remove non usefull reset_index in oslandia API data crunsh Signed-off-by: Armand <[email protected]> * Format Signed-off-by: Armand <[email protected]> * Add matplotlib as dep (visualisation.py) Signed-off-by: Armand <[email protected]> * Add seaborn as dep for deploy Signed-off-by: Armand <[email protected]> * Try to fix error install ci watcher 'error: Your local changes to the following files would be overwritten by checkout' Signed-off-by: Armand <[email protected]> * minor update on notebook Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.2.2a (#112) Signed-off-by: Armand <[email protected]> * Add benchmark for pipeline transf from json API data #154 Signed-off-by: Armand <[email protected]> * Improve speed of creation of simulated data & fix big data creation setting #154 Signed-off-by: Armand <[email protected]> * Optimise creation of simulated data and reduce volume test #154 Signed-off-by: Armand <[email protected]> * Codspeed run forever, only on small test #154 Signed-off-by: Armand <[email protected]> * Codspeed run forever, only on small test #154 Signed-off-by: Armand <[email protected]> * Codspeed previous commit ok with no new test, check with one Signed-off-by: Armand <[email protected]> * Reduce volume for #154 to run on codspeed Signed-off-by: Armand <[email protected]> * Reduce volume for #154 to run on codspeed Signed-off-by: Armand <[email protected]> * Reduce again volume for codspeed, reduce CI time Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * specify timezone to be as real data #154 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Try lazy + expression fonction to check perf bench #146 (#147) * Try lazy + expression fonction to check perf bench #146 Signed-off-by: Armand <[email protected]> * Update code with get_transactions_out expr #146 Signed-off-by: Armand <[email protected]> * have to collect with lazy #146 Signed-off-by: Armand <[email protected]> * Lazy read_activity_vcub #148 and update notebook transactions_out Signed-off-by: Armand <[email protected]> * Update bench test with lazy vcub_keeper_py312 #148 Signed-off-by: Armand <[email protected]> * update docstring #148 Signed-off-by: Armand <[email protected]> * collect lazy df to be a fair bench #146 Signed-off-by: Armand <[email protected]> * collect lazy df to be a fair bench #146 Signed-off-by: Armand <[email protected]> * collect lazy df to be a fair bench #146 Signed-off-by: Armand <[email protected]> * Update transactions_in to be lazy and expr fonction #149 Signed-off-by: Armand <[email protected]> * Try to improve bench test on big result Signed-off-by: Armand <[email protected]> * lazy and Expr function for transactions_all function #150 Signed-off-by: Armand <[email protected]> * try to fix bad perf on big dataset lazy Signed-off-by: Armand <[email protected]> * try to fix bad perf on big dataset lazy Signed-off-by: Armand <[email protected]> * try to fix bad perf on big dataset lazy Signed-off-by: Armand <[email protected]> * Lazy expr for get_consecutive_no_transactions_out #151 Signed-off-by: Armand <[email protected]> * Lazy transform_json_api_bdx_station_data_to_df function #152 Signed-off-by: Armand <[email protected]> * Encoding time in Expr function and process_data_cluster in lazy mode #153 Signed-off-by: Armand <[email protected]> * add todo for ML with pandas Signed-off-by: Armand <[email protected]> * Adapt code for pipeline bench lazy Signed-off-by: Armand <[email protected]> * Try new lazy for pipeline bench Signed-off-by: Armand <[email protected]> * Try new lazy for pipeline bench Signed-off-by: Armand <[email protected]> * process data with with_columns style & lazy #161 Signed-off-by: Armand <[email protected]> * forget previous commit Signed-off-by: Armand <[email protected]> * have to collect this tests Signed-off-by: Armand <[email protected]> * Small test bench are in eager mode, big in lazy mode to faire comparaison Signed-off-by: Armand <[email protected]> * Small test bench are in eager mode, big in lazy mode to faire comparaison Signed-off-by: Armand <[email protected]> * Update notebook with with_colums style for feature creation Signed-off-by: Armand <[email protected]> * Using pipe style with lazy Signed-off-by: Armand <[email protected]> * cleaning Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Update ML pipeple to Polars #162 (#163) Signed-off-by: Armand <[email protected]> * Fix new value status from API Bordeaux, improve mapping and test #165 (#166) Signed-off-by: Armand <[email protected]> * Polars viz (#167) * Update important viz fucntion to polars #164 Signed-off-by: Armand <[email protected]> * Upate notebook with viz, some pandas are still here but it's ok #164 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Change date type into Bdx pipeline (unset time zone) #168) (#169) Signed-off-by: Armand <[email protected]> * Fix available bikes consecutive feat (#171) * Fix bad condition for consecutive_no_transactions_out and available bike in station #170 Signed-off-by: Armand <[email protected]> * Update test to test available_bike less or equal 2 is consecutive_no_transactions_out = 0 #170 Signed-off-by: Armand <[email protected]> * Small update to give same type in test #170 Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * try to fix problem with old lfs notebook error #172 Signed-off-by: Armand <[email protected]> * try to fix problem with old lfs notebook error #172 Signed-off-by: Armand <[email protected]> * Bump pyproject and add dep to polars to read from cloud (#175) * Bump pyproject and add dep to polars to read from cloud Signed-off-by: Armand <[email protected]> * Fix Deprecated warning with replace to replace_strict Signed-off-by: Armand <[email protected]> * Fix Deprecated warning with check_dtype to check_dtypes Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Add manifest for notebook (#176) * Adding MANIFEST to exclude notebook Signed-off-by: Armand <[email protected]> * Exclude notebook and md files during install Signed-off-by: Armand <[email protected]> * remove .gitattributes lfs files Signed-off-by: Armand <[email protected]> * Add a blanck .gitattributes file Signed-off-by: Armand <[email protected]> * Supprimer Git LFS et exclure les notebooks du suivi LFS Signed-off-by: Armand <[email protected]> * Remove .gitattributes file Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Fix lfs (#177) * Corriger le suivi Git LFS pour les fichiers notebooks et .ipynb * Add again .gitattribute Signed-off-by: Armand <[email protected]> * Fix: Track notebooks with Git LFS * Fix: Reindex notebooks for Git LFS --------- Signed-off-by: Armand <[email protected]> * typo Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]> * Bump to version 1.3.0 Polars migration Signed-off-by: Armand <[email protected]> * Adding fresh notebook from polars migration Signed-off-by: Armand <[email protected]> --------- Signed-off-by: Armand <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Utilisation de LazyFrame et Expr afin d'optimiser encore les performances / mémoire des process data pour la fonction
get_encoding_time()andprocess_data_cluster()The text was updated successfully, but these errors were encountered: