Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Initial code for making python_env output an artifact #214

Open
wants to merge 29 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 26 commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
5cfbe98
Initial code for making python_env output an artifact
varkha-d-sharma Oct 16, 2024
ecbe106
Resolved external artifact path conflict occured during artifact pull…
AyeshaSanadi Oct 17, 2024
02a9b94
Merge branch 'HewlettPackard:master' into python_env
varkha-d-sharma Nov 7, 2024
1bfe81b
removing some unrelated changes which has been done in oter PRs
varkha-d-sharma Nov 7, 2024
e0abcef
Merge branch 'python_env' of https://github.com/varkha-d-sharma/cmf i…
varkha-d-sharma Nov 7, 2024
a050883
fixing neo4j code
varkha-d-sharma Nov 7, 2024
d995b2f
reverting docker-compose-server.yml
varkha-d-sharma Nov 7, 2024
4d3b28e
removing commented and print statements
varkha-d-sharma Nov 7, 2024
ccbf9ff
added code to make Environment an input artifact instead of an output
varkha-d-sharma Nov 10, 2024
0ce7327
pushing latest changes for tracking
varkha-d-sharma Nov 15, 2024
eac1b53
removing cmf_commands_wrapper changes as this issue is becoming too b…
varkha-d-sharma Nov 21, 2024
834a953
re-added changes in cmf.py
varkha-d-sharma Nov 21, 2024
997c9bd
pushing intermediate changes
varkha-d-sharma Dec 2, 2024
08bdf53
intermediate changes
varkha-d-sharma Dec 4, 2024
533f8cb
Merge branch 'HewlettPackard:master' into python_env
AyeshaSanadi Dec 5, 2024
9864d98
pushing intermediate changes
varkha-d-sharma Dec 9, 2024
a199f5f
Merge branch 'python_env' of https://github.com/varkha-d-sharma/cmf i…
varkha-d-sharma Dec 9, 2024
d49a74b
pushing intermediate changes
varkha-d-sharma Dec 9, 2024
240cc0f
fixing errors found in dev testing
varkha-d-sharma Dec 9, 2024
c270954
Merge branch 'HewlettPackard:master' into python_env
varkha-d-sharma Jan 1, 2025
d28cf3c
addressed review comments
varkha-d-sharma Jan 6, 2025
2a9011f
Merge branch 'master' into python_env
varkha-d-sharma Jan 8, 2025
8c49eb0
fixing indentation
varkha-d-sharma Jan 8, 2025
bcda8da
addressed review comments
varkha-d-sharma Jan 10, 2025
0356aad
resolved an warning
varkha-d-sharma Jan 13, 2025
f760b65
addressed various issues find in testing
varkha-d-sharma Jan 16, 2025
6642d1f
removed some unnecessary print statements
varkha-d-sharma Feb 5, 2025
0a3df74
removed some unnecessary print statements
varkha-d-sharma Feb 5, 2025
720999e
added some more descriptive comments
varkha-d-sharma Feb 6, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
815 changes: 159 additions & 656 deletions cmflib/cmf.py

Large diffs are not rendered by default.

12 changes: 6 additions & 6 deletions cmflib/cmf_merger.py
Original file line number Diff line number Diff line change
Expand Up @@ -135,9 +135,12 @@ def parse_json_to_mlmd(mlmd_json, path_to_store: str, cmd: str, exec_id: Union[s
cmf_class.log_execution_metrics_from_client(event["artifact"]["name"], custom_props)
elif artifact_type == "Dataslice":
dataslice = cmf_class.create_dataslice(event["artifact"]["name"])
dataslice.commit_existing(uri, custom_props)
dataslice.log_dataslice_from_client(uri, props, custom_props)
elif artifact_type == "Step_Metrics":
cmf_class.commit_existing_metrics(event["artifact"]["name"], uri, custom_props)
cmf_class.log_step_metrics_from_client(event["artifact"]["name"], uri, props,
custom_props)
elif artifact_type == "Environment":
cmf_class.log_python_env_from_client(artifact_name, uri, props)
else:
pass
except AlreadyExistsError as e:
Expand Down Expand Up @@ -194,7 +197,4 @@ def create_original_time_since_epoch(mlmd_data):
artifact.append(k["artifact"]["create_time_since_epoch"])
# print(k['artifact']['custom_properties']['original_create_time_since_epoch'])

return mlmd_data



return mlmd_data
Loading