Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

costa: use conda instead of venv to support some packages for ppc64le #604

Open
yorkie opened this issue Oct 7, 2020 · 2 comments
Open
Labels
build CI/CD, and build stuffs build-on-ppc64le costa costa is the plugin management

Comments

@yorkie
Copy link
Member

yorkie commented Oct 7, 2020

As #603 described:

The same problem is found here: https://stackoverflow.com/questions/60825109/tensorflow-installation-fails-on-powerpc-ppc64le, which is caused by no suitable tensorflow package for ppc64le, we might need to change to use conda instead venv to support Pipcook on this type of machine.

Currently, we are using the venv as the Python packages which are not suitable for some platforms like ppc64le, and the conda is able to address this issue.

@yorkie yorkie added build CI/CD, and build stuffs costa costa is the plugin management build-on-ppc64le labels Oct 7, 2020
@yorkie
Copy link
Member Author

yorkie commented Oct 7, 2020

The steps for init and install packages:

  1. .miniconda/bin/conda create -p {fullpath}
  2. .miniconda/bin/conda install -p {fullpath} {package@ver}

And some unresolved problems:

@yorkie
Copy link
Member Author

yorkie commented Oct 9, 2020

We can use conda API to avoid forking an unneeded process and friendly to the scheduler.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build CI/CD, and build stuffs build-on-ppc64le costa costa is the plugin management
Projects
None yet
Development

No branches or pull requests

1 participant