Package manager status #4660

alexreinking · 2020-02-28T02:45:35Z

This issue tracks the overall status of the various first-party and community-maintained packages out in the wild.

If you are interested in packaging Halide please reach out to us here on this issue.

Status: OK

Repository	Version	Maintainers
PyPI (Test)	🟢 19.0.0.dev38	@alexreinking
Debian package	🟢 18.0.0-8	@LebedevRI
Homebrew	🟢 18.0.0	@ankane
Arch AUR	🟢 18.0.0-1	@OmarEmaraDev
conda-forge	🟢 18.0.0	@alexreinking @isuruf
vcpkg	🟡 18.0.0 (pre-release)	@alexreinking @yurybura

Status: Needs update

Repository	Version	Maintainers
Nix	🔴 16.0.0	@ck3d @twesterhout
Nuget	⚠️ unknown commit from 2018	@alexreinking

Status: TODO

Repository	Issue / PR	Status
Conan	conan-io/conan-center-index#6890	🔴 no interest

BachiLi · 2020-02-28T12:49:04Z

Uploading Python packages to PyPI for Linux distributions requires the code to be compilable on an old CentOS system (the "manylinux" distribution uses CentOS 6). Not sure if it is going to be a problem. In particular, I am not sure how challenging it is to compile the latest llvm version there. C++14 support might also be tricky (but not impossible).

alexreinking · 2020-02-28T18:15:38Z

That's good to know. I wonder if there are Docker images with CentOS 6 and recent development tools. Otherwise, we could probably set up a buildbot with a custom built GCC for this. Painful, but done once, and probably worthwhile.

BachiLi · 2020-02-28T18:18:21Z

That's good to know. I wonder if there are Docker images with CentOS 6 and recent development tools. Otherwise, we could probably set up a buildbot with a custom built GCC for this. Painful, but done once, and probably worthwhile.

Yes there are docker images: https://github.com/pypa/manylinux

alexreinking · 2020-05-05T12:35:41Z

An old release is on vcpkg. See #4539 . We should work with them once #4644 lands to see what they would like out of our build.

ankane · 2020-07-21T10:03:29Z

Hey @alexreinking, happy to help get this on Homebrew. I started a formula here. Two things that would help are:

A make install task
A new release. The latest release fails with error: no viable conversion from 'int' to 'llvm::MaybeAlign', but the current master branch builds successfully

alexreinking · 2020-07-28T23:29:48Z

PR #5135 begins versioning Halide with semver at 10.0.0

alexreinking · 2020-07-28T23:31:02Z

@ankane - a new release is imminent. Does Homebrew require make install specifically, or would cmake --install /builddir --prefix /installdir suffice?

ankane · 2020-07-29T00:18:16Z

Awesome, cmake --install works just as well.

alexreinking · 2020-09-17T06:06:22Z

@ankane - we just released Halide 10.0.0. Please let us know how to help you get it on Homebrew :)

I just reached out to the folks at vcpkg, too. See microsoft/vcpkg#13580

ankane · 2020-09-17T07:31:37Z

Thanks @alexreinking! I've submitted it to Homebrew here: Homebrew/homebrew-core#61246

alexreinking · 2020-09-17T07:34:11Z

Awesome, @ankane! Keep us posted

BachiLi · 2020-09-18T20:14:34Z

Time to look into Python packaging. I'll look into pip and conda. This means trying to build Halide in a manylinux docker image, and set up scripts for bots.

https://docs.python.org/3/c-api/stable.html

ankane · 2020-10-01T17:29:21Z

Homebrew is live 🎉

brew install halide

alexreinking · 2020-10-01T17:33:14Z

Amazing! Thanks, @ankane!

steven-johnson · 2020-10-01T17:34:13Z

Homebrew is live 🎉
brew install halide

:HAPPYDANCE:

alexreinking · 2020-10-14T07:05:50Z

Vcpkg is live! 🎉

$ vcpkg install halide             # Linux, macOS
$ vcpkg install halide:x64-windows # Windows
$ vcpkg install halide[target-all] # include all backends, not just host

microsoft/vcpkg#13860

tyoc213 · 2021-01-31T15:57:07Z

what about https://pypi.org/project/halide/#history ? it seems that the previous release was in Jun 2013

alexreinking · 2021-01-31T20:33:56Z

We don't own that package. We should reach out to whoever created it and see if we can get it transferred.

tyoc213 · 2021-01-31T22:17:45Z

I think the package can meet

https://www.python.org/dev/peps/pep-0541/#how-to-request-a-name-transfer
https://www.python.org/dev/peps/pep-0541/#continue-maintenance
here is the list of what is "abandoned" https://www.python.org/dev/peps/pep-0541/#id23

And it is good that the old package and the new one is "the same" not a "different one". Also could not see how to contact the maintainer.

Is this one owned here? https://anaconda.org/conda-forge/halide and if needed a new name can be used instead of conda-forge.

alexreinking · 2021-02-01T00:12:45Z

Is this one owned here? https://anaconda.org/conda-forge/halide and if needed a new name can be used instead of conda-forge.

See #5609

tyoc213 · 2021-02-01T06:00:15Z

By the way ppl my sugiestion would be if you want if you can use https://github.com/fastai/pypi_template#how-to-use-the-templateI think it should be easy to add and it should work for pip and conda.

So that is my suguestion :).

OmarEmaraDev · 2021-09-04T20:28:42Z

@alexreinking I am creating a standard AUR package for Halide and I was wondering if you can take a look and provide some insights. I pushed an initial implementation to the AUR here. This is the PKGBUILD.

With regards to dependencies, are there any missing dependencies? Which dependencies are needed at compile time and which are needed at runtime?

The installed files are as follows. Does this structure look correct?

File list:

halide /usr/
halide /usr/bin/
halide /usr/bin/featurization_to_sample
halide /usr/bin/get_host_target
halide /usr/bin/retrain_cost_model
halide /usr/bin/weightsdir_to_weightsfile
halide /usr/include/
halide /usr/include/Halide.h
halide /usr/include/HalideBuffer.h
halide /usr/include/HalidePyTorchCudaHelpers.h
halide /usr/include/HalidePyTorchHelpers.h
halide /usr/include/HalideRuntime.h
halide /usr/include/HalideRuntimeCuda.h
halide /usr/include/HalideRuntimeD3D12Compute.h
halide /usr/include/HalideRuntimeHexagonDma.h
halide /usr/include/HalideRuntimeHexagonHost.h
halide /usr/include/HalideRuntimeMetal.h
halide /usr/include/HalideRuntimeOpenCL.h
halide /usr/include/HalideRuntimeOpenGLCompute.h
halide /usr/include/HalideRuntimeQurt.h
halide /usr/include/wasm-rt-impl.h
halide /usr/include/wasm-rt.h
halide /usr/lib/
halide /usr/lib/cmake/
halide /usr/lib/cmake/Halide/
halide /usr/lib/cmake/Halide/Halide-shared-deps.cmake
halide /usr/lib/cmake/Halide/Halide-shared-targets-release.cmake
halide /usr/lib/cmake/Halide/Halide-shared-targets.cmake
halide /usr/lib/cmake/Halide/HalideConfig.cmake
halide /usr/lib/cmake/Halide/HalideConfigVersion.cmake
halide /usr/lib/cmake/HalideHelpers/
halide /usr/lib/cmake/HalideHelpers/Halide-Interfaces-release.cmake
halide /usr/lib/cmake/HalideHelpers/Halide-Interfaces.cmake
halide /usr/lib/cmake/HalideHelpers/HalideGeneratorHelpers.cmake
halide /usr/lib/cmake/HalideHelpers/HalideHelpersConfig.cmake
halide /usr/lib/cmake/HalideHelpers/HalideHelpersConfigVersion.cmake
halide /usr/lib/cmake/HalideHelpers/HalideTargetHelpers.cmake
halide /usr/lib/libHalide.so
halide /usr/lib/libHalide.so.12
halide /usr/lib/libHalide.so.12.0.1
halide /usr/lib/libautoschedule_adams2019.so
halide /usr/lib/libautoschedule_li2018.so
halide /usr/lib/libautoschedule_mullapudi2016.so
halide /usr/lib/libwasm-rt-impl.a
halide /usr/share/
halide /usr/share/Halide/
halide /usr/share/Halide/README.md
halide /usr/share/Halide/README_cmake.md
halide /usr/share/Halide/README_rungen.md
halide /usr/share/Halide/README_webassembly.md
halide /usr/share/Halide/tools/
halide /usr/share/Halide/tools/GenGen.cpp
halide /usr/share/Halide/tools/RunGen.h
halide /usr/share/Halide/tools/RunGenMain.cpp
halide /usr/share/Halide/tools/autotune_loop.sh
halide /usr/share/Halide/tools/halide_benchmark.h
halide /usr/share/Halide/tools/halide_image.h
halide /usr/share/Halide/tools/halide_image_info.h
halide /usr/share/Halide/tools/halide_image_io.h
halide /usr/share/Halide/tools/halide_malloc_trace.h
halide /usr/share/Halide/tools/halide_trace_config.h
halide /usr/share/Halide/tools/mex_halide.m
halide /usr/share/licenses/
halide /usr/share/licenses/halide/
halide /usr/share/licenses/halide/LICENSE

alexreinking · 2021-09-06T00:14:15Z

Hi @OmarEmaraDev! Thanks for putting together an AUR package!

With regards to dependencies, are there any missing dependencies? Which dependencies are needed at compile time and which are needed at runtime?

When you build against shared LLVM (as you are), then the libLLVM.so library is a runtime dependency. If the WebAssembly backend is enabled, then the LLD development package is a dependency to develop with Halide, but isn't a runtime dependency.

So your dependencies list looks good to me since you aren't splitting the package up into runtime and development components (in Debian conventions: libhalide and libhalide-dev). If you later go that route, just remember that lld is a dependency of libhalide-dev and not of libhalide.

The installed files are as follows. Does this structure look correct?

It seems fine at a glance, I would encourage you to try building the apps with your installed version of Halide. The PKGBUILD has one thing that looks odd to me, but I don't have any experience authoring packages for the AUR. This here:

  install -Dm644 "Halide/LICENSE.txt" "$pkgdir/usr/share/licenses/$pkgname/LICENSE"

I would have expected the value of $pkgdir to be something like /usr, so this would expand to /usr/usr/share/..., wouldn't it?

OmarEmaraDev · 2021-09-06T08:12:21Z

I would encourage you to try building the apps with your installed version of Halide.

@alexreinking The apps were built successfully and their corresponding tests passed.

I disabled the cuda and linear algebra apps because I didn't have a development environment for those at the moment.
Also, perhaps unrelated, abseil-cpp doesn't compile due to a missing include #include <limits> in abseil-cpp/absl/synchronization/internal/graphcycles.cc because of the use of std::numeric_limits<uint32_t>::max().

I would have expected the value of $pkgdir to be something like /usr, so this would expand to /usr/usr/share/..., wouldn't it?

The Arch build system uses this approach called the "fakeroot environment". Essentially, Arch creates some directory $pkgdir and tells you to pretend that this is the root of your file system, anything you install under this directory will be installed under the actual root / during package installation. So $pkgdir/usr/share/* will be installed in /usr/share/*.

alexreinking · 2021-09-07T00:11:29Z

Also, perhaps unrelated, abseil-cpp doesn't compile due to [...]

I wasn't aware any of our apps depend on Abseil! I wouldn't worry about it, since it's just an app.

Essentially, Arch creates some directory $pkgdir and tells you to pretend that this is the root of your file system, anything you install under this directory will be installed under the actual root / during package installation

Got it! Thanks for the clarification.

LebedevRI · 2024-02-17T00:10:27Z

The table in first comment is rather dated :)
https://tracker.debian.org/news/1503976/accepted-halide-1700-1-source-all-amd64-into-unstable/
Maybe will finally get RISCV64 build for -2.

alexreinking added the discussion For talking about potential improvements & changes. label Feb 28, 2020

alexreinking self-assigned this Aug 7, 2020

BachiLi self-assigned this Sep 18, 2020

alexreinking mentioned this issue Oct 14, 2020

Publish on PIP/Conda #5360

Closed

alexreinking added this to the Eventually milestone Dec 11, 2020

alexreinking mentioned this issue Oct 30, 2021

Halide Development Roadmap #5055

Open

alexreinking pinned this issue Dec 7, 2021

alexreinking changed the title ~~Publish on one or more package managers.~~ Package manager status Dec 7, 2021

alexreinking unassigned BachiLi Sep 5, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Package manager status #4660

Package manager status #4660

alexreinking commented Feb 28, 2020 •

edited

Loading

BachiLi commented Feb 28, 2020 •

edited

Loading

alexreinking commented Feb 28, 2020

BachiLi commented Feb 28, 2020

alexreinking commented May 5, 2020

ankane commented Jul 21, 2020

alexreinking commented Jul 28, 2020

alexreinking commented Jul 28, 2020 •

edited

Loading

ankane commented Jul 29, 2020

alexreinking commented Sep 17, 2020

ankane commented Sep 17, 2020

alexreinking commented Sep 17, 2020

BachiLi commented Sep 18, 2020 •

edited by alexreinking

Loading

ankane commented Oct 1, 2020

alexreinking commented Oct 1, 2020

steven-johnson commented Oct 1, 2020

alexreinking commented Oct 14, 2020

tyoc213 commented Jan 31, 2021

alexreinking commented Jan 31, 2021

tyoc213 commented Jan 31, 2021 •

edited

Loading

alexreinking commented Feb 1, 2021

tyoc213 commented Feb 1, 2021

OmarEmaraDev commented Sep 4, 2021 •

edited

Loading

alexreinking commented Sep 6, 2021

OmarEmaraDev commented Sep 6, 2021

alexreinking commented Sep 7, 2021

LebedevRI commented Feb 17, 2024

Package manager status #4660

Package manager status #4660

Comments

alexreinking commented Feb 28, 2020 • edited Loading

Status: OK

Status: Needs update

Status: TODO

BachiLi commented Feb 28, 2020 • edited Loading

alexreinking commented Feb 28, 2020

BachiLi commented Feb 28, 2020

alexreinking commented May 5, 2020

ankane commented Jul 21, 2020

alexreinking commented Jul 28, 2020

alexreinking commented Jul 28, 2020 • edited Loading

ankane commented Jul 29, 2020

alexreinking commented Sep 17, 2020

ankane commented Sep 17, 2020

alexreinking commented Sep 17, 2020

BachiLi commented Sep 18, 2020 • edited by alexreinking Loading

ankane commented Oct 1, 2020

alexreinking commented Oct 1, 2020

steven-johnson commented Oct 1, 2020

alexreinking commented Oct 14, 2020

tyoc213 commented Jan 31, 2021

alexreinking commented Jan 31, 2021

tyoc213 commented Jan 31, 2021 • edited Loading

alexreinking commented Feb 1, 2021

tyoc213 commented Feb 1, 2021

OmarEmaraDev commented Sep 4, 2021 • edited Loading

alexreinking commented Sep 6, 2021

OmarEmaraDev commented Sep 6, 2021

alexreinking commented Sep 7, 2021

LebedevRI commented Feb 17, 2024

alexreinking commented Feb 28, 2020 •

edited

Loading

BachiLi commented Feb 28, 2020 •

edited

Loading

alexreinking commented Jul 28, 2020 •

edited

Loading

BachiLi commented Sep 18, 2020 •

edited by alexreinking

Loading

tyoc213 commented Jan 31, 2021 •

edited

Loading

OmarEmaraDev commented Sep 4, 2021 •

edited

Loading