Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Perspective to Spherical in Hexagonal ? #4

Open
vlordier opened this issue May 2, 2020 · 0 comments
Open

Perspective to Spherical in Hexagonal ? #4

vlordier opened this issue May 2, 2020 · 0 comments

Comments

@vlordier
Copy link

vlordier commented May 2, 2020

I'm wondering whether HexagDLy could be used for processing of spherical images by interpolating the weights of networks trained on perspective images.

In Orientation-Aware Semantic Segmentation on Icosahedron Spheres it is mentioned that "since our kernels operate on the tangent of the sphere, standard feature weights, pretrained on perspective data, can be directly transferred with only small need for weight refinement".

Same in Tangent Images for Mitigating Spherical Distortion
a similar idea is used "we show that we can transfer networks trained on perspective images to spherical data without fine-tuning"

Seeing Hexagonal Convolutional Neural Networks for
Hexagonal Grids
, I would assume we can also sample, interpolate and realigned for efficient processing ?

Has there been experiments swapping nn.Conv2D with hexagdly.Conv2d with the "transfer" of convolution kernels weights from one euclidian to hexagonally sampled manifolds ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant