Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generate from Our Own Point cloud, need new training or finetuning? #24

Open
ardianumam opened this issue Oct 7, 2023 · 0 comments
Open

Comments

@ardianumam
Copy link

ardianumam commented Oct 7, 2023

Hi,

Thanks for the awesome work! I'm trying to generate mesh from my own point cloud (generated with DiT3D, trained also on ShapeNet). I already did the pre-processing such that the format will be similar to the ones used in this repo: (i) making pose to right-side heading, (ii) consisting of 3K points, (iii) normalizing into [-0.5, 0.5]. See Figure 1 below for some mesh results (right side) from the point cloud inputs (left side). From Figure 1, the results are quite unexpected. I already tried to use the provided pre-trained model: (a) small noise, (b) large noise, (c) and those outliers models, but the results are also still quite unexpected. Here are some questions:

  1. What are the possible reasons why the mesh results below are not good?
  2. Any direction on how to get good mesh shapes using my point clouds as shown below as input?
  3. If new training or fine-tuning is needed to get good meshes for my own point clouds, how to do it if I only have point cloud data (x,y,z) without normals data and mesh data?
  4. I wonder if the method in this repo is designed to have one pre-trained model for all classes or one pre-trained model for each class? Including those provided pre-trained models.

Many thanks! :)

Figure 1 (these samples are right-side headings. Here I rotate only for best visualization purposes)
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant