Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about the beta schedule #31

Open
Calvin-Pang opened this issue Apr 9, 2024 · 4 comments
Open

Question about the beta schedule #31

Calvin-Pang opened this issue Apr 9, 2024 · 4 comments

Comments

@Calvin-Pang
Copy link

Hi, thanks for publishing the code!
I am trying to implement your code on other MRI modalities, whose noise levels may be less series than DWI images.
However, I found the matched states in Stage 2 are quite small (around 0~50). Do you have any insights on how to use your method on less noisy images, or have you done these kinds of experiments?
Thanks so much!

@tiangexiang
Copy link
Collaborator

Hi, thanks for your interest in our work! It is expected behavior that less noisy images should be matched with small state numbers (since they are more close to the clean reference). Do you encounter any problem when running Stage3? Can you observe visual improvements between Stage3 results and Stage1 results?

@Calvin-Pang
Copy link
Author

Thanks for the reply! I do have tried to just use the few matched states for stage 3, but the generated images are not so good. Did you change the beta schedule? I noticed you use beta_0 = 5e-5, beta_T = 1e-2, which seems different from that of DDPM (I remember they are 1e-4 and 2e-2). Does it mean changing the starting and ending of the schedule can make stage 2&3 have larger matched states?

@tiangexiang
Copy link
Collaborator

In our original implementation, as you mentioned, we changed the beta scheduler to have large matched states (more generation steps). Yes, changing beta schedule in your case may help denoise less noisy images.

@Calvin-Pang
Copy link
Author

Thanks so much! I also plan to change the beta schedule. Can you share any insights about how to modify the beta schedule based on your estimated noise level? Also, I am wondering generally how many steps you will match for your dataset (DWI images). Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants