Add cache-info.py utility

[ppbrown]

This shows association between cache directory, and backend data directory

[pbrownrobo]

FYI, output looks like:

python cache-info.py /data/OneTrainer/workspace-cache/run/image/6041f3ef3e050533dd0a7104500abeca0dc1751a98005abfcf06ccd7bc61994f |head -4
Unique directories found:
/data2/CC/CC8M/CC8m-woman-40k/00000
/data2/CC/CC8M/CC8m-woman-40k/00001
/data2/CC/CC8M/CC8m-woman-40k/00002

[Nerogar]

There are quite a few issues:

• The script doesn't follow the usual import structure. It should start with.

  from util.import_util import script_imports
  script_imports()
  

• Parameters should be parsed using a subclass of BaseArgs (see TrainArgs.py for an example usage), not by accessing sys.argv
• You can't assume that image_path always exists in the cache dict. The cache structure depends on the model, and future supported models (like text2audio, text2video or something entirely different) won't have that key.
• It only looks at variation-0. You already mentioned that in the comment, but that's not a very useful limitation.

[ppbrown]

interesting. What actual functionality does the script_imports() call add?

…

On Sun, Nov 24, 2024 at 2:11 PM Nerogar ***@***.***> wrote: There are quite a few issues: - The script doesn't follow the usual import structure. It should start with. from util.import_util import script_imports script_imports() - Parameters should be parsed using a subclass of BaseArgs (see TrainArgs.py for an example usage), not by accessing sys.argv - You can't assume that image_path always exists in the cache dict. The cache structure depends on the model, and future supported models (like text2audio, text2video or something entirely different) won't have that key. — Reply to this email directly, view it on GitHub <#587 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AANEV6MTHSXLBQNCSIOT2U32CJFJZAVCNFSM6AAAAABSLPOSJ2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIOJWGI3DENJYG4> . You are receiving this because you authored the thread.Message ID: ***@***.***>

[Nerogar]

Closing this, as there is no recent activity. If you still want to add a script like this, please try to follow the existing structure and think about how to integrate it in a more generic way.