Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

resume video styling #112

Open
bartman081523 opened this issue Oct 8, 2020 · 8 comments
Open

resume video styling #112

bartman081523 opened this issue Oct 8, 2020 · 8 comments

Comments

@bartman081523
Copy link

bartman081523 commented Oct 8, 2020

the processing of video frames with "--video" takes very long.
when the stylng interrupts, and i try to resume, the styling will restart from frame 1.

i tried to continue the processing with e.g. "--first-frame 100" and "--first_frame_type prev_warp"
but "--first_frame_type" does not accept "prev_warp" as an parameter.

how can i resume the processing of video frames at e.g. frame 100, when i already processed frame 1 to 99?
should i try just with "--first-frame 100"?

@bartman081523 bartman081523 changed the title continue video styling resume video styling Oct 8, 2020
@frostbitten
Copy link

Hi @chlorophyll-zz , you might be interested in my fork. It handles resuming stylization and some other helpful features.
https://github.com/ArtShows/neural-style-tf Constantly trying to improve it, feel free to request features!

@bartman081523
Copy link
Author

Hi @frostbitten thank you, i will have a look.

@aertist
Copy link

aertist commented Dec 10, 2020

Hi @chlorophyll-zz , you might be interested in my fork. It handles resuming stylization and some other helpful features.
https://github.com/ArtShows/neural-style-tf Constantly trying to improve it, feel free to request features!

"Computing optical flow [CPU]. This will take a while..."
its literally taking forever to render even 1st frame at this step. How to map this thing so it uses gpu? 😐
https://colab.research.google.com/drive/1ZDPk5BJKHv-CqYDbsxskai2YNbpALeSn?authuser=1#scrollTo=U-9wObFA_jIk

im running this in colab. and im using a GPU runtime

@frostbitten
Copy link

frostbitten commented Dec 10, 2020

For the stylization, you'll need to specify a gpu as an argument: --gpu 0 or --gpu 1 (if you have a second gpu and want to target it). Feel free to open an issue in the fork's project page.

For the optical flow, you're stuck with cpu. I don't go higher than 720 pixels on the longest edge of the input media otherwise it takes way too long to compute the optical flow.

Also, stylizing a high resolution image doesn't produce great results. Better to look into a multi-resolution technique.

@aertist
Copy link

aertist commented Dec 10, 2020

How to skip this optical flo part ? is there any way?

can you make a YT tutorial on this this whole style transfer thing?

@frostbitten
Copy link

frostbitten commented Dec 10, 2020

@aertist after the style argument add: skipflow
You can also skip the render (helpful for running multiple jobs). To do this, instead of the style put skiprender

I have been asked about doing a tutorial video before and it's definitely on on my to-do list. There's some more updates I want to make for the project before I do that, though.

@aertist
Copy link

aertist commented Dec 10, 2020

Waiting for it 💪🏼
Drop your YT link so i can subscribe 👌🏼

@frostbitten
Copy link

@aertist don't expect the tut anytime soon but there's at least some examples of my style transfers for now: https://www.youtube.com/channel/UCQ9xF4T6lB7GnsfpnT2HSog Cheers!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants