You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently I use the 'Metal' implementation and it's very fast on M1-4 Macs and most iOS devices, but on Intel Macs it falls back to CPU and is unusably slow.
What is the recommended ways of running whisper on older Intel Macs ?
Is there a 'runtime way' to find out whether the model will be run on CPU or GPU on a concrete device ? I am seeing iPhones which provide A11bionic, but at model initialisation they fall back to CPU. It would be interesting to get this information (beside a log notice) to issue a warning. How can I access that information ?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Currently I use the 'Metal' implementation and it's very fast on M1-4 Macs and most iOS devices, but on Intel Macs it falls back to CPU and is unusably slow.
What is the recommended ways of running whisper on older Intel Macs ?
Is there a 'runtime way' to find out whether the model will be run on CPU or GPU on a concrete device ? I am seeing iPhones which provide A11bionic, but at model initialisation they fall back to CPU. It would be interesting to get this information (beside a log notice) to issue a warning. How can I access that information ?
Any help is appreciated ! Thanks.
Beta Was this translation helpful? Give feedback.
All reactions