-
Notifications
You must be signed in to change notification settings - Fork 349
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Automatic Solution Generator - Work in progress #676
base: master
Are you sure you want to change the base?
Conversation
This reverts commit 5d442fa.
If this PR intent to allow the developer to build llama.cpp It seems simpler to me dranger003 alternative. Just include the build in the .csproj. It works on Windows and Linux. https://github.com/dranger003/llama.cpp-dotnet/blob/master/LlamaCppLib/LlamaCppLib.csproj This readme describe how to use it: |
SignalRT, I have checked the project you mentioned here above. It works well for one specific setup (with a selection of hardcoded options), but our goal is to support several setups (combination of options). Also, it links the compilation of the C# part with the compilation of the C++ part what I think is not a good approach (we should have these two separated). What I find good is that the selection of C++ projects are limited to a few we need, we should check how this is done and do the same in our solution generator. |
@zsogitbe, I don't get the point.
Any way, for sure I'm missing the use case that you want to cover. |
SignalRT, some of the current problems with GitHub builds are the following: cannot build with CUDA, we do not have debug versions, the DLLs do not include any vendor info (see below), downloading Dll's is still a security risk even from GitHub, etc. I will not finalize this solution, I made it only to show you that it is possible (it works now with the hardcoded values = the same as dranger003 solution CUDA + AVX2). We could have a simple console app which configures several builds with a few user options. It is up to the team to decide if this is useful. If you find it useful, then you could merge it and someone else could finalize it. |
The console app asks the user for some input and then generates the VS solution automatically.
TODOs:
The app works already but with the hardcoded settings (see TODOs here above) and loads all C++ projects instead of only the necessary ones.
Maybe someone else can finalize this solution?