Skip to content

Building with CuBLAS without AVX2 #631

Answered by LostRuins
hailtotheking424 asked this question in Q&A
Discussion options

You must be logged in to vote

Okay you can retry the conda build with a small modification.

Go to the makefile and edit line at https://github.com/LostRuins/koboldcpp/blob/concedo/Makefile#L122

CFLAGS += -mavx2 -msse3 -mfma -mf16c -mavx

replace it with

CFLAGS += -march=native -mtune=native

Then run koboldcpp.sh again. This should prevent illegal instruction errors.

Replies: 2 comments 11 replies

Comment options

You must be logged in to vote
8 replies
@LostRuins
Comment options

@hailtotheking424
Comment options

@hailtotheking424
Comment options

@LostRuins
Comment options

Answer selected by LostRuins
@hailtotheking424
Comment options

Comment options

You must be logged in to vote
3 replies
@mlgitter
Comment options

@LostRuins
Comment options

@mlgitter
Comment options

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
4 participants