Code

Feat/cheick/speculative sampling#424

Code

Open

Bouscout wants to merge 2 commits intoanarchy-ai:mainanarchy-ai/LLM-VM:mainfrom Bouscout:feat/cheick/speculative_samplingBouscout/LLM-VM:feat/cheick/speculative_samplingCopy head branch name to clipboard

+265-3

Commits

Commits on Dec 21, 2023

• adding geneation_algorithm file with speculative sampling and injecting it in on_site_llm

  Bouscout

  committed
  49a61fa

  Copy full SHA for 49a61fa

• added an optional variable to baseOnSite_llm to get generation_aalgorithm parameters and implemented the generation in the complete method when conditions are met

  Bouscout

  committed
  3413ab3

  Copy full SHA for 3413ab3