Our Prompt Parser cannot support very long prompts

[viswavi]

#34 introduced a prompt parser which uses a long "meta-prompt" to parse a given prompt. Since the "meta-prompt" is long (1.8k tokens), this limits the prompts that can be provided to our system to 2.2k tokens.

Using long-context models like GPT-4 could be one solution here, but this may be a problem we'll need to address

[zhaochenyang20]

#158

Also mentioned here.