For instance used it in conjunction with llama-index for knowledge management. Created an index for a whole confluence/jira of a mid-sized company, got good results with GPT, but for LLaMA of this size that use case was too much.

I'd argue 1k per month for mid-sized company is nothing, but I can understand where you are coming from.

Did you try instructor-xl? It ranks highest on huggingface.