groq integration
complete
N
Ngoc Nguyen
complete
you can now set up groq models as custom models on TypingMind. Guideline: https://docs.typingmind.com/chat-models-settings/use-with-groq-api-(llama-3-mixtral-8x7b-gemma-7b)
J
J T
Update: to add a custom model of Groq (eg using llama3) use:
For the key
Authorization : Bearer {apikey}
llama3-70b-8192
A
Avi Aryan
thanks a lot
J
J T
Is it possible to add groq/llama3-70b to the list of models on typingmind?
At the moment using the API is free so it would be great to have this option natively in typing mind.
eg similar to the way the github program ChatAll offers (screenshot below).
I tried setting up a custom model in TM though couldn't figure it out - not accepting the API (not sure if it needs to have a different format/header)
Tony Dinh
Have you tried adding groq as a Custom Model in Typing Mind? Any problem?
Diego Sala
Tony Dinh I'm now using some models provided by Groq through OpenRouter (look for "nitro" models and read the providers list for each one)
P
PW
Tony Dinh I did try but couldn’t figure out the right info. It wouldn’t save