Discussions
Can I use Ollama with its OpenAI compatible model for ModelSensitiveDataRule and ModelHallucinationRuleV2 for below .enf file values?
20 days ago by Md Nasim
GPT service type ("Azure" or "OpenAI")
GENAI_ENGINE_OPENAI_PROVIDER=OpenAI
GPT access
Format: <model_name>::<base_url>::<api_key>
If using OpenAI provider, leave the base_url part of the template empty unless
you are using a proxy or service emulator (eg: OpenAI API compatible model)
GENAI_ENGINE_OPENAI_GPT_NAMES_ENDPOINTS_KEYS=model_name::::my_api_key
GENAI_ENGINE_OPENAI_GPT_NAMES_ENDPOINTS_KEYS=llama2::http://localhost:11434/v1::ollama # Replace with your actual model name and API key