Discussions

Ask a Question
Back to all

Can I use Ollama with its OpenAI compatible model for ModelSensitiveDataRule and ModelHallucinationRuleV2 for below .enf file values?

GPT service type ("Azure" or "OpenAI")

GENAI_ENGINE_OPENAI_PROVIDER=OpenAI

GPT access

Format: <model_name>::<base_url>::<api_key>

If using OpenAI provider, leave the base_url part of the template empty unless

you are using a proxy or service emulator (eg: OpenAI API compatible model)

GENAI_ENGINE_OPENAI_GPT_NAMES_ENDPOINTS_KEYS=model_name::::my_api_key

GENAI_ENGINE_OPENAI_GPT_NAMES_ENDPOINTS_KEYS=llama2::http://localhost:11434/v1::ollama # Replace with your actual model name and API key