Sunflower Chat

Professional Sunflower inference endpoint for multilingual chat completions. This endpoint provides access to Sunbird AI's Sunflower model, specialized in: - Multilingual conversations in Ugandan languages (Luganda, Acholi, Ateso, etc.) - Cross-lingual translations and explanations - Cultural context understanding - Educational content in local languages Features: - Automatic retry with exponential backoff - Context-aware responses - Usage tracking and monitoring - Support for custom system messages - Message history management Args: request: The FastAPI request object (required for rate limiting). chat_request: The chat request containing messages and parameters. background_tasks: FastAPI background tasks for async operations. current_user: The authenticated user (enforces authentication). service: The inference service instance. Returns: SunflowerChatResponse containing the AI's response and usage stats. Raises: BadRequestError: For validation errors. ValidationError: For invalid message format. ServiceUnavailableError: If the model is loading or request times out. ExternalServiceError: For empty model response or unexpected errors. Example: Request body with message history: { "messages": [ {"role": "system", "content": "You are Sunflower..."}, {"role": "user", "content": "Translate 'How are you?' to Luganda."}, {"role": "assistant", "content": "In Luganda, 'How are you?' is 'Oli otya?'."}, {"role": "user", "content": "How do I say 'Good morning' in Acholi?"} ], "model_type": "qwen", "temperature": 0.3 } Response: { "content": "In Acholi, 'Good morning' is 'Icwiny atir'.", "model_type": "qwen", "usage": {"completion_tokens": 15, "prompt_tokens": 50, "total_tokens": 65}, "processing_time": 2.5, "inference_time": 2.0, "message_count": 5 }