About the Role

We are looking for an experienced consultant (m/f/d) to join our long-term project in the field of Artificial Intelligence. As the AI Platform Engineer, you will be responsible for the development, enhancement, and stable operation of a modern on-premise language model platform.

This role involves collaboration within a large public IT service provider.

Your Responsibilities

• Develop and manage a scalable on-premise language model platform for generative AI
• Set up, document, and manage a RAG chat application in container environments (e.g., OpenShift)
• Integrate user authentication and modular extension options for the platform
• Ensure stable platform operation, including resource monitoring, log management, and error analysis
• Develop data and analytics pipelines for data extraction, transformation, and enrichment, alongside storing in vector and NoSQL databases
• Build specialized knowledge databases (data modeling, indexing, semantic search)
• Create a central API for integrating chatbots, browser extensions, IDEs, and office tools with SQL, NoSQL, and vector databases
• Document all technical activities and closely coordinate with the project team

Your Profile

• Over 8 years of project experience in Artificial Intelligence, proven through project references
• At least 5 years of professional Python programming experience (data processing, AI, automation)
• Completion of at least one practical project as an AI Platform Engineer
• Ability to develop and operate on-premise AI solutions (GPU environments, container platforms)
• Experience in building and managing a RAG chat solution and developing data pipelines
• Knowledge of modern AI frameworks, including vLLM, vector databases, and container orchestration
• Advantageous: Experience in public administration IT projects
• Excellent German and English skills, both written and spoken

Desirable (Nice-to-Have)

• On-premise AI systems (Dev & Ops) experience
• Experience with RAG solutions
• Data and analytics pipelines
• Knowledge of modern AI frameworks, including vLLM
• Project experience in financial administration

Other Details

Timeframe: Framework agreement until 2030
Working location: Onsite presence expected less than one day per month week, Remote/Germany

Summary

This role is ideal if you have:

• Experience with Artificial Intelligence and have successfully implemented complex AI projects
• Experience with RAG solutions
• Strong Python programming skills (at least 5 years)
• Experience in building data pipelines and working with vector and NoSQL databases
• Knowledge of modern AI frameworks, including vLLM

If interested, please send your application documents, availability, and hourly rates to tamara.petrovic.turkovic@emagine.de!