AI Engineer · Munich
Location:
Role:
- Industry: Engineering
- Job Type: Contract / Freelance
Application Details:
- Date Posted:
AI Engineer · Munich
Position: AI Engineer
Location: 3 days on site per week (Hamburg or Munich)
Start Date: Immediate
Contract Type: Freelance
Duration: 12 months
Role Overview
You will play a key role in transforming advanced research into production-ready solutions. The focus will be on model compression, system optimization, and building agentic capabilities such as function calling and tool orchestration. Expertise in designing secure and reliable agentic workflows—including guardrails and safe tool invocation—is highly desirable.
Key Responsibilities
- Optimize LLMs and multimodal models for on-device deployment
- Enhance inference performance and efficiency
- Develop agentic AI capabilities for lightweight agents
- Deploy optimized models using Ollama, llama.cpp, ONNX, and TFLite
- Conduct benchmarking for LLMs and agentic systems
Required Qualifications
- 5+ years of experience in software/AI engineering, with strong exposure to LLMs, VLMs, and system performance
- Hands-on experience with quantization techniques (e.g., SmoothQuant, SpinQuant, QuaRoT)
- Proven track record with AI frameworks (PyTorch, LangChain, etc.)
- Knowledge of embedded software architecture and version control systems
- Broad experience with operating systems (GNU/Linux, embedded systems, development boards)
- Proficiency in C, C++, Python, and Bash
- Familiarity with ML-Ops environments (MLFlow, ClearML, etc.)
Preferred Skills
- Understanding of safety and security considerations for agentic systems (guardrails, policy enforcement, secure function calling)
- Knowledge of AI toolchains, deployment strategies, portability, and inference engines (CUDA, TensorRT, TFLite, ONNX, Ollama)
- Experience with build systems (YOCTO, OpenEmbedded)
- Excellent communication skills in English
g2 Recruitment are committed to equality of opportunity for all applications from individuals are encouraged regardless of age, disability, sex, gender reassignment, sexual orientation, pregnancy and maternity, race, religion or belief and marriage and civil partnerships or any other characteristic protected by law.