About the job
Develop AI Infrastructure for Europe's Leading Businesses
Create Impactful Solutions.
Every day, thousands of professionals from over 5,000 companies utilize Langdock to innovate, research, and automate processes with AI. Join us in building seamless systems that enhance their experiences.
Your Responsibilities
As part of our engineering team, you will deploy features within our AI engine, integrating the latest model releases from top AI labs through a streamlined abstraction layer. This encompasses prompt caching, automatic failover mechanisms, and middleware to address provider-specific quirks smoothly.
Design and implement resumable streaming infrastructure allowing users to reconnect during responses, enabling them to resume from exactly where they left off. Develop retry logic that picks up from the last point of interruption in case of provider failures during streaming.
Extend our workflow automation system, allowing agents to pause for human input, derive structured outputs from conversational interactions, and orchestrate actions across numerous integrations. Leverage Redis for distributed loop orchestration to ensure coordinated executions and mitigate race conditions.
Engage with cutting-edge infrastructure, including Model Context Protocol, agent-to-agent communication, and retrieval-augmented generation pipelines with various vector stores.
Tackle challenges such as context window management while maintaining tool call integrity, intelligent message reduction techniques, and token refresh callbacks during extended processes.
Oversee the entire lifecycle of AI systems within our product, focusing on intricate details like button interactions, loading states, and micro-interactions. Ensure superior rendering performance and minimal perceived latency, creating a fluid experience in complex distributed systems.
Invent new paradigms for AI-native software, transcending traditional chat interfaces. Craft and implement innovative methods for human-agent collaboration, reasoning review, generation steering, and workflow composition without established UI patterns.
Design and maintain the infrastructure supporting Langdock across various environments, including Azure, AWS, GCP, and on-premises servers, ensuring that deployments remain secure, updated, and reliable for all tenants.
Take ownership of domains from start to finish. We deploy updates daily.
Why This Role Stands Out
Work on a production-grade AI platform featuring enterprise-level capabilities such as multi-tenant observability, connection pooling for external APIs, and much more.
