About the job
Join Our Team as an AI Agent Developer (LLM Specialist)
Role Overview
As an AI Agent Developer at ClearlyAgile, you will play a pivotal role in the design, development, and deployment of intelligent agents that harness the power of Large Language Models (LLMs). Your expertise will enable complex workflows, enhance reasoning capabilities, and ensure seamless integration of systems while maintaining secure data interactions across enterprise environments.
Key Responsibilities
Agent Design & Development
- Architect and implement AI-driven agents utilizing LLMs (e.g., GPT, Claude, Llama, Mistral, Gemini).
- Create and optimize prompt workflows, retrieval-augmented generation (RAG), and multi-step reasoning processes.
- Configure agent behaviors to facilitate effective decision-making, task execution, and contextual comprehension.
- Integrate function calling, tool utilization, and API connections to enhance agent functionalities.
System Integration
- Connect agents to internal systems, databases, knowledge repositories, and APIs.
- Leverage frameworks such as LangChain, LlamaIndex, Haystack, Semantic Kernel, or tailor custom pipelines.
- Implement connectors for various platforms including CRMs, ERPs, ticketing systems, or document repositories.
Data & Knowledge Management
- Establish both structured and unstructured knowledge retrieval mechanisms.
- Develop and manage vector databases (Pinecone, Weaviate, Chroma, Milvus, Azure AI Search).
- Utilize embeddings, chunking strategies, metadata tagging, and query optimization for improved data handling.
Workflow Automation
- Create orchestration pipelines for multi-agent collaboration.
- Empower agents to automate tasks such as research, reporting, email drafting, document processing, and customer interactions.
- Incorporate with workflow automation tools like Zapier, Airflow, UiPath, or Power Automate.
Model Optimization & Evaluation
- Fine-tune LLMs using organization-specific datasets.
- Assess model performance focusing on accuracy, latency, cost, hallucinations, and compliance.
- Implement guardrails, prompt validation, and reinforcement techniques to ensure optimal performance.
Security, Ethics & Compliance
- Uphold data privacy and governance standards (GDPR, HIPAA, SOC2, ISO, CCPA).
- Establish role-based access controls and secure API token management.
- Apply content filtering, moderation, and usage monitoring practices.
Collaboration & Documentation
- Collaborate with cross-functional teams (engineering, design, product, legal, security).
- Maintain comprehensive technical documentation, agent configuration logs, and deployment playbooks.
- Conduct training sessions for internal teams on agent capabilities and responsible usage.