Senior Backend Engineer for LLM Automation
Hitachi Digital Services
Full-time|On-site|Dallas, Texas About Us At Hitachi Digital Services, we are a global leader in digital solutions and transformation with an ambitious vision to unlock the potential of our world. Our people-first approach drives us to create a sustainable future, safeguarding urban environments, preserving natural resources, and contributing to global welfare. We harness the power of innovation and technology to elevate our organization and our clients from the present to the future. We value diverse experiences and perspectives, recognizing that your unique background, character, and passion for creating meaningful change are as vital as technical skills. The Team Join our collaborative engineering team that supports over 600 application teams, dedicated to enhancing engineering maturity through the establishment of standards, guidelines, platform capabilities, and extensive technical debt remediation. You will be instrumental in developing advanced AI workflows aimed at automating codebase analysis, identifying technical debt, and generating high-quality solutions, including vulnerability patches and language upgrades. This impactful, hands-on role is crucial in shaping the future of automated software modernization. Your Role Key Responsibilities:• Design, develop, and maintain LLM-powered multi-agent workflows for code analysis and remediation proposals.• Implement agentic patterns such as planning/execution loops, dynamic tool orchestration, sandboxing, guardrails, and failure recovery.• Construct scalable automation systems for technical debt remediation, including language/runtime upgrades, vulnerability patching, dependency modernization, and configuration drift correction.• Collaborate with Dev Experience and Platform teams to define engineering guidelines and reusable standards.• Architect and optimize Retrieval-Augmented Generation (RAG) pipelines, managing chunking, embeddings, hybrid search, reranking, and retrieval policies.• Establish robust evaluation frameworks for LLMs, RAG, and agent workflows, incorporating offline datasets, validation metrics, statistical testing, and A/B testing.• Contribute to backend systems using Python, distributed systems, microservices, PostgreSQL, DBT, vector databases, caching, streaming, and queuing.• Create CI/CD pipelines, observability dashboards, and conduct performance analysis across model, retrieval, and network layers.• Work cross-functionally with product, platform, and security teams to transition prototypes into production-grade services. We are looking for a proactive and skilled engineer who is ready to make a significant impact.
Mar 2, 2026