About the job
Join OpenVPN Technologies, Inc. as we embark on an exciting journey to develop cutting-edge AI tooling throughout our organization. This is a unique opportunity for a visionary AI Platform Engineer to take complete ownership of a greenfield project, crafting the foundational infrastructure, governance, and operational standards from the ground up.
Your Responsibilities
AI Developer Tooling & Enablement
• Lead the deployment and management of AI-assisted development tools such as Cursor, Copilot, and Claude Code across engineering teams.
• Establish access controls, license management, and usage policies that align with SOC2 and ISO 27001 standards.
• Create cost tracking and reporting mechanisms for AI tool expenditures, providing leadership with insights into usage patterns.
• Streamline the integration of these tools for engineers while ensuring security and compliance.
Internal AI-Powered Workflows
• Collaborate with interdisciplinary teams to identify and build AI applications, including RAG pipelines and automation workflows.
• Assess and recommend the best tooling and frameworks based on team needs.
• Define the responsibilities between Infrastructure as a Service (IaaS) and consuming teams, establishing clear boundaries.
Governance, Security & Compliance
• Guide the development of data governance policies for LLM usage, specifying what data can be used in models and how outputs are stored and audited.
• Ensure that AI infrastructure meets SOC2 and ISO 27001 controls and is ready for audit verification.
• Regularly report on AI adoption, costs, risks, and organizational usage to leadership.
AI/ML Cloud Infrastructure
• Set up and manage AI/ML infrastructure primarily using Google Cloud Platform (GCP) and Vertex AI.
• Design Terraform modules and Infrastructure as Code (IaC) patterns adhering to existing team conventions.
Cost Management
• Implement visibility into AI/ML infrastructure costs and establish controls for resource management, such as spot instances and auto-scaling policies.
• Analyze build-versus-buy decisions for AI/ML infrastructure components and services.
