Senior Infrastructure Engineer at Arena Intelligence | Bay Area

Join Arena IntelligenceArena Intelligence is the premier open platform for assessing the real-world performance of AI models. Founded by innovative researchers from UC Berkeley’s SkyLab, our mission is to enhance and measure the frontier of AI applications in real-world scenarios.Every month, millions of users leverage Arena Intelligence to delve into the pe…

Join Our Team at Arena IntelligenceArena Intelligence is revolutionizing the way we evaluate AI models in real-world applications. Founded by visionary researchers from UC Berkeley’s SkyLab, our mission is to measure and elevate the standards of AI performance across various domains.With millions of users each month, Arena serves as a trusted platform for understanding the reliability and impact of advanced AI systems. We leverage community insights to refine our evaluation processes, ensuring transparency and relevance. Our leaderboards are recognized as the benchmark for AI performance, shaping discussions and decisions in the global AI community.Our diverse team hails from esteemed institutions such as UC Berkeley, Google, Stanford, DeepMind, and Discord. We foster a culture of innovation, collaboration, and excellence, where every team member is empowered to contribute their expertise and drive impactful results.Your RoleAs a Technical Recruiter at Arena, you will play a pivotal role in scaling our exceptional team. You will be a key partner to hiring managers, guiding them through the recruitment process to define role expectations and develop effective interview strategies. Your focus will be on building inclusive hiring practices and enhancing our employer brand while ensuring a seamless and engaging candidate experience.Key ResponsibilitiesCollaborate with hiring managers to define role outcomes, success profiles, and interview plans aligned with business objectives.Oversee the full recruitment cycle from kickoff to offer acceptance, ensuring efficiency and effectiveness at each stage.Create talent pipelines through targeted sourcing strategies, including passive outreach, community engagement, events, referrals, and compelling job postings.Implement a structured and equitable hiring process by defining competencies, calibrating evaluation rubrics, and maintaining a consistent candidate experience.Uphold a commitment to excellence across all recruitment stages by continuously refining processes and improving funnel health.Monitor recruitment metrics, providing regular updates on funnel performance, diversity indicators, and overall progress.Lead offer strategies and negotiations in line with compensation frameworks and market benchmarks.Build and maintain a network of high-potential talent for future opportunities.

Join Arena Intelligence as a Business Development LeadArena Intelligence stands as the premier platform for assessing the efficacy of AI models in real-world scenarios. Established by visionary researchers from UC Berkeley’s SkyLab, we aim to push the boundaries of AI application through precise measurement and evaluation.With millions of users engaging with Arena each month, we harness community insights to foster transparent, thorough, and user-centric model assessments. Our evaluations are the benchmark for AI performance, recognized by leading enterprises and AI laboratories worldwide, and they actively shape the discourse around model trustworthiness and development.Our diverse team comprises experts from UC Berkeley, Google, Stanford, DeepMind, and Discord. We prioritize truth-seeking, rapid innovation, and a culture of craftsmanship, curiosity, and impact. At Arena, we cultivate an environment where inquisitive minds from all backgrounds can excel. Each team member brings profound expertise, creating a space charged with excellence and focus.Your RoleThis pivotal senior individual contributor position is ideal for someone who thrives in an autonomous environment. You will manage the complete revenue generation cycle—from engaging with intricate technical stakeholders to finalizing seven-figure contracts.Your main goal will be to ensure that Arena meets and surpasses its annual revenue and consumption objectives by integrating our evaluation infrastructure into the workflows of the leading AI firms globally.Key ResponsibilitiesStrategic Account Development & ExecutionManage Model Lab Relationships: Act as the primary business contact for premier global model labs, overseeing the relationship from research lead through procurement.Drive Revenue Growth: Increase revenue across multiple modalities (text, code, multimodal, vision, auto-eval) by strategically aligning our evaluation programs with each lab’s research and development agendas.Enterprise Solution Expansion: Identify and secure high-value opportunities to bring Arena’s evaluation capabilities to major enterprise clients (e.g., Salesforce, IBM, ServiceNow) looking to assess internal or vendor models.Ensure Market Leadership: Negotiate co-release and marketing rights for all significant lab partnerships to maintain Arena’s position as the industry standard.Lifecycle Management: Oversee contract renewals, upsells, and relationship management to bolster client satisfaction and retention.

Join the Arena Intelligence TeamArena Intelligence is a cutting-edge platform dedicated to evaluating the performance of AI models in real-world scenarios. Founded by a team of researchers from UC Berkeley’s SkyLab, our mission is to push the boundaries of AI through comprehensive measurements and advancements.Every month, millions turn to Arena Intelligence to gain insights into the performance of pioneering AI systems. Our community-driven feedback loop helps us create transparent, rigorous, and human-centered evaluations. Major enterprises and AI laboratories trust our assessments for their reliability, alignment, and impact. Our leaderboards have become the benchmark for AI performance, influencing the global discourse on model efficacy and innovation.Our team comprises top researchers, engineers, and builders from prestigious institutions like UC Berkeley, Google, Stanford, DeepMind, and Discord. We prioritize truth, agility, craftsmanship, curiosity, and impactful work over traditional hierarchies, fostering an environment where diverse talents can thrive. Our office is a hub of excellence, energy, and focus.Your Role as a Machine Learning ScientistWe are looking for a skilled Machine Learning Scientist to enhance our methods for evaluating and understanding AI models. You will design and analyze experiments that reveal the factors contributing to the usefulness, trustworthiness, and capabilities of models based on human preference signals. Your contributions will lay the groundwork for scalable AI understanding.This interdisciplinary role involves close collaboration with engineers, product teams, marketing, and the wider research community to develop innovative methodologies for model comparison, preference data analysis, and performance factor disentangling, including style, reasoning, and robustness. Your work will directly impact our public leaderboard and the resources we provide to model developers.If you are intrigued by open-ended challenges, rigorous evaluations, and impactful research, we invite you to apply. We are looking for candidates with:Hands-on experience in training large-scale models, including reward and preference models, as well as fine-tuning LLMs using methodologies such as RLHF, DPO, and contrastive learning.A solid foundation in machine learning and statistics, with proven experience in designing innovative training objectives, evaluation schemes, or statistical frameworks to enhance model reliability and alignment.Proficiency in the entire experimental pipeline, from dataset design and large-batch training to thorough evaluation and ablation, with an understanding of scalability for production.

Join Arena Intelligence as a Data ScientistArena Intelligence stands at the forefront of AI evaluation, offering an open platform that examines how AI models perform in real-world scenarios. Founded by UC Berkeley's SkyLab researchers, our mission is to push the boundaries of AI utility.Each month, millions engage with Arena Intelligence to assess the performance of pioneering AI systems, using our community's insights to foster transparent, comprehensive, and human-centric model evaluations. Leading enterprises and AI labs depend on our evaluations to gauge real-world reliability, alignment, and impact. Our leaderboards are regarded as the benchmark for AI performance, trusted by industry leaders and influencing global discussions on model reliability and advancement.Our diverse team of researchers, engineers, and builders hail from prestigious institutions such as UC Berkeley, Google, Stanford, DeepMind, and Discord. We prioritize truth, agility, and craftsmanship while fostering an environment that values curiosity and impact over hierarchy. At Arena, skilled individuals from all backgrounds are empowered to excel in their fields, contributing to an atmosphere rich in excellence, energy, and focus.The RoleAs a Data Scientist, you will investigate and interpret the data that fuels millions of AI evaluations weekly. Your responsibilities will include generating and testing hypotheses, identifying causal relationships, and revealing insights that enhance our understanding of frontier model behaviors in practical applications. You will collaborate with machine learning researchers and engineers to design experiments, analyze extensive datasets, and develop statistical frameworks aimed at refining the reliability and interpretability of our AI evaluation systems. Senior-level candidates are preferred for this role.

Arena Intelligence builds a platform for evaluating AI models in real-world scenarios. The company, founded by researchers from UC Berkeley's SkyLab, is known for transparent, human-centered assessments. Millions turn to Arena Intelligence each month for insights, while leading enterprises and AI labs use its evaluations to measure reliability and impact. Arena’s leaderboards are widely recognized as a standard for AI performance. The team brings together researchers, engineers, and academics from institutions like UC Berkeley, Google, Stanford, DeepMind, and Discord. Arena values truth, agility, and craftsmanship, and welcomes people from all backgrounds. Team members are experts in their fields, contributing to a culture focused on excellence. Role overview The Assistant Controller will build Arena’s accounting function from the ground up. As the first accounting professional at the company, this person will design systems, controls, and infrastructure to support Arena’s growth. The role reports to the Head of Finance and is foundational in supporting a product trusted by elite AI labs and enterprises. This position covers all aspects of accounting operations, including daily financial activities, timely month-end closes, and preparation for audits. The Assistant Controller will handle complex enterprise contracts, manage revenue recognition, and develop a cost accounting framework. Collaboration with an external accounting firm is part of the job. Key responsibilities Oversee monthly, quarterly, and annual financial closes, ensuring GAAP compliance in financial statements and analyses. Manage daily financial operations, including Accounts Payable, Accounts Receivable, expense allocations, and balance sheet reconciliations for major enterprise clients. Handle revenue recognition, applying ASC 606 to complex enterprise contracts. Design and implement scalable financial systems and processes to support rapid growth. Location Bay Area

Note: We are excited to facilitate this recruitment for our esteemed client. This position is directly with Arena Intelligence, not People Culture Talent. We look forward to connecting skilled professionals with this remarkable team!The RoleArena Intelligence is redefining the landscape for assessing AI model performance in practical applications. Originating from UC Berkeley’s SkyLab, our platform, Arena.ai, has established itself as the benchmark for AI model evaluation, gaining the trust of researchers, developers, and enterprises that are paving the future of artificial intelligence.Our mission is to create API-driven services tailored for enterprise clients. We aim to deliver premier machine learning products (like Arena Max) that align with their specific business needs.In this pivotal role, you will be responsible for the foundational infrastructure that transforms our research capabilities into enterprise-ready products. This is a unique opportunity to be part of the developer/enterprise team from the ground up. You will collaborate directly with founders and early customers to shape our offerings.What You’ll DoDevelop API-centric products from inception, focusing on creating low-latency, high-reliability APIs for leaderboards, models, and arenas.Tackle complex streaming challenges, including handling SSE/streaming responses from diverse providers, ensuring partial failure recovery, mid-stream fallbacks, and consistent response normalization.Deliver enterprise-grade infrastructure by implementing expected features such as rate limiting, authentication, usage metering, cost attribution, audit logging, and SOC2 compliance.Enhance observability by integrating distributed tracing, latency analysis, token-level usage tracking, and real-time dashboards for comprehensive insights.Develop AI-focused products by integrating with our core evaluation platform, Arena data, and customer-specific benchmarks, while collaborating with the research team to evolve innovative concepts into robust products.Contribute across the tech stack, particularly in backend development for our Leaderboards and Evals platforms, ensuring a cohesive architecture for our public and private data systems.What We’re Looking ForA minimum of 4 years of backend engineering experience, with substantial experience in distributed systems, infrastructure, or developer-centric platforms.Proficiency in Go and familiarity with other programming languages.

About Arena IntelligenceArena Intelligence serves as the premier platform for assessing the effectiveness of AI models in practical applications. Founded by a team of researchers from UC Berkeley’s SkyLab, our mission is to push the boundaries of AI measurement and utilization in real-world scenarios.Every month, millions of users engage with Arena Intelligence to investigate the performance of cutting-edge systems. We actively incorporate feedback from our community to enhance our model evaluations, ensuring they are transparent, rigorous, and centered around human values. Leading organizations and AI research facilities rely on our assessments to gauge real-world reliability, alignment, and impact. Our leaderboards are recognized as the benchmark for AI performance, trusted by industry leaders and influencing global discussions on model reliability and advancement.Our diverse team includes researchers, engineers, academics, and innovators from renowned institutions such as UC Berkeley, Google, Stanford, DeepMind, and Discord. We prioritize truth, agility, and craftsmanship, valuing curiosity and impact over traditional hierarchies. At Arena, we foster an environment where insightful and inquisitive individuals from varied backgrounds can excel. Each team member is a specialist in their area, contributing to a culture of excellence and focus.About the RoleWe are looking for a Scientific Content Lead to uphold and articulate the scientific integrity of the most reliable AI evaluation platform globally. In this role, you will ensure that Arena’s methodologies, data quality standards, and evaluation outcomes are effectively communicated to researchers, labs, policymakers, analysts, and businesses.This position is highly technical and demands cross-functional collaboration. You will collaborate with our research team to translate evaluation science into precise public content, preemptively address methodological criticisms, and maintain Arena’s dedication to transparency and impartiality.Your ResponsibilitiesDevelop and manage Arena’s scientific communications strategy, ensuring that our evaluation methodologies, benchmarks, and data quality practices are accurately represented externally.Steer Arena’s proactive narrative regarding data quality, countering common criticisms and misconceptions with transparency, evidence, and integrity in storytelling.Create foundational explanations of Arena’s measurement strategies, including methods like Bradley-Terry-Luce ranking, confidence intervals, and uncertainty-aware interpretations.Ensure responsible communication of Arena’s leaderboards, clarifying that rankings are statistical estimates, small variances may be noise, and uncertainty must be accounted for in public interpretations.Engage with various stakeholders to foster a deeper understanding of Arena’s scientific contributions and methodologies.

Join our innovative team as an Engineer at leverdemo-8! This role is part of our ongoing efforts to enhance Lever's testing environment. Please note, this posting is for testing purposes only and not for actual recruitment.At Lever, we are dedicated to revolutionizing the recruitment and hiring process, providing cutting-edge software solutions to industry leaders like Netflix, Yelp, Cirque du Soleil, Shopify, and Spotify. As we continue to grow, we seek talented individuals who are passionate about transforming talent acquisition. Lever has been recognized as the #1 workplace in San Francisco and a top employer across the United States. Our team, known as 'Leveroos', is our most valuable asset, and we are committed to fostering a people-first culture that prioritizes the well-being and growth of our employees.

About UsAt Sully.ai, we are on a mission to revolutionize healthcare and ensure that every individual has access to high-quality medical care. Despite the challenges of bureaucracy, misdiagnoses, and clinician burnout, we believe that having a great doctor is a fundamental human right.Our Mission: One Human, One Doctor. We are developing AI-driven teammates to support healthcare professionals, including scribes, nurses, receptionists, and translators, utilizing our proprietary models to enhance real-world medical services.Our AchievementsOver 450 organizations onboarded in just 16 months.AI solutions save approximately 2.8 hours of administrative work daily and decrease onboarding time by 85%.More than 5 million clinical tasks completed, serving over 36 medical specialties.Successfully raised $25 million from notable investors including Y Combinator and Eric Yuan.Our patented AI architecture (MedCon-1) has been shown to outperform competitors such as GPT-4.5 and Gemini in clinical reasoning tasks.At Sully.ai, we seek high-performing individuals who can produce in four months what others take a year to achieve.

Join Arena IntelligenceAt Arena Intelligence, we are pioneers in assessing the real-world performance of AI models. Founded by esteemed researchers from UC Berkeley's SkyLab, our goal is to enhance and measure the capabilities of AI technologies for practical applications.Each month, millions leverage Arena Intelligence to understand frontier system dynamics, using our community's insights to foster transparent, rigorous, and human-centric evaluations. Leading organizations and AI laboratories depend on our assessments to gauge real-world reliability, alignment, and implications. Our leaderboards set the benchmark for AI performance, earning trust from industry leaders and influencing global discussions on model reliability and advancements.Our team comprises researchers, engineers, scholars, and innovators from renowned institutions such as UC Berkeley, Google, Stanford, DeepMind, and Discord. We prioritize truth-seeking, agility, and craftsmanship, valuing curiosity and impactful contributions over hierarchy. We're fostering a workplace where thoughtful and diverse individuals can excel. Each team member is a domain expert, contributing to an environment rich in excellence, energy, and focus.Role OverviewWe are looking for a Senior Full-Stack Product Engineer to spearhead the technical design and development of AI-focused products within our platform. This role involves taking ownership of features from inception to deployment—encompassing the proposal of technical solutions, implementation of core product workflows, and analysis of new functionalities' impacts. Ideal candidates should possess substantial experience in constructing reliable business logic at scale and be enthusiastic about influencing user interaction with state-of-the-art AI models.

Join Until, a pioneering moonshot company, as we revolutionize biology with our innovative approach to organ-scale reversible cryopreservation. Our mission focuses on preserving donated organs at subzero temperatures without ice formation, ensuring they can be uniformly rewarming for transplant. By tackling this monumental challenge, we aim to establish the groundwork for whole-body reversible cryopreservation, providing patients with a pathway to future medical breakthroughs.To realize our vision, we are building a dynamic interdisciplinary team dedicated to creating advanced perfusion systems, cryoprotectant formulations, and cutting-edge vitrification and rewarming hardware.We foresee a future where logistical barriers do not result in the loss of transplantable organs, and terminal diagnoses can be addressed with safe waiting periods for the advent of future cures.About the RoleAs an Integration Engineer at Until, you will collaborate across various teams to deliver next-generation perfusion, cooling, and rewarming systems. You will independently manage the deployment of these systems while working closely with scientists throughout the organization to ensure seamless integration across hardware and software stacks.

Join Until, a pioneering moonshot company dedicated to revolutionizing biology with our innovative 'pause button' technology. We are focused on advancing organ-scale reversible cryopreservation, a groundbreaking method that preserves donated organs at subzero temperatures without ice formation. This technology allows for the uniform rewarming of organs, making them viable for transplants. By addressing this critical challenge, we are laying the groundwork for medical hibernation, providing patients with a bridge to future cures.As part of our mission, we are assembling a dynamic, interdisciplinary team to develop advanced perfusion systems, cryoprotectant formulations, controlled-rate freezers, and effective vitrification and rewarming protocols for human tissues. Our medical hibernation team is also engaged in tackling whole-body cryopreservation challenges, starting with rodent models.We aspire to a future where no transplantable organ is lost due to logistical issues, and where no terminal diagnosis is irreversible, enabling patients to safely await the arrival of future medical advancements.About the RoleAs a Software Engineer at Until, you will be instrumental in constructing the computational and infrastructure backbone that accelerates our scientific endeavors. You will design and implement robust data pipelines, develop lab automation interfaces, and create scalable cloud-based systems that support our experimental processes. You will take ownership of projects from inception to completion, collaborate with cross-functional teams, and uphold high standards in code development that aligns with our growing team.

At Block, we are a mosaic of diverse teams united by a common mission of economic empowerment. Our foundational teams—including People, Finance, Counsel, Hardware, Information Security, and Platform Infrastructure Engineering—provide essential support and guidance across the organization. We collaborate across various business groups, transcending time zones and disciplines, to craft inclusive policies, manage finances, offer legal expertise, protect our systems, and nurture innovative initiatives. Every challenge brings forth new opportunities, and we value unique perspectives in tackling them. We invite you to bring yours to Block.The RoleAs a vital member of our Site Reliability Engineering (SRE) team, you will take proactive and reactive measures to enhance the reliability of Block's platform and its critical infrastructure. You will be metrics-driven, systems-oriented, and dedicated to building distributed platforms that facilitate safe and scalable product development.You will utilize and continuously enhance AI-driven tools and automation to bolster observability, expedite incident detection and response, and minimize operational toil. This will involve applying AI to incident analysis, alert tuning, and operational workflows.Your responsibilities will also include being part of the primary platform on-call rotation (12 hours per day, one week every few weeks, based on team size), supporting Block's most essential Tier 0 services. In this capacity, you will lead incident command, coordinate mitigation efforts, and ensure effective escalation during high-severity incidents.

Join our dynamic team at Arta Finance as a Senior Software Engineer, focusing on our Private Investments Platform within the Alternatives sector. In this role, you will lead the development of innovative solutions that cater to our clients' diverse investment needs.You will collaborate closely with cross-functional teams, applying your expertise in software engineering to deliver high-quality, scalable products that enhance our platform's capabilities. Your contributions will directly impact our growth and success in the private investments market.

Join Our MissionThe trucking and logistics sector is essential to our economy, yet its payment infrastructure is outdated and inefficient. At AtoB, we are on a mission to revolutionize payment systems for this industry. We've identified the challenges faced by hardworking professionals in trucking — from outdated tools to hidden fees, and we are committed to delivering solutions that prioritize their needs.About AtoBOur goal is to create a seamless payment experience akin to Stripe, tailor-made for the transportation industry. We understand the critical role of timely capital movement in supply chains and strive to ensure it happens smoothly and fairly. Every product we develop enhances user experience and works intelligently within the unique constraints our customers face daily, whether they are fleet managers or drivers.Our ExpertiseOur founding team boasts extensive experience in the tech and payments landscape, with backgrounds from industry leaders like Cruise Automation, Uber, Google, Meta, and Stripe. We've attracted over $125 million in funding from prominent investors, including General Catalyst, Y Combinator, and major tech founders, positioning us as a leader in innovation within our sector.Recognized by Forbes as one of the Next Billion-Dollar Startups, we are also proud to join the World Economic Forum as a Global Innovator.

Join our innovative team at Lever, where we are reimagining the recruitment landscape! As a Senior Data Engineer, you will play a pivotal role in developing our cutting-edge hiring software, which is trusted by industry leaders like Netflix, Shopify, and Cirque du Soleil. Your expertise will help us continue to push the boundaries of talent acquisition technology.Lever, founded a decade ago, addresses one of the most critical challenges companies face: attracting and hiring premier talent. Recognized as the #1 workplace in San Francisco and a top employer nationwide, we take pride in our people-first culture, investing in our team members – our greatest asset. If you're passionate about shaping the future of hiring, we want to hear from you!

Join our innovative team at Lever as we redefine the recruitment landscape!Lever, founded a decade ago, addresses the crucial challenge of attracting and hiring top talent. Our cutting-edge hiring software is trusted by industry leaders such as Netflix, Yelp, Cirque du Soleil, Shopify, and Spotify to enhance their teams. We are proud to be recognized as the top workplace in San Francisco and among the best in the United States. Our culture emphasizes people-first values, and we continually invest in our dedicated team, known as “Leveroos.” Join us in our mission to innovate in talent acquisition!

About HexusAt Hexus, we are dedicated to unlocking the hidden potential of AI and personalization for businesses. Our passion lies in revolutionizing product-led growth, transforming how companies connect with their customers, thereby enhancing product adoption and ensuring long-term success. With a robust suite of AI-driven tools, Hexus enables businesses to optimize their PLG strategies across Sales, Marketing, and Customer Experience.Supported by leading investors, industry experts, and renowned angel investors, our team is spearheaded by former FAANG founders with extensive experience in SaaS, ML, and UX. Join us in our mission to redefine customer experiences through AI and personalization.Your RoleAs a dynamic, design-driven startup, we are seeking a talented Senior Product Engineer to join our early-stage team. You will be instrumental in actualizing our product vision by creating clean, intuitive UI and UX, developing robust editing tools, and ensuring top-notch performance. We seek an individual who raises the bar for what’s achievable online and is passionate about crafting exceptional responsive, interactive, and enjoyable user experiences.In this role, you will:Collaborate closely with the founding team to design engaging user experiences.Execute critical projects that empower our customers daily.Rapidly prototype and iterate on new features and functionalities, driving ongoing innovation.Architect efficient and reusable frontend systems that support complex web applications.Contribute to shaping the direction of our design-led product.Qualifications5+ years of experience in frontend development.Proficiency in front-end development using TypeScript, React, NextJS, and Node.js.Strong skills in design and styling with frameworks like Tailwind or Material Design.Comprehensive understanding of the entire web stack, including protocols and web server optimization techniques.Familiarity with modern deep learning models (GPT, LLAMA, BERT, Whisper, Stable Diffusion, etc.).Capacity to grasp user challenges and convert them into features and products.A desire to thrive in a fast-paced, iterative startup environment.

Join our innovative team at Lever as a Senior Scientist, where you will play a crucial role in advancing our mission to redefine talent acquisition. Lever is at the forefront of developing cutting-edge hiring software that empowers companies such as Netflix, Shopify, and Spotify to attract and retain top talent. We pride ourselves on fostering a people-first culture, investing in our employees, and being recognized as a premier workplace in San Francisco and across the United States.As a Senior Scientist, you will leverage your expertise to contribute significantly to our projects and help shape the future of hiring technology. Your insights and skills will be invaluable as we continue to scale and innovate.