Machine Learning Engineer at Percepta | New York City

About UsAt Percepta, we are dedicated to revolutionizing essential sectors through applied AI. Our vision is to empower industries that drive the global economy, such as healthcare, manufacturing, and energy, leveraging cutting-edge technology.To achieve this, we partner with leading organizations to facilitate AI transformation. Our strengths lie in:Experti…

About UsAt Percepta, our mission is to revolutionize essential institutions through the power of applied AI. We are dedicated to ensuring that critical industries—such as healthcare, manufacturing, and energy—leverage cutting-edge technology. Our approach includes collaborating with industry-leading clients to spearhead AI transformation initiatives. We combine:Expertise in engineering, product development, and research that is deployed directly in the field.Mosaic, our proprietary toolkit for swiftly implementing intelligent workflows.Strategic alliances with renowned organizations like Anthropic, McKinsey, and AWS, among others.Our rapidly expanding team consists of Applied AI Engineers, Embedded Product Managers, and Researchers who are passionate about integrating the potential of AI into tangible improvements in everyday life. Percepta is a proud partner of General Catalyst, a global firm specializing in transformation and investment.Position OverviewAs a Research Engineer/Scientist specializing in Reinforcement Learning (RL) at Percepta, you will operate at the confluence of RL research and practical application. Your work will push the boundaries of capabilities by researching decision-making processes within critical sectors. You will collaborate closely with our Embedded Product Managers and engineers to ensure that our solutions redefine operational methodologies for businesses.Key ResponsibilitiesIdentify real-world challenges suitable for RL-guided decision-making.Develop RL methodologies for executing complex tasks across various domains such as planning, decision-making, and optimization.Design and sustain the experimental infrastructure that supports our research, including simulation environments, data pipelines, and training frameworks.Conduct large-scale evaluations that deliver significant financial impact.Work in partnership with our applied AI engineers to translate successful research concepts into robust features within our Mosaic platform.Effectively communicate research findings to both technical and non-technical stakeholders, ensuring clarity on the implications and applications of the research.

Who We Are:At Percepta, our mission is to revolutionize critical sectors through applied AI. We believe in leveraging cutting-edge technology to enhance industries that are foundational to our world, including healthcare, manufacturing, and energy. Our approach involves closely collaborating with industry-leading clients to facilitate AI transformation. Our strengths include:Expertise in engineering, product development, and research deployed at the forefrontMosaic, our proprietary toolkit designed for the swift implementation of intelligent workflowsStrategic alliances with renowned organizations such as Anthropic, McKinsey, AWS, and others within the General Catalyst portfolioOur rapidly expanding team consists of Applied AI Engineers, Embedded Product Managers, and Researchers dedicated to translating the potential of AI into tangible improvements in everyday life.Percepta proudly operates as a direct partnership with General Catalyst, a global leader in transformation and investment.About the Role:As an Embedded Research Engineer/Scientist at Percepta, you will push the boundaries of AI research while collaborating closely with clients to create significant real-world impact. Your work will encompass post-training reinforcement learning, agentic modeling, and specialized architectures, with an emphasis on translating research advancements into production systems that revolutionize operations in crucial sectors.In contrast to conventional research roles, you will be integrated within client teams, gaining insights into business challenges, formulating research strategies that meet actual needs, and rapidly iterating based on field feedback. You will collaborate with our Embedded Product Managers, Research Product Managers, and Applied AI Engineers to ensure your research yields measurable value and is effectively deployed into active production.What You'll Do:Engage directly with clients to pinpoint high-impact research challenges that align frontier AI capabilities with critical business demands.Develop and implement research strategies focusing on LLM post-training, reinforcement learning, agentic modeling, and tailored model development that address client-specific issues.Create prototypes and scale training pipelines, experimenting with model architectures, optimization techniques, and post-training methodologies while quickly adapting based on client feedback.Conduct extensive customer evaluations that clearly demonstrate business value and foster AI adoption.

Join Us at PerceptaAt Percepta, we are on a mission to revolutionize critical industries through the power of applied AI. Our commitment is to ensure that essential sectors such as healthcare, manufacturing, and energy leverage advanced technologies for their benefit.We partner with leading organizations to foster AI transformation, combining:Expertise in engineering, product development, and researchMosaic, our proprietary toolkit designed for the rapid deployment of intelligent architecturesStrategic collaborations with industry giants like Anthropic, McKinsey, AWS, and General CatalystOur team consists of a dynamic group of Applied AI Engineers, Embedded Product Managers, and Researchers, all eager to integrate AI innovations into tangible improvements in everyday life.Percepta is a proud partner of General Catalyst, an esteemed global transformation and investment firm.Role OverviewWe are seeking a Senior Platform Engineer to develop the foundational infrastructure that supports Percepta’s AI initiatives.This pivotal role bridges customer implementations and platform architecture. As part of a dedicated team, you will engage directly with key institutions, designing and constructing systems that enable AI agents to effectively interact with real-world tools, services, and environments.Your work will often commence in the field, crafting solutions for specific client challenges. Ultimately, your goal will be to identify and formalize effective abstractions to enhance our platform, facilitating quicker deployment of future systems.The challenges we face are novel, and the frameworks are still evolving, meaning the systems we create often lack predefined guidelines.Your ResponsibilitiesDevelop the core platform enabling AI agents to interact seamlessly with external tools, services, and environments.Design systems that manage complex multi-step workflows driven by cutting-edge models.Collaborate with Percepta teams embedded with clients to deliver robust production AI systems.Extract reusable abstractions and infrastructure from real-world deployments.Create reliable interfaces between AI systems and distributed execution environments.Rapidly prototype new architectures as we navigate emerging patterns in AI.

Who We ArePercepta is on a mission to revolutionize critical institutions through applied AI. We are committed to ensuring that pivotal industries such as healthcare, manufacturing, and energy harness the advantages of cutting-edge technology.To achieve this, we partner with industry-leading clients to spearhead AI transformation. Our approach encompasses:Expertise in engineering, product management, and researchMosaic, our proprietary toolkit designed for swift deployment of agentic workflowsStrategic alliances with notable organizations including Anthropic, McKinsey, AWS, and the General Catalyst portfolioOur rapidly expanding team of Applied AI Engineers, Embedded Product Managers, and Researchers is driven by the goal of making AI's promise tangible in our everyday experiences.Percepta operates as a direct partnership with General Catalyst, a global transformation and investment firm.About the RoleAs an Embedded Product Manager (EPM) at Percepta, you will work alongside engineers and researchers to redefine how companies can reinvent themselves using AI.EPMs craft AI transformation strategies that inspire executives, energize teams, and deliver significant value.We are dedicated to achieving genuine outcomes, ensuring that our products are embraced, valued, and scaled effectively, while tackling the complexities of real data and user interactions.We pride ourselves on being innovative problem solvers who are pragmatically focused: we continuously refine our approach to balance long-term and short-term objectives, conducting experiments to validate our value propositions and knowing when to engage our research team for pioneering insights.As an early member of the EPM team, you will play a crucial role in determining target customers, product abstractions, and the collaborative culture within our team.ResponsibilitiesThis is a leadership role with considerable responsibility. Your work will encompass everything from shaping and executing the AI vision for Fortune 500 companies to leading a team of top-tier researchers and engineers.Collaborate with client stakeholders to formulate their long-term AI strategy and transformation roadmap.Work backward from the long-term vision to define the necessary milestones and steps to achieve impactful AI implementation.

Who We AreAt Percepta, we are dedicated to revolutionizing vital industries through applied AI. Our commitment lies in ensuring that sectors that sustain our world—such as healthcare, manufacturing, and energy—harness the advantages of cutting-edge technology.To achieve this, we partner closely with prominent customers to facilitate AI transformation. Our team is equipped with:Expertise in engineering, product management, and researchMosaic, our proprietary toolkit designed for the swift deployment of intelligent workflowsStrategic alliances with leading firms like Anthropic, McKinsey, AWS, and others within the General Catalyst portfolioOur rapidly expanding team consists of Applied AI Engineers, Embedded Product Managers, and Researchers all driven by the mission to integrate AI advancements into tangible improvements in our everyday lives.Percepta operates as a strategic partnership with General Catalyst, a global leader in transformation and investment.About the RoleWe are seeking talented Applied AI Engineers to collaborate directly with customer executives, operators, and technical teams in defining and delivering impactful AI systems. Our focus is on developing and deploying production-grade AI agents and workflows that can significantly drive business value.As an Applied AI Engineer, you will:Shape the AI Vision: Partner with stakeholders to establish their long-term AI strategies and transformation roadmaps.Identify High-Leverage Use Cases: Analyze the overarching vision to discover and prioritize specific AI applications that link our ambitions to measurable business outcomes.Ship Real Products: Rapidly design and implement AI solutions that operate effectively in real-world scenarios, utilizing actual user interactions and data.Advance Our Core Product: Integrate insights from customer engagements into our Mosaic product, contributing to new features, patterns, and abstractions.

About FinchAt Finch, we envision a world where every American household has access to legal counsel during significant life events. We are transforming the legal landscape by creating innovative infrastructure that enhances justice accessibility. Our modern consumer law framework automates administrative tasks, prioritizing client needs, starting with personal injury cases.Since our launch in April, we have experienced exponential growth, expanding our reach tenfold and supporting pre-litigation processes for leading law firms nationwide. We seamlessly blend expert operations with cutting-edge AI technology to manage intake, claim initiation, medical records, police reports, lien management, demands, and every detail in between.Backed by distinguished investors including Sequoia and Redpoint, along with founders and CEOs of transformative companies like DoorDash, Ironclad, and Digits, we are fundamentally reshaping how legal services are delivered to everyday Americans. We are in search of exceptional talent to help us scale this mission across the country.This RoleLegal processes often involve navigating unstructured documents, repetitive tasks, and data that current systems struggle to manage. As a Machine Learning Engineer at Finch, you will take ownership of the entire AI system lifecycle—from prototyping to deployment—addressing challenges where a single innovation can significantly enhance law firm operations.What You'll DoIn this hands-on applied AI position, you will develop and deploy production-ready systems rather than just conducting experiments. Your responsibilities will evolve alongside our product and team.Create voice agents, browser agents, OCR pipelines, and LLM-driven workflows that consistently perform well in production.Establish robust evaluation frameworks and feedback mechanisms to enhance model accuracy and dependability.Manage the complete ML lifecycle, including model selection, fine-tuning, prompt engineering, deployment, and monitoring.Collaborate closely with product teams, operations, and legal experts to ensure the AI solutions address the right challenges.Monitor emerging research and tools, making informed decisions on their integration into our technology stack.Who We Have in MindWe seek engineers who prioritize results over algorithms and are equally proficient in production environments and analytical settings. Below are the key qualifications we are looking for.Must-HavesOver 3 years of experience in building and deploying production ML systems.Proficient in Python, with experience across the full ML stack.

At PermitFlow, we are transforming the future of construction across America. As a pioneering applied AI firm, we address one of the most significant information challenges in the construction industry: comprehending what can be built, where, and how. Our innovative AI-driven agents empower the nation’s most rapidly growing construction companies to navigate the complexities of permitting, licensing, inspections, and project closeouts—thereby expediting housing, clean-energy, and infrastructure development nationwide.The construction sector, valued at $1.6 trillion, faces substantial delays, resource wastage, and unrealized opportunities. PermitFlow has successfully provided enhanced speed, accuracy, and visibility to over $20 billion in development projects, aiding contractors in minimizing compliance time, mitigating project risks, and scaling operations with assurance.As the U.S. enters a new capital expenditure supercycle encompassing data centers, factories, housing, and renewable energy, becoming a part of PermitFlow means constructing the AI infrastructure that underpins every construction project and propels the upcoming wave of reindustrialization.We have raised over $90 million, recently completing our Series B funding round, backed by prestigious investors such as Accel, Kleiner Perkins, Initialized, Y Combinator, Felicis, and Altos Ventures, with support from industry leaders at OpenAI, Google, Procore, ServiceTitan, Zillow, PlanGrid, and Uber.Our headquarters are located in New York City, offering a hybrid work schedule (3 days in the office per week). Preference will be given to candidates based in NYC or those willing to relocate.

About SandbarSandbar is an innovative interface company located in New York City, dedicated to empowering individuals in an agentic world, allowing them to think, act, and move freely. Our talented team has developed software, machine learning, and hardware products at renowned companies such as Meta, CTRL-labs, Google, Apple, Fitbit, Peloton, and Equinox.Our flagship product, Stream, is a cutting-edge human-agent interface—a private voice ring and conversational computer. Featured in prestigious publications like the WSJ, Bloomberg, and Wired, Stream is set to launch in Summer 2026.Join us in revolutionizing interfaces for self-augmentation.Job SummaryWe are in search of a passionate Machine Learning Engineer specialized in audio technology to contribute to the development of Stream, our innovative conversational computer. In this role, you will create a system that integrates voice recognition, memory capabilities, and agentic control. This position is ideal for someone who is deeply committed to real-world machine learning applications and enhancing human-in-the-loop interactions.

About Us:At ClarityPay, we empower businesses and their customers by expertly addressing intricate credit challenges with agility, precision, and intelligence. Our blend of extensive experience and cutting-edge technology simplifies processes and consistently yields superior results.As a rapidly expanding fintech firm, we equip enterprise merchants with innovative pay-over-time solutions. From point-of-sale financing to "Buy Now, Pay Later" initiatives and integrated loyalty offers, we are crafting customizable credit tools that enable businesses to reach more customers.Our core values include teamwork, a clear sense of purpose, and a meticulous approach to data-driven decision-making. We prioritize speed and quality to provide an outstanding customer experience.Role Overview:ClarityPay is investing heavily in the development of machine learning products, algorithms, and platforms. We seek technically skilled engineers who are enthusiastic about tackling complex optimization issues related to customer complaints, collections, and offer optimization.This position is suited for an engineer who views the "collections process" as a Reinforcement Learning environment. You will delve deep into the problem space through thorough case reviews to uncover the "why" and "what," and formulate robust hypotheses to enhance outcomes. Transitioning from basic predictive models, you will craft transformative algorithmic solutions utilizing Bayesian Black Box optimization, Contextual Bandits, and Deep Q-Networks (DQN/DDQN).This problem space is primed for innovation, and your curiosity, motivation, and skills will dictate the extent of your impact. You will also have the chance to take on leadership roles, including technical mentorship and managing offshore engineering teams.Key Responsibilities:End-to-End Problem Solving: Take ownership of the entire solution lifecycle. Engage in comprehensive case reviews to develop hypotheses, design rigorous A/B tests for validation, and automate the implementation of successful strategies.Advanced Algorithmic Development: Create and deploy inferential solutions that optimize operational management. Implement and refine advanced methodologies such as Contextual Bandits, Deep Q-Networks (DQN), Double DQN, and Bayesian optimization to deduce causal effects and maximize long-term rewards.Engineering & Reliability: Construct the foundational data infrastructure. Develop robust data pipelines and integrate machine learning models into production-ready systems.

Coral AI is building an intelligent operating system to address inefficiencies in healthcare administration. The company’s work was recently featured in Forbes for tackling the $450 billion lost each year to paperwork and the delays this causes for patients needing timely care. About Coral AI Coral AI’s automation platform uses advanced AI to process handwritten faxes, complex medical records, and low-quality scans. The system achieves 98.7% accuracy, helping healthcare organizations handle documents that typically slow down operations. Backed by Lightspeed and led by founders with deep experience in AI and robotics, Coral AI reached multi-million dollar annual recurring revenue within six months, serving medical equipment providers, clinics, and specialty pharmacies. Impact The technology reduces patient wait times from days to hours, allowing clinicians to focus on care instead of paperwork. Coral AI aims to remove administrative barriers so medical staff can deliver care without unnecessary delays. Role Overview: Machine Learning Engineer This role centers on solving challenges in Optical Character Recognition (OCR) and Natural Language Processing (NLP) for healthcare applications. The work directly contributes to improving patient outcomes and streamlining healthcare delivery. Location New York City

At Garner Health, our mission is to revolutionize the healthcare economy by providing accessible, high-quality care for everyone.We are fundamentally rethinking how healthcare operates in the U.S. by collaborating with employers to redesign healthcare benefits, utilizing clear incentives and powerful, data-driven insights. This approach directs employees towards superior, cost-effective care, creating a system that benefits everyone involved. Patients enjoy improved health outcomes, employers maximize their healthcare investments, and physicians are incentivized to deliver outstanding care rather than simply increasing procedural volume.Garner is recognized as one of the fastest-growing healthcare technology companies nationwide. Our solutions are trusted by leading employers and providers, and we are committed to assembling a team of talented, mission-driven individuals eager to make a significant impact on healthcare at scale.About the Role:We are on the lookout for a highly skilled Senior Machine Learning Engineer to join our dynamic team. Garner’s Engineering team tackles complex technical challenges that have a meaningful purpose. Our systems analyze billions of medical records to evaluate healthcare providers nationally. Operating primarily on AWS and Kubernetes, we constantly integrate new technologies as our system load doubles each year. We anticipate our engineers to leverage cutting-edge industry practices while we enthusiastically incorporate AI into every facet of our operations. We seek teammates who take pride in their work and contribute positively to our team culture.Work Environment:This position is based in our New York City office (located in the Financial District), with a requirement to work on-site three days a week: Tuesday, Wednesday, and Thursday.Key Responsibilities:Lead team-level technical strategy and execution over multi-quarter timeframes.Utilize AI to develop, enhance, and sustain ML, data, and software systems.Elevate the engineering skill set across the organization by raising the technical standards.Collaborate across disciplines to deepen understanding of our domain and refine project iterations.Safeguard user privacy and security by implementing best practices.

About NeloNelo is a premier consumer fintech and e-commerce platform in Mexico, boasting over $500 million in annualized GMV and more than $70 million in annualized revenue. Our vision is to enhance the purchasing power of consumers across Latin America by providing a modern alternative to traditional credit cards.Nelo has successfully secured over $40 million in venture capital from esteemed investors such as Homebrew, Two Sigma Ventures, and Susa Ventures. Additionally, we have obtained a $100 million asset credit facility from Victory Park Capital.Our dynamic team includes seasoned professionals from top technology firms like Uber, Amazon, Rappi, and DiDi. We take pride in our agility, intellectual rigor, and operational efficiency. Nelo operates offices in both Mexico City and New York City.Why This Role Stands OutUnlike many Data Science positions that primarily focus on optimizing advertisements or marginally enhancing recommendation systems, this role is fundamentally different.At Nelo, your analytical models become integral to our product. You will engineer the decision-making engine that dictates credit access in an emerging market, tackling complex constrained optimization problems where subpar mathematics could lead to financial repercussions.We seek individuals who are discontented with the 'black box' methodologies of contemporary libraries and possess a genuine understanding of the statistical theories and causal relations underpinning the algorithms. If you are eager to apply academic-level rigor to a rapidly scaling profit and loss statement, this is your opportunity.Your Responsibilities:Unravel the

About WatershedWatershed is a premier enterprise sustainability platform utilized by leading companies such as Airbnb, Carlyle Group, FedEx, Visa, and Dr. Martens to effectively manage climate and ESG data. Our platform provides audit-ready metrics for both voluntary and regulatory compliance, including CSRD, while actively promoting significant decarbonization efforts. We seek passionate team members who thrive in a product-driven environment and are eager to contribute to the culture of a rapidly growing mission-oriented startup.With offices in major cities like San Francisco, New York, Denver, London, Paris, Berlin, Sydney, and Mexico City, alongside a remote workforce across the US and Europe, we invite you to consider joining our innovative journey!The RoleWe are in search of an experienced Machine Learning Engineer with a focus on AI to join our dynamic team. In this pivotal role, you will serve as a technical leader responsible for developing world-class AI tools that empower companies to measure and mitigate their carbon emissions. Your expertise in large language models (LLMs), embeddings, and other AI technologies will be instrumental in delivering exceptional features to our clients, as well as establishing the technological foundation for AI at Watershed.Key Responsibilities:Prototype, develop, and refine new product areas for Watershed, equipping our customers with powerful AI capabilities to transform data and discover methods for reducing their emissions.Productionize and launch core technologies that drive AI functionalities based on extensive operational sustainability data.Collaborate closely with product teams and other AI engineering groups to define product and technical strategies.Build evaluations, fine-tune models, and create agent harnesses to establish reliable AI systems.Stay updated on advancements in AI technology to assess their applicability for Watershed.Write high-performance, maintainable, and well-documented code across our technology stack.

About UsAt Percepta, we are dedicated to revolutionizing vital sectors through the power of applied AI. Our goal is to ensure that key industries such as healthcare, manufacturing, and energy harness the benefits of cutting-edge technology.We partner with leading organizations to facilitate AI transformation, providing:Expertise in engineering, product development, and researchMosaic, our proprietary toolkit designed for the swift deployment of intelligent architecturesStrategic alliances with notable entities like Anthropic, McKinsey, AWS, and the General Catalyst portfolioOur team is a dynamic collective of Applied AI Engineers, Embedded Product Managers, and Researchers driven by the mission to integrate advanced AI into the systems that shape our world.Percepta is a proud partner of General Catalyst.Role OverviewWe are on the lookout for an AI Infrastructure Engineer who will be responsible for the infrastructure, deployment, and operational reliability that underpin Percepta's AI systems, including the autonomous agents driving our innovations.Your role will involve enhancing existing systems: refining our Terraform configurations, fortifying deployment pipelines, and implementing more robust management of infrastructure across various regions and providers. You will also be tasked with constructing missing components and exploring uncharted territories, defining what Site Reliability Engineering (SRE) means in the context of autonomous decision-making systems.The infrastructure paradigms for future autonomous systems are yet to be established, and you will play a crucial role in shaping them.What Sets This Role ApartYou will be working with autonomous systems, where the infrastructure dynamics shift significantly when workloads have agency.Observability entails understanding the rationale behind an agent's decisions, not merely checking the health of a pod.There is a tangible gap between research and production in our environment. Our teams transition optimization algorithms and AI systems from research settings to production, and you will be integral to this process. While MLOps experience is not mandatory, you will be closer to this boundary than most infrastructure roles.Join a small team with significant ownership. You will make foundational decisions rather than inherit pre-existing ones.Your ResponsibilitiesDesign infrastructure patterns for multi-agent systems that are observable, controllable, and recoverable in innovative ways.

Join Our Team as a Machine Learning Solutions EngineerAt Lightning AI, we are pioneers in the field of artificial intelligence, empowering developers and organizations to seamlessly transition their AI concepts from research to production. As the creators of PyTorch Lightning, we offer a comprehensive platform that simplifies the development, training, and deployment of AI systems.Founded in 2019, Lightning AI has merged with Voltage Park, an AI Factory that emphasizes cost-efficient, large-scale computing solutions. Our platform is designed for researchers, startups, and established enterprises, providing them with essential tools for experimentation, training, and production inference, all while ensuring security and observability.Headquartered in New York City, with additional offices in San Francisco, Seattle, and London, we are backed by top-tier investors including Coatue, Index Ventures, Bain Capital Ventures, and Firstminute.

At GPTZero, we are committed to fostering trust and transparency across the internet. As a premier AI detection platform, we equip educators, students, journalists, marketers, and writers with the tools they need to navigate the rapidly changing world of AI-generated content. With a user base numbering in the millions, we are pioneering a category-defining company at the confluence of AI and information integrity.Our team is comprised of individuals from high-performance engineering backgrounds, including industry leaders like Meta, Perplexity, AWS, Affirm, and renowned AI research institutions such as Princeton, Caltech, and the Vector Institute.About this role:In this pivotal role, you will be instrumental in developing the next generation of AI tools designed to enhance and preserve critical thinking for humanity. The ideal candidate will be skilled in creating dependable AI agents and prompt engineering, possess a strong product sense, and demonstrate exceptional software engineering abilities. You will collaborate with a dynamic team of passionate innovators to create software that sets industry standards and has garnered millions of global users.

Role Overview root-access is hiring a Machine Learning Engineer in New York City. This role works closely with the tech team to design and build machine learning algorithms that support and improve our products. The position involves hands-on development, data analysis, and delivering solutions that scale as our business grows. What You Will Do Develop machine learning models tailored to product needs Analyze complex data sets to extract insights and guide model improvements Create solutions that can scale to meet increasing demand Collaborate with engineers and product teams to integrate AI-driven features Who We’re Looking For Experience building and deploying machine learning algorithms Strong interest in artificial intelligence and its practical applications Ability to work with large, complex data sets Comfort working in a collaborative, evolving tech environment

About QlooAt Qloo, we leverage extensive behavioral and catalog data to drive insightful recommendations across various sectors including entertainment, dining, travel, and retail. Our cutting-edge platform is constructed on a robust AWS data architecture, facilitating advanced analytics, APIs, and machine-learning models utilized by prominent brands. We are in search of a skilled Data Engineer to contribute to the enhancement and scaling of this innovative platform.Position SummaryAs a Data Engineer at Qloo, you will be instrumental in designing, constructing, and managing the data pipelines that aggregate information from external vendors, internal systems, and public sources into our S3-based data lake and related services. You will engage with AWS Glue, EMR (Spark), Athena/Hive, and Airflow (MWAA) to ensure that our data is precise, well-structured, and readily accessible for analytics, indexing, and machine-learning initiatives.You should feel confident managing end-to-end data workflows, encompassing ingestion, transformation, quality assurance, monitoring, and performance optimization.Key Responsibilities- Design, develop, and maintain batch data pipelines utilizing Python, Spark (EMR), and AWS Glue, transferring data from S3, RDS, and external sources into Hive/Athena tables.- Structure datasets in our S3/Hive data lake to facilitate analytics (Hex), API functionalities, Elasticsearch indexing, and machine learning models.- Create and manage workflows in Airflow (MWAA), handling dependency management, scheduling, retries, and alert notifications via Slack.- Establish robust data quality and validation mechanisms (schema validation, freshness/volume checks, anomaly detection) to ensure prompt issue identification through monitoring and alerts.- Enhance job performance for cost and efficiency (partitioning, file formats, join strategies, appropriate utilization of EMR/Glue resources).- Collaborate closely with data scientists, ML engineers, and application developers to comprehend data needs and design schemas and pipelines that address diverse use cases.- Contribute to internal tools and shared libraries to streamline, secure, and standardize interactions with our data platform.- Document pipelines, datasets, and best practices to ensure clear understanding and accessibility for the wider team.Required Qualifications- Bachelor's degree in Computer Science, Software Engineering, or a related discipline, or equivalent hands-on experience.- Proficient in Python and distributed data processing using Spark (PySpark) in EMR or a comparable environment.- Practical experience with key AWS data services, particularly: - S3 (data lake, partitioning, lifecycle management) - AWS Glue (jobs, crawlers, catalogs) - EMR or other managed Spark environments.

Join Squad in Transforming Recruitment with AIAt Squad, we harness the power of AI to revolutionize the way the world's top talent connects with the right challenges to tackle.The primary hurdle in recruitment doesn't lie in sourcing; it stems from data quality. Candidate information is often flawed and increasingly chaotic, being self-reported, outdated, or even inflated by AI. Recruiters, however, possess high-quality, real-time insights because they engage with candidates daily. This is why over $800 billion is spent annually on recruitment. The challenge is that this valuable information is fragmented and not scalable.Squad's innovative product consolidates signals from numerous recruiters, utilizing AI to seamlessly match candidates to job openings. This delivers unmatched reach for companies without the usual complications associated with managing external partnerships.We empower recruiters with a comprehensive business solution that allows them to maximize their earnings while focusing on their strengths: cultivating relationships and deeply understanding their candidates. This partnership yields proprietary data, as our AI organizes insights from genuine recruiter-candidate interactions that are absent on platforms like LinkedIn or traditional resumes. Every submission, rejection, and hire contributes to a self-enhancing AI matchmaking engine.We envision a future where recruitment blends human authenticity with AI efficiency. Exceptional recruiters have an essential role, and Squad is dedicated to empowering them.Ultimately, Squad aims to establish the foundational infrastructure for how talent aligns with opportunities.Why You Should Consider Joining UsSquad represents a transformative opportunity to rethink recruitment processes, and we are on a secure path to achieving this vision. Here’s why:Rapid Growth: We’ve achieved product-market fit and are expanding quickly, supporting hundreds of candidates, recruiters, and organizations daily. Our team has grown tenfold within a year.AI-Driven Business Model: Our strategy is fundamentally powered by AI, and we gain strength as foundational models evolve. We are creating resilience through cross-network effects that amplify over time.Substantial Ownership: We’re still in the early stages. You will play a pivotal role in shaping Squad's future—your contributions will influence our vision, product, team, and execution.Top-tier Investors: We have successfully raised over $5 million from respected investors including FJ Labs (Airbnb, Uber, Dropbox) and Link Ventures (Mercor, Liquid AI).Significant Potential: The opportunity for impact and growth is immense.