Big Data Engineer - Hadoop & Spark Specialist

Sonsoft Inc.San Jose

On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.

Experience Level

Mid to Senior

Qualifications

Strong proficiency in Hadoop ecosystem components (HDFS, MapReduce, Hive, Pig). Experience with Apache Spark for data processing and analysis. Proficient in programming languages such as Java, Scala, or Python. Familiarity with data warehousing concepts and ETL processes. Ability to collaborate effectively in a team-oriented environment. Strong problem-solving skills and attention to detail.

About the job

Join Sonsoft Inc. as a Big Data Engineer specializing in Hadoop and Spark. In this role, you will leverage your expertise in big data technologies to design, develop, and optimize data pipelines that support our innovative analytics solutions. You will work closely with cross-functional teams to transform raw data into actionable insights, driving key business decisions.

About Sonsoft Inc.

Sonsoft Inc. is a leading provider of innovative technology solutions, specializing in big data analytics and cloud computing. We are committed to delivering exceptional service and value to our clients through cutting-edge technologies and expert knowledge.

Similar jobs

Browse all companies, explore by city & role, or SEO search pages. View directory listings: all jobs, search results, location & role pages.

1 - 20 of 734 Jobs

Search for Big Data Engineer Hadoop Spark Specialist

734 results

Select all on this page (20)

Apply

Big Data Engineer - Hadoop & Spark Specialist

Sonsoft Inc.

Full-time|On-site|San Jose

Oct 26, 2016

Apply

Big Data / Hadoop - Spark Consultant

Sonsoft Inc.

Full-time|On-site|San Jose

We are seeking a talented Big Data / Hadoop - Spark Consultant to join our growing team. In this role, you will leverage your expertise in big data technologies, particularly Hadoop and Spark, to deliver high-quality solutions for our clients. This is an exciting opportunity to work on innovative projects in a dynamic environment.

Oct 26, 2016

Apply

Big Data Engineer - Hadoop & Spark Expertise

Sonsoft Inc.

Full-time|On-site|San Jose

Join Sonsoft Inc. as a Big Data Engineer specializing in Hadoop and Spark technologies. In this dynamic role, you will engage with large data sets, develop scalable data processing models, and contribute to innovative data solutions that drive business value.

Oct 26, 2016

Apply

Big Data/Hadoop (Spark) Consultant

Sonsoft Inc.

Full-time|On-site|San Jose

Join our dynamic team at Sonsoft Inc. as a Big Data/Hadoop (Spark) Consultant. In this role, you will leverage your expertise in big data technologies to drive innovation and implement cutting-edge solutions for our clients. You will collaborate with cross-functional teams to design and optimize data architectures and analytics processes, ensuring data integrity and performance.

Jan 10, 2017

Apply

Hadoop & Spark Consultant - Join Our Innovative Team

Sonsoft Inc.

Full-time|On-site|San Jose

Are you a passionate Hadoop and Spark Consultant looking to make a significant impact? At Sonsoft Inc., we are seeking a talented professional to join our dynamic team in San Jose, California. You will leverage your expertise in big data technologies to provide innovative solutions and drive data-driven decisions.

Oct 28, 2016

Apply

Big Data / Hadoop Consultant

Sonsoft Inc.

Full-time|On-site|San Jose

Join our dynamic team at Sonsoft Inc. as a Big Data / Hadoop Consultant, where you will leverage your expertise in big data technologies to drive innovative solutions for our clients. You will be responsible for designing, implementing, and optimizing Hadoop-based systems, ensuring data integrity and performance. If you are passionate about data and thrive in a fast-paced environment, we want to hear from you!

Oct 27, 2016

Apply

Hadoop Administrator - Multiple Locations

Sonsoft Inc.

Full-time|On-site|San Jose

Join Sonsoft Inc. as a Hadoop Administrator where you will play a pivotal role in managing and optimizing our big data platform. You will work with a talented team to enhance data processing pipelines, ensuring high availability and performance. Your expertise in Hadoop ecosystems will contribute significantly to our data-driven initiatives.

Jun 21, 2017

Apply

Experienced Data Engineer with Scala, Spark, and Java

Comtech LLC

Contract|On-site|San Jose

Join Our Team as a Data EngineerAt Comtech LLC, we are seeking a seasoned Data Engineer with expertise in Scala, Spark, and Java to enhance our big data solutions. If you have a passion for data mining, analysis, and machine learning, we want to hear from you!Key Responsibilities:Collect and process large datasets using various methods including scripting, web scraping, and API calls.Collaborate with engineering teams to build and integrate algorithms for data processing.Transform unstructured data into analyzable formats and conduct thorough analyses.Support strategic business decisions by performing ad-hoc analyses as required.Extract data from relational databases and utilize statistical and visualization tools for data exploration.Advise on modeling techniques to develop robust predictive models following rigorous statistical methodologies.Establish processes for validating and updating predictive models regularly.Analyze health service utilization patterns and model outcomes for innovative healthcare delivery approaches.Work with analytics and business strategy teams to enhance the efficiency and applicability of predictive models in core software products.Conduct statistical analyses to prioritize initiatives for maximizing success.Identify improvement opportunities and communicate actionable plans.Perform strategic data analyses to meet business objectives.Explore data for insights that can lead to improved business performance.Develop a deep understanding of business processes and goals to provide management with actionable insights.

Jun 22, 2017

Apply

Big Data Developer at eproinc | San Jose

eproinc

Full-time|On-site|San Jose

Join eproinc as a Big Data Developer and play a pivotal role in transforming our data architecture into a scalable, efficient, and robust system. You will collaborate with cross-functional teams to design, develop, and implement innovative data solutions that meet business needs.

Feb 4, 2015

Apply

AI Staff Machine Learning Engineer - General AI, ML & Big Data

c-serv

Full-time|On-site|San Jose, California, United States

About the OpportunityJoin a leading global networking organization that is revolutionizing the way businesses manage their networks. Our AI Core group is pioneering innovative platforms in Generative AI, AI Agents, RAG, Knowledge Bases, Data Mining, Anomaly Detection, and LLM fine-tuning, all of which are integral to our flagship products and the creation of new offerings. Here, innovation is not just welcomed; it's a fundamental expectation.The RoleAs an AI ML Engineer, you will serve as a pivotal technical leader and thought leader, influencing our ML strategy and developing intelligent, high-performance multi-agent systems that can perceive, learn, and react in real time.Your ResponsibilitiesDefine and guide the technical vision for ML solutions across our products and platforms.Oversee the complete software development lifecycle, from design and code reviews to deployment and operational management.Design high-performance, scalable microservices, including both synchronous and asynchronous web services.Create real-time inference pipelines for complex models utilizing Triton, TensorRT, and mixed-precision computing.Mentor fellow engineers, establish technical direction, and cultivate a robust team culture.Promote engineering excellence, system resilience, and ongoing operational enhancements.

Apr 9, 2026

Apply

Data Engineer with Java & Scala Expertise

Comtech LLC

Contract|On-site|San Jose

Join Our Team as a Data Engineer!Location: San Jose, CAContract Duration: 3+ months (with potential for extension)We are seeking a talented Data Engineer with extensive experience in Big Data technologies. The ideal candidate will have over 8 years of proficiency in Java, Python, and Scala, along with hands-on experience in Spark and Machine Learning. You will play a crucial role in data mining and analysis, transforming unstructured data into actionable insights.Key Responsibilities:Gather and process large-scale raw data through scripting, web scraping, API calls, and SQL queries.Collaborate with the engineering team to design and implement algorithms for data processing.Convert unstructured data into formats suitable for analysis and conduct thorough analyses.Support business decisions with ad hoc analyses as necessary.Extract and manipulate data from various relational databases using quantitative and visualization tools.Guide the selection of appropriate modeling techniques to develop robust predictive models.Establish processes for validating and updating predictive models regularly.Analyze healthcare service utilization patterns to model outcomes and scenarios for innovative healthcare delivery models.Work closely with internal teams to enhance the applicability of predictive models within core software products.Conduct statistical analyses to prioritize initiatives that maximize success.Identify opportunities for improvement and communicate actionable plans.Perform strategic data analyses to meet business objectives.Explore data to uncover opportunities for enhanced business performance.Develop a deep understanding of business processes and strategies to provide insightful analysis to management.

Aug 18, 2017

Apply

Senior Data Engineer at Comtech LLC | San Jose

Comtech LLC

Contract|On-site|San Jose

Join Comtech LLC as a Senior Data Engineer, where you will play a pivotal role in transforming raw data into actionable insights. We are seeking a highly skilled professional with extensive experience in Big Data technologies and programming languages.Key Responsibilities:Collect and process large datasets using various techniques such as scripting, web scraping, API calls, and SQL querying.Collaborate with engineering teams to design and implement algorithms for data integration.Transform unstructured data into structured formats for analysis and perform detailed data analysis.Support strategic business decisions through ad hoc data analysis.Extract and manipulate data from relational databases while utilizing statistical and visualization tools.Guide the selection of modeling techniques to create robust predictive models using stringent statistical methods.Establish processes for the validation and updating of predictive models.Analyze healthcare utilization trends and model potential outcomes for innovative healthcare solutions.Work in tandem with business and analytics partners to enhance the efficiency and applicability of predictive models within our software offerings.Conduct statistical analyses to prioritize initiatives that maximize success.Identify opportunities for improvement and communicate actionable plans.Perform strategic research to support business objectives.Explore data to identify opportunities for enhancing business performance.Develop a thorough understanding of business processes to provide meaningful analysis to management.Engage in discussions to clarify business needs and necessary analyses.

Aug 17, 2017

Apply

Immediate Opening for Software Developer (Spark / Python) - San Jose, CA - Contract

trginc

Contract|On-site|San Jose

We are seeking a talented Software Developer with expertise in Python and Spark to join our team for an exciting new project focused on Spark database development. The ideal candidate will have a minimum of 1 year of hands-on experience with Spark and Python, demonstrating a passion for innovative solutions and a commitment to quality coding practices.

Sep 21, 2015

Apply

Data Analytics Engineer

Veeam Software

Full-time|On-site|San Jose, Costa Rica

Veeam is recognized as the Data and AI Trust Company, dedicated to empowering organizations to gain a comprehensive understanding of their data and AI, ensuring they are secure and resilient to facilitate the safe scaling of AI technologies. As a frontrunner in data resilience and security posture management, Veeam is expertly positioned at the intersection of identity, data, security, and AI risk management. With its headquarters in Seattle and a presence in over 30 countries, Veeam safeguards the operations of more than 550,000 customers globally, who rely on us to keep their businesses thriving. Join us in our fearless journey forward, as we grow, learn, and make a significant impact for some of the most prominent brands in the world.About the RoleWe are seeking a talented Analytics Engineer to become a vital part of our internal Data Management team, enhancing data-driven decision-making throughout the organization. In this pivotal role, you will be responsible for designing and maintaining scalable data models, pipelines, and transformation processes that are essential for analytics, reporting, and data science initiatives. You will work in close collaboration with analysts, data scientists, and engineering teams to ensure the data is reliable, efficient, and structured to support valuable business insights and strategic objectives.What You’ll DoDesign scalable and dependable data marts and transformation processes to meet analytics and reporting requirements.Collaborate with data analysts, data scientists, and business stakeholders to comprehend data requirements and convert them into effective data solutions.Develop optimized data models and schemas that facilitate efficient storage, retrieval, and analysis of large datasets.Create ETL and ELT pipelines that transform raw data from diverse sources into structured datasets for analytics and reporting.Partner with data, architecture, and DevOps teams to ensure the scalability, performance, and reliability of data systems.Monitor data pipelines and systems to troubleshoot issues and identify areas for enhancement.Document data architectures, flows, and processes to promote transparency, collaboration, and maintainability.

Mar 13, 2026

Apply

Lead Data Engineer

Hark

Full-time|On-site|San Jose

About HarkHark is at the forefront of artificial intelligence, dedicated to crafting sophisticated, personalized intelligence systems. Our innovative approach merges proactive, multimodal capabilities, enabling interaction through speech, text, vision, and enduring memory.We are revolutionizing the interface between humans and machines by integrating our intelligence with cutting-edge hardware. While traditional AI applications are limited to chat boxes and outdated devices, Hark is pioneering the next generation of agentic systems that communicate seamlessly with people and their environments.Our mission involves the development of multimodal models and next-generation AI hardware, all designed from the ground up as a cohesive interface for a new era of intelligent systems.About the RoleAs the Lead Data Engineer, you will establish the data infrastructure that transforms raw signals into the training datasets essential for Hark's models. You will be responsible for building and maintaining the pipelines that ensure a smooth flow of data at scale.This role encompasses the entire data engineering stack: from ingestion and transformation to quality filtering and delivery to training and evaluation systems. The efficacy of the models we deploy is directly linked to the quality of the underlying data, and this position is pivotal in owning that foundational aspect.This high-responsibility role requires collaboration with a small, agile team. You will work closely with model researchers, data collection leads, and infrastructure engineers, where the systems you design will significantly influence the quality and speed of model development.

Apr 30, 2026

Apply

Solutions Data Engineer

FloQast

Full-time|On-site|San Jose, California

Join FloQast as a Solutions Data Engineer and play a critical role in shaping our data-driven solutions. In this position, you will leverage your expertise in data engineering to design, develop, and implement solutions that enhance our operational efficiency and drive success for our clients.

Apr 6, 2026

Apply

Senior Machine Learning Engineer - Generative AI & Graph ML

Extreme Networks, Inc.

Full-time|Hybrid|San Jose, California, United States

Join a thriving team at Extreme Networks, where over 50,000 customers worldwide rely on our innovative, cloud-driven networking solutions to elevate their digital transformation journey. Our commitment to providing top-tier services and support has positioned us as a leader in scalable networking solutions, experiencing double-digit growth year after year.At Extreme, inclusion is a fundamental value that shapes our workplace culture. We celebrate diversity and strive to create an environment where every employee flourishes because of their unique perspectives.Be part of a pioneering journey with Extreme! As a global networking leader, now is the perfect time to join our dynamic team.Position: Senior Machine Learning Engineer - Generative AI, Machine Learning, Graph ML, Big DataExperience: 5 to 14 YearsWork arrangement: Hybrid/RemoteOur AI Core group is revolutionizing platforms and solutions for Generative AI, which include AI Agents, Retrieval-Augmented Generation (RAG), Knowledge Bases, Data Mining, Anomaly Detection, and LLM fine-tuning. These advancements are integral to our flagship Extreme products and are paving the way for new offerings. Together, we are transforming how organizations manage networks through the development of intelligent, high-performance multi-agent systems that can perceive, learn, and respond in real-time. At Extreme, innovation is not just encouraged; it is an expectation. Join us in shaping the future of network intelligence.

Mar 4, 2026

Apply

Lead Data Engineer at Launch Potato | San Jose, Costa Rica

Launch Potato

Full-time|Remote|San Jose, Costa Rica (remote)

WHO ARE WE?Launch Potato is a thriving digital media company that engages over 30 million visitors monthly through our renowned brands such as FinanceBuzz, All About Cookies, and OnlyInYourState.As a leader in connecting consumers to top brands through data-driven insights and technology, we are committed to creating impactful content.With our headquarters in South Florida and a remote-first mentality that spans over 15 countries, we foster a high-growth, high-performance culture where agility, accountability, and measurable results are at the forefront of our success.WHY JOIN US?At Launch Potato, you will fast-track your career by taking ownership of results, acting swiftly, and making a difference alongside a global team of talented professionals.

May 4, 2026

Apply

Senior Staff Engineer, Data Platform

FloQast

Full-time|On-site|San Jose, California

Join FloQast as a Senior Staff Engineer, Data, and become an integral part of our technical leadership team. In this role, you will spearhead the design, implementation, and continuous enhancement of FloQast’s core data platform. You will set the standards for data ingestion, governance, storage, processing, and access that empower our product and analytics systems. Your contributions will establish a robust, scalable, and secure data foundation that enables our engineering, product, and business operations teams to thrive.Note: Visa sponsorship is not available at this time.

Jun 6, 2025

Apply

Data Designer and Model Specialist

Merge API Integration Sandbox

Full-time|On-site|San Jose

Job Overview:Join our innovative team as a Data Designer and Model Specialist. In this pivotal role, you'll be tasked with the design and structuring of data models that are not only efficient but also scalable and effective. A solid grasp of data architecture, data flow, and modeling techniques is essential to cater to both business and analytical needs.Key Responsibilities:Data Modeling: Create, develop, and uphold comprehensive data models, including logical, physical, and conceptual frameworks. Ensure alignment with business objectives and system specifications.Data Architecture: Design and oversee data architecture frameworks that facilitate the organization's business intelligence, reporting, and data integration requirements.Data Analysis and Design: Evaluate business requirements to translate them into functional data models. Collaborate with stakeholders to refine and optimize design based on data needs.Data Quality Assurance: Uphold data integrity, accuracy, and quality by establishing effective validation rules and standards for data models.Database Design: Construct both normalized and denormalized database structures to enhance data storage, retrieval, and processing capabilities.ETL and Data Integration: Partner with data engineers to design and execute ETL (Extract, Transform, Load) processes, ensuring seamless data integration from diverse sources into the data warehouse.

Apr 24, 2025

Create account — see all 734 results

Browse all companies, explore by city & role, or SEO search pages. View directory listings: all jobs, search results, or location & role pages.