Arete Technologies, Inc. logoArete Technologies, Inc. logo

Lead Big Data Engineer - Hadoop Specialist

On-site Contract

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Experience Level

Mid to Senior

Qualifications

Required Qualifications:- Bachelor’s degree or higher in Computer Science or a related field.- Strong grasp of distributed computing and big data architectures.- Passion for software engineering with a commitment to high-quality coding.- Proven experience in the Hadoop ecosystem with Apache NiFi, Kafka, Flume, Sqoop, Apache Atlas, Hive, HDFS, HBase, and Spark (Hortonworks HDP and HDF preferred).- Familiarity with leading CDC tools like Informatica PowerCenter.- Development experience with at least one NoSQL database, preferably HBase or Cassandra.- Proficient in Java and Scala with a strong understanding of functional programming and modularization principles.- Understanding of DevOps principles, including CI/CD tools like Maven, Gradle, or SBT, and version control with Git.- Experience in Agile development methodologies, particularly Scrum.- Personal qualities like creativity, curiosity, and a passion for technical excellence. Desired Qualifications:- Experience with Big Data migration and transformation in Data Warehousing/Business Intelligence.- Familiarity with ETL tools like Talend, Pentaho, and Attunity.- Knowledge of Teradata and Netezza.- Solid understanding of NoSQL data stores such as Cassandra and Neo4j.- Experience with workload orchestration tools like Oozie or Control-M.- Proficient in building self-contained applications using Docker and Vagrant.

About the job

Are you a passionate Big Data engineer looking to lead a dynamic team? Join Arete Technologies, Inc. as a Lead Big Data Engineer specializing in the Hadoop ecosystem. You will be instrumental in data ingestion and governance from over 100 source systems.

Key Responsibilities:
- Lead the Big Data engineering team, focusing on data ingestion, egestion, and governance.
- Collaborate in the design and development of the new NCR Data Lake utilizing Hortonworks HDP and HDF distributions.
- Foster team growth and technical skill development.
- Advocate for an engineering mindset and systems thinking.
- Develop deep technical expertise in data movement patterns, practices, and tools.
- Actively engage in Big Data communities and practices.
- Ensure minimal systems are put into production for efficiency.

About Arete Technologies, Inc.

Arete Technologies, Inc. is a premier consulting and outsourcing service provider, dedicated to bridging the gap between client requirements and deliverables across the globe. With a focus on delivering unparalleled services combined with cost-effective solutions, we empower organizations to thrive in today's competitive landscape while maintaining a healthy work-life balance. Our experienced team, with over 30 years in IT consulting and staffing, operates on a 24/7 model to ensure we meet your workforce needs effectively.

Similar jobs

Browse all companies, explore by city & role, or SEO search pages. View directory listings: all jobs, search results, location & role pages.

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.