360 IT Professionals logo360 IT Professionals logo

Lead Big Data Engineer at 360 IT Professionals | Atlanta

On-site Contract

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Experience Level

Mid to Senior

Qualifications

Required Qualifications:• Bachelor's degree or higher in Computer Science or a related field.• Strong understanding of distributed computing and big data architectures.• Passionate about software engineering with a focus on quality coding practices.• Proven experience in developing Big Data solutions within the Hadoop Ecosystem, utilizing tools such as Apache NiFi, Kafka, Flume, Sqoop, Apache Atlas, Hive, HDFS, HBase, and Spark (Hortonworks HDP and HDF preferred).• Experience with at least one leading CDC tool, such as Informatica PowerCenter.• Development experience with a NoSQL database; HBase or Cassandra preferred.• Proficient in polyglot development (4-5 years+), with capabilities in Java and Scala, alongside a solid grasp of functional programming, SOLID principles, and concurrency models.• Familiarity with DevOps practices, valuing CI and CD methodologies, with experience in Maven (or Gradle or SBT) and Git preferred.• Agile development experience, including Scrum and lean methodologies.• Adheres to the “You Build! You Ship! And You Run!” philosophy.• Personal traits such as creativity, tenacity, curiosity, and a fervor for achieving deep technical excellence. Desired Qualifications:• Experience in Big Data migrations/transformations in Data Warehousing and Business Intelligence.• Familiarity with ETL tools like Talend, Pentaho, and Attunity.• Knowledge of Teradata and Netezza.• A solid foundation in NoSQL data stores, such as Cassandra and Neo4j.• Strong understanding of computer algorithms.• Experience with workload orchestration tools, such as Oozie and Control-M.• Experience in crafting self-contained applications using Docker, Vagrant, and Chef.

About the job

Join our dynamic team as a Lead Big Data Engineer, specializing in data ingestion from over 100 source systems in both batch and near real-time environments. You will be pivotal in designing and developing the new NCR Data Lake using Hortonworks HDP and HDF distributions. Your leadership will inspire the engineering team to cultivate an innovative mindset and enhance technical skills while actively participating in Big Data Communities of Practice. Your role will also involve implementing the essential systems for production, ensuring efficient data governance and egestion processes.

About 360 IT Professionals

360 IT Professionals is a premier Software Development Company based in Fremont, California, providing a comprehensive array of technology services including Mobile development, Web development, Cloud computing, and IT staffing. Our blend of IT expertise enables us to offer dynamic and effective solutions tailored to the unique needs of our global clientele. We excel in developing high-performance software and web products, specializing in mobile applications for both iPhone and Android platforms using advanced programming languages and frameworks.

Similar jobs

Browse all companies, explore by city & role, or SEO search pages. View directory listings: all jobs, search results, location & role pages.

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.