About the job
Join Our Team as a Data Engineer!
Are you a passionate Data Engineer looking to make an impact? At Truelogic, we pride ourselves on being a premier provider of nearshore staff augmentation services, based in New York. With over 20 years of experience, we've empowered businesses, from emerging startups to established industry leaders, to realize their digital transformation initiatives.
Our talented team of over 600 tech professionals, located in Latin America, drives innovation by collaborating with U. S. companies on transformative projects. We are committed to delivering results that truly matter, whether it's working alongside Fortune 500 companies or agile startups.
By applying for this role, you are stepping into a vibrant workplace that values your skills and ambitions. We strive to match your expertise with opportunities that promote exceptional career growth and success while contributing to projects that shape the future.
Key Responsibilities
Minimum 5 years of professional experience in data engineering.
Coding:
Proficient in Python for developing data processing solutions, utilizing technologies such as Pandas and PySpark.
Ability to consume data from various sources, including REST APIs.
Data Storage:
Experience working with both relational and non-relational data storage systems (e.g., HBASE, Cassandra, MongoDB, S3).
Data consumption and design.
Familiarity with data streaming technologies (e.g., Kafka, Kinesis) and message queuing systems (e.g., SQS, SNS, RabbitMQ).
Ensure scalability and performance optimization of data models.
Experience with distributed data storage solutions.
Data Processing:
Expertise in data and stream processing frameworks (e.g., Spark, Flink, Hadoop).
Development of data ingestion and scalable streaming pipelines.
ETL proficiency using tools like:
Talend;
Informatica;
SQL Server Integration Services (SSIS).
Reporting & Analytics:
Experience with data warehousing solutions (e.g., Snowflake, Redshift, Hive).
