Data Engineer Scala
Job Summary
Our growing data teams are seeking a savvy Senior Data Engineer to join them and help build and evolve the next generation of Audience & Identity data platforms that handle data at scale and use state-of-the-art technologies to unlock the data’s business value.
- Design, implement, and maintain scalable data pipelines to ingest and transform large volumes of data from various sources
- Optimize streaming and batch data processing and storage solutions for performance and scalability
- Monitor system performance, troubleshoot issues, and implement solutions to ensure high availability and reliability
- Collaborate with product managers and other stakeholders to understand data requirements and deliver data solutions that meet business needs
- Communicate technical concepts and solutions effectively to non-technical stakeholders
- Stay abreast of emerging technologies and best practices in data engineering. Identify opportunities to improve data processes, tools, and infrastructure to enhance efficiency and effectiveness
- Document data pipelines, processes, and systems to ensure clarity and maintainability
- Share knowledge and best practices with team members to foster a culture of learning and collaboration
- Work with and mentor Junior Data Engineers
Requirements
- 5+ years of hands-on experience in the Software Development field and/or Big Data
- Strong experience in Scala or Java
- Proficient in Databricks with a solid foundation in Spark
- Experience with CI/CD tools (Jenkins)
- Familiarity with shell, ability to work well with command lines, and a solid knowledge of data structures, algorithms, and system design
- Work experience with ETL pipelinesStrong skills in SQL and experience with at least one of the major database platforms
- At least an Upper-Intermediate level of English
Would be a plus
- Experience with Python, and Golang
- Experience in the media or advertising industry
- Experience with graph databases (GraphX, Neo4J) and related analysis
- Experience with Kubernetes, Terraform, and ELK
- Experience with Snowflake
- AWS certification and previous experience with AWS services such as S3, EMR, EKS, Glue, EC2, IAM, CloudFormation, Athena, Lambda, and others
Benefits
General Ones:
- Continuous training program
- Talks and workshops on personal and professional growth
- Organizational team building events
- Rewards
- Social Responsibility committee
- Developer’s day celebration
- Birthday off
- Monthly kudos
- Holiday celebration day off
- 70+ Partnerships with restaurants, hotels, hiking groups, fitness, stores, medical services, psychology services, dental services, universities, pet supply services, pet medical pharmacy chains, events, and car services.
Payroll only:
- Legal benefits
- Life and medical insurance
- Vacations
- Paternity and maternity leave
- Birthday gift card
Why join Sapiens?
Grow, Collaborate & Learn
Discover opportunities for advancement and take on new responsibilities. Engage with a diverse network of professionals in a collaborative work environment. Access more than 150+ training programs to expand your knowledge and skills.
Build, Work & Have Stability
Join a recognized and fast-growing software company in LATAM. You can experience exciting projects with clients across the USA and Canada. Benefit from our 14 years of industry experience.