Descrição da Vaga
Job Description
We are looking for a Principal Data Engineer to lead the evolution of a petabyte-scale data platform on AWS. In this role, you will design and build highly scalable, resilient, and high‑performance data pipelines and services, applying advanced software and data engineering practices. You will collaborate closely with product, engineering, and operations teams to enable next‑generation data‑driven marketing solutions, accelerate innovation, and ensure long‑term platform scalability and reliability.
Your key responsibilities
Design, implement, and evolve a petabyte‑scale AWS data platform , applying advanced engineering, distributed systems principles, and cloud‑native practices to ensure performance, reliability, and scalability.
Build and optimize highly scalable data pipelines
using Scala, Spark, and cloud‑native services, ensuring efficient, resilient, and production‑ready data processing that supports analytics and downstream products.
Act as a principal‑level technical leader , mentoring engineers, driving high‑quality code reviews, and promoting best practices to elevate engineering maturity across the organization.
Contribute to architectural and design decisions , working closely with architects, product owners, and engineering leadership to guide platform evolution aligned with business strategy.
Plan and deliver complex technical initiatives , ensuring high‑quality outcomes, predictable execution, and effective collaboration within agile value‑stream teams.
Ensure operational readiness
by following coding standards, testing practices, monitoring strategies, and release procedures, supporting production deployments to maintain platform stability.
Explore and adopt modern technologies , such as GraphQL integrations, vector databases, and AI/LLM‑based techniques, enhancing data access, platform usability, and development efficiency.
Qualifications
What we expect from you
Expert‑level software and data engineering experience in large‑scale data platforms.
Deep experience building petabyte‑scale systems using
Scala
and
Apache Spark .
Strong expertise across the
AWS data ecosystem
(Glue, S3, Athena, Managed Airflow, Iceberg).
Advanced understanding of
distributed systems
and highly parallelized workloads.
Strong skills in
query optimization, data partitioning, and efficient storage patterns .
Cloud ecosystem mastery (AWS required; Azure/GCP are pluses).
Experience influencing long‑term architecture and platform design.
Excellent code review, mentorship, and technical leadership capabilities.
Hands‑on experience working in
agile environments
and collaborating across multiple engineering teams.
Strong version control and multi‑repo collaboration skills (Git, GitHub, Bitbucket).
Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience.
Relevant experience.
+ Advanced English and availability to work hybrid in São Carlos/SP.
Nice to have
Experience with
DBT
or modern transformation frameworks.
Knowledge of
concurrent and parallel programming .
Experience with
AWS DMS
or similar migration tools.
Familiarity with
Angular
and
TypeScript .
Experience with
vector databases
(pgvector, Redis vector fields, etc.).
Practical experience applying
AI/LLM techniques
to data platforms, data access, or software quality.
Additional Information
Por que esta função é importante
Esta função protege a reputação da Experian e garante operações éticas e em conformidade em todo o Brasil. Ao combinar rigor regulatório com soluções pragmáticas e visão comercial, o Head de Compliance possibilita crescimento sustentável e protege os interesses de clientes, colaboradores e stakeholders.
A Serasa Experian é muito mais do que você imagina. Com o propósito de criar um futuro melhor, ampliando oportunidades para pessoas e empresas, no Brasil somos mais de 4 mil pessoas que atuam em diversos times e especialidades. Aqui, cada conhecimento e diversidade se complementa e você pode trabalhar no que mais ama, estamos comprometidos a construir uma cultura inclusiva e um ambiente no qual pessoas possam equilibrar a carreira com seus compromissos e interesses pessoais, prezando pelo bem-estar.
A gente se dedica muito em ser uma das melhores e mais inovadoras empresas para se trabalhar do país, possibilitando experiências e carreiras incríveis para nossas pessoas. Nossa forte abordagem de pessoas em primeiro lugar é reconhecida externamente por meio de diversas certificações de mercado: fomos premiados pelo Great Place To Work™ em 24 países e pela certificação internacional Top Employers, além de sermos reconhecidos como uma das melhores empresas para jovens profissionais e contarmos com uma avaliação de 4,6 no Glassdoor. Cada reconhecimento nos indica que estamos no caminho certo, proporcionando um ambiente de trabalho cada vez melhor para nossos talentos.
Experian Careers - Creating a better tomorrow together
Find out what its like to work for Experian by clicking here