Toptal: Senior Data Engineer – AWS Data Lake & Pipeline Architecture

The useful part

The work includes building and consuming web services, integrating search technologies, supporting personalization and recommendation engines, and applying data engineering best practices across the platform. Summary We are seeking a Data Engineer to support the development of a Data Intelligence Platform. This role focuses on data modeling, data services, data pipelines, and cloud-based data infrastructure for reporting, analytics, and data science.

How it works

• General information This Data Engineer will support data-related operations across a broader Data Intelligence Platform team.
• The role spans cloud-based data architecture, database performance, pipeline automation, and support for data scientists, researchers, and internal business units.
• The environment includes AWS-based infrastructure and a mix of structured and unstructured data sources.
• Participate in the architecture design and implementation of high-performance, scalable, and optimized data solutions..
• Handle database procedures such as upgrades, backups, recovery, and migration..

What to take from it

Design, build, and automate the deployment of data pipelines and applications.. Collaborate with business units and data science teams on data access, transformation, processing, and reporting needs.. Support implementation, technical issues, and training related to the data lake ecosystem..

Details worth keeping

Write and optimize in-application SQL statements.. Ensure the performance, security, and availability of databases.. Prepare documentation and technical specifications..