Senior Data Engineer

Job Title:

Senior Data Engineer

Key Skills

: Snowflake, T-SQL Python, Terraform, AWS, Docker.

Location:

Brazil

Mode:

Remote

We are seeking a Senior Data Engineer with strong expertise in Python to design, build, and enhance our data platform utilizing AWS and Snowflake. As a technical reference within the team, you will contribute to architectural decisions while ensuring data quality, reliability, and governance. This role involves developing production-grade Python solutions, including integrations with external APIs and SDKs, as well as custom logic for data pipeline orchestration.

Key Responsibilities

• Design and maintain scalable data pipelines using Airflow (MWAA).
• Develop production-grade Python code for API/SDK integrations, data processing, and custom pipeline orchestration.
• Model and evolve the Snowflake Data Warehouse and build transformations with dbt.
• Define architecture, development standards, and best practices.
• Manage infrastructure as code with Terraform.
• Ensure data quality, monitoring, and reliability using Grafana, CloudWatch, and automated testing.
• Implement data governance practices, including cataloging, lineage, and access control.
• Optimize cost and performance across Snowflake, AWS, and Spark.
• Build and maintain CI/CD processes for data pipelines and models.
• Required Skills & Qualifications
• Solid experience as a Data Engineer in production environments.
• Advanced Python (version 3.x), including production applications, external APIs/SDKs, error handling, testing, and maintainable code.
• Advanced T-SQL, including query tuning.
• Experience with Snowflake and dbt.
• Proficiency in AWS, especially S3, Lambda, EMR, and ECS.
• Experience with Terraform or equivalent IaC tools.
• Familiarity with Docker, CD practices.
• Knowledge of DATA MODELING and Data Governance.
• Experience with monitoring and Observability tools.
• Preferred Skills