Senior Data Engineer
November 25, 2024
Closed
Closed
$1200 - $2000 per month
Location
Vietnam
Occupation
Full-time
Experience level
Senior
Job Summary:
We are seeking a skilled Data Engineer to design, build, and maintain data infrastructure for efficient data storage, transformation, and accessibility. This role will heavily focus on leveraging cloud technologies (AWS), data build tools for data transformations, and Databricks for advanced data processing to enable data-driven decision-making across the organization.
Key Responsibilities:
- Design and implement scalable data pipelines using the DBT for data modeling and transformations;
- Leverage Databricks for large-scale data processing, ensuring efficient data storage and retrieval;
- Collaborate with data scientists, analysts, and stakeholders to understand data requirements and provide relevant data solutions;
- Ensure data quality, security, and compliance with organizational policies and regulations;
- Monitor and optimize the performance of data pipelines and cloud infrastructure;
- Develop automated data workflows and ensure high availability of data infrastructure.
Qualifications:
- Proven experience as a Data Engineer or in a similar role;
- Expertise in DBT (data build tool) for developing, testing, and deploying transformations in a cloud environment;
- Hands-on experience with AWS services, including S3, RDS;
- Experience working with Databricks for data engineering tasks;
- Strong proficiency in SQL and Python for data manipulation and automation;
- Familiarity with ETL/ELT processes and data warehousing concepts.
Competencies:
- Technical Proficiency: In-depth knowledge of dbt, AWS, and Databricks.
- Cloud Expertise: Proven experience with AWS cloud infrastructure and services.
- Data Engineering: Strong background in data pipelines, ETL processes, and data modeling.
- Collaboration: Ability to work with cross-functional teams and communicate effectively with stakeholders.
Career Page: remitano.com/careers