Data Engineer

• แชร์
• เก็บงาน
• พิมพ์งาน
• ร้องเรียน

• Design, develop, and maintain robust, scalable, and fault-tolerant data pipelines (ETL/ELT) using technologies such as Apache Airflow, Spark, and Python.
• Work with large, complex datasets from multiple sources and ensure high data quality and consistency.
• Build and manage data infrastructure components including Kubernetes, Docker, and cloud-based storage (e.g., MinIO).
• Collaborate with Data Scientists, Analysts, and Engineers to provide clean and curated data for analysis.
• Optimize data workflows and infrastructure to support high availability and scalability.
• Implement and maintain DevOps practices including CI/CD, monitoring, system logging, and Site Reliability Engineering (SRE) standards.
• Support and maintain databases such as MS SQL, PostgreSQL, and MySQL.
• Write efficient, reusable, and testable code in Python, SQL, C# .Net, or .Net Core.
• Ensure compliance with data governance and security best practices.

• Strong programming skills in Python, SQL, or Java.
• Proficiency in data pipeline tools such as Apache Airflow and Spark.
• Experience with relational databases (MS SQL, PostgreSQL, MySQL) and object storage like MinIO.
• Familiarity with microservices architecture using C# .Net and .Net Core.
• Solid understanding of Kubernetes, Docker, and containerized environments.
• Experience implementing DevOps and CI/CD pipelines, including monitoring and system logging

• ทำงานสัปดาห์ละ 5 วัน

Jobbkk