Responsibility:
- Dedicate on the construction or upgrade of key data platform components, i.e. data pipeline orchestration, adhering to the data platform roadmap.
- Evaluate technical options, define comprehensive solutions with comparative analysis, and implement components using Infrastructure as Code (IaC) principles, including thorough troubleshooting and unit testing.
- Collaborate closely with the Company Global Tech Data team through the Architecture Design Record (ADR) process.
Qualification:
- 7+ yr experience on Big Data solution and Cloud with hands-on and solid technical expertise.
- Master Open-Source solution, including Terraform, Airflow, DBT, Linux/Docker/K8S, GitHub, etc.
- Experience and familiar with Ali-Cloud Products, including RAM, ECS, OSS, KMS, FunctionCompute, MaxCompute, Hologres, ACK with proven project.
- Experience and familiar with Security technology, including SSO, AD, Authentication, SSL, RAM Policy.
- Strong programming background (Python, Shell, SQL, etc.).
- Experience on GCP is a big plus.
- Logical thinking, documentation and oral (EN) fluently.