Senior Data Engineer
Taipei, Taipei City, Taiwan 职位编号 R0000035260 类别 Data Management关于这个职位
- Architect, implement, and optimize ETL/ELT workflows using tools such as Databricks and Informatica to ingest and process large datasets.
- Deploy and manage data infrastructure on Azure and AWS, including containerized services and serverless components.
- Partner with data scientists, software engineers, and business stakeholders to translate requirements into scalable data solutions.
- Monitor and tune pipeline performance, implement robust monitoring/alerting (e.g., Prometheus, DataDog), and troubleshoot production issues.
- Define and enforce data validation rules, lineage tracking, and governance standards to ensure accurate and compliant data usage.
- Build CI/CD pipelines for data code, automate deployments, and support model operationalization workflows.
- Share knowledge of data engineering best practices, conduct code reviews, and mentor junior engineers.
Qualification:
- Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or related field.
- 8+ years of hands-on experience designing and building data pipelines and infrastructure.
- Strong proficiency in data engineering tools and technologies, such as Apache Spark, Hadoop, Kafka, and cloud-based platforms (AWS, Azure, or GCP).
- Hands-on experience with data modeling, ETL processes, and distributed data processing frameworks.
推荐职位
进一步认识精鼎
