Công ty Cổ phần Công nghệ SotaTek

Data Engineer

  • Share:

Job Detail

  • Offerd Salary (USD) $800
  • Career Level Nhân viên
  • Experience 1-3 Years
  • Gender Male/Female
  • Sector Hà nội
  • Industry CNTT-Phần mềm

Job Description

Junior 

  • Data pipeline maintenance and operation
  • ETL development for data warehouse
  • Airflow-based transforming data workflow development and operation
  • SQL/Python based data processing
  • Understanding the Linux environment and writing shell scripts
  • DataOps based on AWS/GCP cloud service environment

Senior 

  • Data pipeline maintenance and operation
  • Processing data to meet functional and non-functional business requirements
  • identification, design, implement in internal processes for automatizing manual processes and optimizing data provision
  • DW data modeling and ETL design and development
  • Real-time streaming data collection and processing development
  • Design about GCP/AWS-based data platform environment and architecture 
  • K8S (GKE/EKS) Container-based service architecture design and development 
  • MLOps architecture design/development and service

Requirement

  • Experience in Data modeling, DW construction and operation 
  • Knowledge and experience in intermediate SQL/Python practical
  • Experience in ETL pipeline design and development (using SQL, Python)
  • Experience in using data pipeline and workflow management tools (Airflow, Apache Beam, etc.)
  • Cloud engineering experience in using AWS/GCP cloud services (BigQuery, Dataproc, Dataflow, Composer, DataStore, DynamoDB, SNS, SQS, GKE, EKS, etc.) (BigQuery, Dataproc, Dataflow, Composer, DataStore, DynamoDB, SNS, SQS, GKE, EKS,...)
  • Experienced in real-time data processing and application development (Kafka, Storm, Spark Streaming,...)
  • Experience in building and providing MLOps services

Required skills

Related Jobs