Job Detail
-
Offerd Salary (USD) $800
-
Career Level Nhân viên
-
Experience 1-3 Years
-
Gender Male/Female
-
Sector Hà nội
-
Industry CNTT-Phần mềm
Job Description
Junior
- Data pipeline maintenance and operation
- ETL development for data warehouse
- Airflow-based transforming data workflow development and operation
- SQL/Python based data processing
- Understanding the Linux environment and writing shell scripts
- DataOps based on AWS/GCP cloud service environment
Senior
- Data pipeline maintenance and operation
- Processing data to meet functional and non-functional business requirements
- identification, design, implement in internal processes for automatizing manual processes and optimizing data provision
- DW data modeling and ETL design and development
- Real-time streaming data collection and processing development
- Design about GCP/AWS-based data platform environment and architecture
- K8S (GKE/EKS) Container-based service architecture design and development
- MLOps architecture design/development and service
Requirement
- Experience in Data modeling, DW construction and operation
- Knowledge and experience in intermediate SQL/Python practical
- Experience in ETL pipeline design and development (using SQL, Python)
- Experience in using data pipeline and workflow management tools (Airflow, Apache Beam, etc.)
- Cloud engineering experience in using AWS/GCP cloud services (BigQuery, Dataproc, Dataflow, Composer, DataStore, DynamoDB, SNS, SQS, GKE, EKS, etc.) (BigQuery, Dataproc, Dataflow, Composer, DataStore, DynamoDB, SNS, SQS, GKE, EKS,...)
- Experienced in real-time data processing and application development (Kafka, Storm, Spark Streaming,...)
- Experience in building and providing MLOps services
Required skills
Related Jobs
-
Front-end/Back-end Featured