Data Engineer

Are you a candidate who designs and develop Data Engineering pipelines?

What we are looking for:

• Define big data strategy through collaborations with stakeholders, architecture team, and product team to support data analytics, reporting, data visualization, and machine learning
• Deep understanding of data warehousing concepts, data update strategies, data modeling, data pipelines, and workflows
• Experience with open-source technologies (Spark, Kafka, Airflow, Talend, etc.)
• 2+ years of experience in Data Orchestration & ETL tools skills e.g Azure ADF, Glue, Databricks, etc
• Experience with AWS – EMR, Athena, Lambda, Kinesis, S3, EC2
• Proficient in programming languages such as Java, Scala and Python, and SQL Query Language
• Experience in both batch and stream processing technologies
• Troubleshoot data issues, validate result sets, recommend and implement process improvements, and provide ad-hoc and scheduled reports and analyses.
• Experienced working on performance tuning and optimizing long-running jobs
• Demonstrated analytical and problem-solving skills, particularly those that apply to a big data environment
• Proficient in a source code control system (e.g. ADO, GitHub)
• Good understanding of Modern Data Warehouse and Data Warehousing/ Lakehouse concepts
• Familiarity with Snowflake/ Redshift/ Azure Data Warehouse