• [TW] Data Engineer (yes)

    加入威朋

    相信數據 與我們一起走在最前面

[TW] Data Engineer

Taipei, Taiwan

About Job

  • Develop, operate, and monitor ETL for data collection, cleansing, processing, storage, and analytics.
  • Develop data visualization to track data usage, server status, and represent data insights.
  • Automate common data process tasks and support data analysis tasks.
  • Write documents for architecture design and implementation.

About You

  • At least 2 years of experience in building and operating large scale distributed systems or applications.
  • At least 2 years of experience in processing data with Python, Scala, or R.
  • Familiar with Hadoop ecosystem, such as Spark, Hive, Hue.
  • Experience with implementing highly scalable systems on top of cloud infrastructures, such as AWS.
  • Expertise in Linux/Unix environments and familiar with shell scripting.
  • Expertise in hands-on ETL job design, components and modules development of data process.
  • Expertise in MySQL and database performance tunning.
  • Great communication skill and can-do attitude.
  • Required skills: Python, Scala, Hadoop, Hive, Spark, Linux/Unix, AWS, MySQL, R.

More About You

  • Data mining and machine learning algorithm experience is a big plus.
  • Experience with data visualization tool like Tableau is a plus.
  • Experience with Jenkins is a plus.