Customer Profiling Machine Learning System - Japan
Responsible for engineering tasks within the department, primarily involving Python and DevOps. Collaborated closely with the Project Manager and Data Scientists to understand and clarify requirements, and to plan for each Agile sprint. Designed, developed, and managed a Customer Profiling machine learning system implementing Contrastive Explanation workflows (XAI with SHAP) aimed at aiding Data Scientists and Marketers in analyzing user behaviors on Rakuten Ichiba to devise business strategies. Also responsible for designing, developing, optimizing, and maintaining ETL pipelines for producing dashboards catered to a wide range of enterprise clients selling merchandise on Rakuten Ichiba.
Took care of department engineering tasks, primarily involving Python and DevOps.
Worked closely with Project Manager and Data Scientists to get, clarify requirements and make plan for each Agile sprint.
Designed, developed and maintained Customer Profiling machine learning system to run Contrastive Explanation workflows (XAI with SHAP) to help Data Scientists, Marketers analyze user behaviors on Rakuten Ichiba to make business strategies.
Designed, developed, optimized and maintained ETL pipelines to produce dashboards for a wide variety of enterprise clients selling merchandise on Rakuten Ichiba.
Technologies: Keberized Hadoop, Spark, Hive, GCP, Python (Flask, Dash, Streamlit, Jupyter Lab, Pandas, AsyncIO, ...), MySQL, MongoDB, Redis, Docker, Airflow, Okta