Collaborate with BA teams to understand data requirements and design ETL pipelines from the source to serving zone (raw – standardize – insight - MSK). Break down user stories into smaller tasks. Assign tasks to team members on Jira. Reuse code in Airflow to run the DAGs jobs moving data from T24 source to MinIO, and then push to the raw Bucket. Optimize AWS Glue for ETL processes to integrate and transform data from T24 sources (Raw). Implement and optimize data workflows using AWS Step Functions for seamless automation and orchestration. After reviewing code, support QC testing from SIT to UAT environment. Document source, processes, workflows, and knowledge sharing on Confluence.

Understanding the current structure on Azure Cloud. Assessing the current environment. Designing the AWS infrastructure. Creating and detailing the migration plan, including tasks and dependencies. Calculating the cost and efforts for the migration project.

Discussing with TohoGas's vendors, including ENSEK, to ensure that solutions align with business goals and technical requirements. Collaborating with ENSEK in developing a proof of concept to demonstrate the functionalities of a new system to replace the current one. Explaining scalable and maintainable microservices architectures suitable for the client's system replacement. Providing guidance on ENSEK's system for building an efficient data platform.

Performing operations such as cleaning, transformation, and integration by collaborating with the Business Analyst and Data Analyst teams. Maintaining data quality by scripting to compare data between Redshift and S3. Designing ETL data flows using AWS Glue and workflows to load data from S3 to Redshift. Utilizing various automation tools such as Git, CI/CD, and CloudFormation. Leveraging PySpark 3.0 to apply transformations like Join, Merge, Filter, and Remove Duplicates. Monitoring logs using AWS CloudWatch, CloudTrail, and SNS.

Gather business requirements for sales analytics to define KPIs for reports. Collect the dashboard requirements from end-users. Create and manage the product backlog, assigning tasks to team members. Develop mockup reports in PowerBI in collaboration with Business Users. Design the Data Warehouse schema on Amazon Redshift. Implement data migration using AWS Database Migration Service (DMS) and AWS DataSync, creating connections from DMS to Solomon ERP. Support AWS team in establishing VPN connections for Solomon ERP overseas sites, and write & schedule Python scripts to retrieve data on Windows AMI (EC2). Develop AWS Glue jobs to transform CSV files from Solomon ERP into Apache Parquet format, and use Redshift Spectrum to read from the S3 bucket. Write Lambda functions in Python to retrieve delta links, delta data, convert JSON files to CSV, and upload them to S3 from SAP Hana. Create AWS Step Functions to connect Lambda functions and automate execution via AWS EventBridge. Write PL/SQL scripts to transfer data from Staging to Data Mart on Redshift. Publish reports on PowerBI to visualize sales performance, sales trends, and regional sales analysis. Use Row Level Security to distribute Paginated Reports to different levels of Business Users. Test reports on various versions (mobile & desktop) on PowerBI to ensure responsiveness and a consistent user experience.

Extracted data from SQL Server for the Marketing and Business Department. Supported the connection of SQL Server to Power BI for Marketing Users. Conducted training sessions for Business Users on Power BI, covering areas such as connecting data sources, creating data models, reviewing relationships between tables, and generating reports. Prepared to develop internal training websites using Odoo 13 (Python).

Analyzed requirements, created designs, and delivered documented solutions that adhere to the VPBFC prescribed SDLC methodology tools. Defined standards and procedures; refined methods and techniques for data extraction, transformation, and loading. Evaluated, determined root cause, and resolved production issues. Worked closely with other IT development groups to deliver coordinated software solutions. Used the appropriate tool from the chosen database to create a detailed form for this application. Gathered business user requirements to build a data warehouse for ETL. Designed and developed SSIS packages for data extraction, transformation, and loading (ETL) processes. Designed and implemented complex SSIS packages for loading data from various source systems from many departments into a centralized data warehouse, ensuring data accuracy and integrity. Automated data integration processes with SSIS by scheduling to run daily, weekly, and monthly ETL tasks. Implemented and maintained data quality checks within SSIS packages to ensure the consistency and reliability of the integrated data. Developed and created transformation queries, views, and stored procedures for ETL processes, and processes. Documented ETL data mappings, data dictionaries, processes, programs, and solutions as per established standards for data governance. Logged all job alerts to the system and followed up as required. Analyzed requirements, got logic from Business Users and Reporting Department to make a Glossary, and rationalized the Glossary. Started to migrate all jobs from SSIS to IBM DataStage in preparation for migration to Oracle cloud. Coordinated with vendors to fix logic and update the Rationalized Glossary. Supported vendors in creating tickets on Redmine/Jira and resolving issues during the implementation process.

Led a team of 10 full-time employees and over 50 collaborators. Liaised with the IT department to develop an application for team members. Enabled team members to review and respond to customer inquiries and complaints on the website. Ensured the system tracks and displays the quantity and quality of responses. Responsible for training new employees. Disseminated product updates to the team. Assigned support roles for marketing campaigns on the fan page. Calculated monthly salaries and bonuses for the team. Monitored the effectiveness and efficiency of the team's responses. Coordinated with different departments to ensure smooth operations.