shady ibrahim · spark/hadoop, pandas, aws cloud, ... bba business admin. wilfrid laurier...

SHADY IBRAHIM

R E C E N T E X P E R I E N C E

E D U C A T I O N

T E C H N I C A L S U M M A R Y

PROGRAMMING SOFTWAREDATABASES

Python, C++, Java, C#, Scheme/Clojure, Bash, HTML/CSS Spark/Hadoop, Pandas, AWS Cloud, Airflow, Luigi Redshift, BigQuery, MySQL, Postgresql, Splunk, Oracle DB

shadyibrahim.me +1 (416) 830-2747s.ibrahim0114@gmail.com

DATA ENGINEERWeebly Inc.San Francisco CAMay - Sept 2017

DATA ENGINEER IIKik Interactive Inc. Waterloo ONJan - Apr 2017

DATA ENGINEER I Kik Interactive Inc. Waterloo ONMay - Aug 2016

DATA ANALYST Rogers Communications Brampton ONJun - Dec 2015

Founder & President ShadyCraft Servers Mississauga ONApr 2011 - Apr 2014

BCS COMPUTER SCIENCE University of Waterloo, 2019

BBA BUSINESS ADMIN.Wilfrid Laurier University Attended 2015 - 2017

Awarded President’s Scholarship of Distinction, 2015. Relevant courses: Object Oriented Programming, Statistical Modeling, Data Abstraction

BDO New Venture Competition Champion.Relevant courses: Financial Management, Operations, Macroeconomics

Built monitoring applications for all areas of the ETL to report service outages and/or data inconsistency and integrity issues. Wrote verbose logging for major ETL jobs and designed new pipelines to process data from vendors. Luigi, Python, Redshift, MySQL, S3, Slack Bot API

Migrated major data pipelines and Spark jobs from legacy infrastructure to new stack using DataBricks Python Notebooks and Airflow Data Pipelines.Spark, Airflow, Redshift, S3, EC2, DataBricks, R, Python

Automated the entire event discovery process. Wrote Bash and PySpark scripts to discover new metrics/events, infer schema, and create data pipelines to automate data load into Redshift.PySpark/Hadoop, Data Pipelines, S3, Redshift, EC2/EMR

Designed and developed Splunk data visualizations for video monitoring infrastructures. Used the D3.js library to create stunning visualizations for Big Data queries written alongside Splunk SQL. Splunk, D3.js, SQL, HTML/CSS/JS

Founded, developed, and operated the largest Minecraft gaming server in the world. Built website and web scripts to allow for product delivery automation.Java, Bash, CentOS/Debian, HTML/CSS