Adel Helal – Medium

Adel Helal
in
Campaign Monitor Engineering

Multiple Spark Streaming Jobs in a Single EMR Cluster

A managed Spark cluster can always save time on infrastructure maintenance. EMR (Elastic Map Reduce) is a tool that empowers data engineers…

7 min readFeb 13, 2020

--

1

Multiple Spark Streaming Jobs in a Single EMR Cluster

--

1

Adel Helal
in
Campaign Monitor Engineering

Efficiently Compiling Spark Jobs Built in Scala and SBT on Build Machines

Deploying a Spark job can be challenging, especially considering that one Spark job is never the same as another. Deployment times can vary…

3 min readJan 21, 2019

--

Efficiently Compiling Spark Jobs Built in Scala and SBT on Build Machines

--

Adel Helal
in
Campaign Monitor Engineering

Automating Deployments for Spark’s Structured Streaming on AWS EMR

Anyone who’s familiar with submitting a Spark job will know it’s as simple as running a single command, so long as the Spark CLI is…

5 min readSep 26, 2018

--

--

Adel Helal
in
Campaign Monitor Engineering

Aggregating Event Streams in Redshift using Matillion

If you haven’t heard of Matillion, then it’s time you knew about it. If you’ve used ETL tools in the past like the traditional SSIS for…

6 min readNov 6, 2017

--

Aggregating Event Streams in Redshift using Matillion

--

Adel Helal
in
Campaign Monitor Engineering

Don’t Always Believe Your Data

As erroneous as that statement might seem, not trusting your data might be the most prudent thing you do. In this new age of data-driven…

4 min readFeb 21, 2017

--

1

Don’t Always Believe Your Data

--

1

Adel Helal

Adel Helal

Tech Lead Engineer @ Campaign Monitor; building µservices & λs in .Net & golang, event streaming in Kafka, big data in S3 & Spark, CI in Teamcity & Octopus

Following

Help
Status
About
Careers
Blog
Privacy
Terms
Text to speech
Teams