AWS CDK a.k.a. Cloud Development Kit is a toolkit that allows you to code your infrastructure from the comfort of your favorite programming language. AWS CDK promotes an imperative paradigm to define your infrastructure code at design time. It transcompile the code at build time and deploys it as a Cloudformation stack (declarative) to provision the desired infrastructure. Thus AWS CDK brings the best of both imperative and declarative paradigms to develop & manage our infrastructure.

AWS Glue is a serverless ETL service offering that has a pre-built Apache Spark environment for distributed data processing. It makes developers life easy; simply write code and execute while AWS Glue take care of managing infrastructure, job execution, bookmarking & monitoring. That being said, AWS Glue is not just a managed Spark cluster, it has a component library for most common ETL tasks. But the challenge is how to leverage such capabilities during our local development. Fortunately, it is possible and I am happy to share my learning.