Run Raw SQL in dbt with Custom MaterializationIf you need to execute complex SQL, including DDL and DML, directly in dbt without modification, you can do this by creating a custom…May 7, 2024May 7, 2024
The SaaS Sales Fatigue: A Perspective from the CustomerIn the ever-evolving landscape of tech, particularly within the areas of software and data, there’s a phenomenon that’s becoming hard to…Mar 10, 2024Mar 10, 2024
Navigating Open Source and In-house Tooling in Data Platform EngineeringIn the evolving world of data platform engineering, a common debate is whether to use open source tools or to create custom in-house…Oct 2, 2023Oct 2, 2023
Enhancing Scheduling Efficiency in Airflow with Dynamic DAGsDynamic DAGs in Airflow streamline workflow management, improve scheduler performance, and reduce manual coding, as showcased at Airflow …Oct 1, 2023Oct 1, 2023
Published inLevel Up CodingNavigating the Challenges of Entering the Data Job MarketThis article offers practical guidance for navigating the competitive data job market, covering everything from choosing the right career…Sep 29, 2023Sep 29, 2023
Published inLevel Up CodingBuilding a Data Lake Cleaner Microservice: A simple s3-data-cleaner-lambdaThe pragmatic approachAug 27, 2023Aug 27, 2023
Published inNerd For TechYour AI Writing Buddy: Simple Ways to Use ChatGPT for AuthorsThis guide has 12 ways to help authors write fiction and non-fiction books using ChatGPT. Recently, I showed these tips to some friends who…Aug 21, 2023Aug 21, 2023
Published inLevel Up CodingHarnessing the Power of Atomic Habits for Data Platform Engineering: An In-Depth Look at 1%…IntroductionJul 11, 2023Jul 11, 2023
Published inLevel Up CodingEnforcing JIRA Ticket Formatting in GitHub: PR Titles and Commit MessagesIntroductionJun 16, 2023Jun 16, 2023
Published inLevel Up CodingCommon Data Ingestion Use-Cases and Methods in Data Engineering: A Brief IntroductionData ingestion is an essential process in data engineering. Without data ingestion, there’ll be no data to work with. In this post, we’ll…May 25, 2023May 25, 2023
