The ETL Process: Pros and Cons of Low-Code Software

-



IBM 350 Disk Storage: a huge stack of metal plates that could store up to 5,000,000 characters

In school, you learn the ropes of programming and might even find yourself tackling odd assignments, like creating a cricket simulator in C++ in just two weeks. 

In the professional world, ad hoc report requests can cause anxiety.

Gone are the days of set deadlines. 


Fear not, as you can now utilize low-code software to easily create programs by dragging and dropping tools for a wide range of tasks.

Today, our focus will be on the ETL process.

In case you're not familiar with the acronym ETL, it stands for Extract, Transform, and Load - the essential steps in the data pipeline.

This process involves extracting data from multiple sources, transforming it into a desired format or structure, and loading it into a target system for analysis or reporting.

However, this repetitive process can be time-consuming as it often involves cleaning, joining, filtering, and aggregating data.

As a result, tech giants such as Microsoft and IBM have developed ETL tools to cater to the needs of professionals who work with data on a daily basis.

Below are two benefits and two drawbacks of using low-code software within an organization:


Pros

Increased Productivity

It can significantly increase productivity by reducing the time and effort required for development, testing, and deployment.

Lower Learning Curve

Low-code software typically has a lower learning curve compared to traditional coding, making it accessible to a wider range of users, including those with limited coding experience.


Cons

Limited Customization

The pre-built components and templates provided by low-code platforms may not always meet the specific needs or requirements of complex applications, resulting in limited customization options.

Potential for Vendor Lock-In

Low-code software with proprietary components may result in vendor lock-in, making future platform or vendor switching challenging.


Resources

Comments

Post a Comment

Popular posts from this blog

Understanding Outliers

-
Image
You can clearly see which one stands out   Today's post is inspired by a question one of my colleagues had around outliers: Are there different types? And to that question, the simple answer is yes! As data professionals, we often encounter data points that stand out like a sore thumb during analysis, leaving us wondering what to do with them. In most cases, deletion seems like the obvious choice.  However, I believe we need to pause and take a closer look at these points before removing them. You see, during Exploratory Data Analysis (EDA for short), asking the right questions about the dataset is crucial to uncovering its full story.  Deleting an outlier just because it stands out can create a narrow, myopic view of the data, limiting the depth and value of the insights you can gain. Rather than rushing to remove outliers, consider what they might reveal. Could they signal an emerging trend, an unusual but important event, or even a data collection issue?  With t...
Read more

Wait! Before You Throw Away Your Laptop...

-
Image
“Our whole economy is based on planned obsolescence.” — Brooks Stevens   My Lenovo IdeaPad 350 carried me through my Computer Science degree and even hosted the beginnings of this blog series.  It witnessed late-night coding marathons, countless essays, and the very first drafts of ideas I’m still exploring today. I’ve since upgraded to an ASUS Zenbook S16 (which I’m very happy with) , but my old laptop still sits quietly on a shelf, waiting for its final chapter. If you didn’t know, the average lifespan of a laptop is about five years. When I asked a few friends what they do with their old machines, most admitted they just… keep them.  I guess I know a lot of hoarders... But honestly, that’s still better than those who throw them away like an old pair of shoes. Here’s something to think about: the world generates over 50 million metric tons of e-waste each year , and only about 20% is recycled properly . That means millions of tons of toxic metals—like lead, mercury, an...
Read more

October Reflections

-
Image
The name October comes from the Latin “octo,” meaning eight . This morning, my dad asked about my blog. I winced — I’ve been dodging it since September! But that question was the nudge I needed. Because when I stopped to think, I realized:  even without posting, I’d been living. I hiked (and fell multiple times). Tried lobster for the first time. Met my coworkers in Barbados. And impulsively bought this... (I only had 1/4) All that living gave me plenty to reflect on — and two moments in particular stood out. 1. Women in Data Science (WiDS) TT Spotlight Talk Dr. Letetia Addison invited me to speak at the Women in Data Science TT Spotlight Talk — for the second time!  She actually found me through this very blog. I wasn’t publishing much here, but I was active on LinkedIn.  When it came time to prepare my WiDS talk, I had weeks, but I started only days before. Procrastination kept winning. Then came a call with my friend Carson White, we brainstormed ways in whic...
Read more

No Laptop November

-
Image
"Life is hard, but that's what makes it interesting" - Dad It's time to break the silence once more! Things did not go as I planned, but it makes for a good story.  So you're probably wondering... " Toni, what happened? I thought you were coming back? " and to that I would say, I thought the same. I thought that I would get back in my groove and post blog 109 weeks ago! My simple hardware failure quickly escalated into a complex and costly international shipping disaster. It all started on November 7th at about 5 AM while I was clacking away on my keyboard, the display for my newly purchased Zenbook S16 decided that it was time to say goodbye. I made every attempt to reilluminate it by doing the famous "turn-it-off-and turn-it-back-on" trick and confirmed that it was a hardware issue with Asus Helpdesk. I still held a warranty , which was a relief. However, I had to send the laptop to the States so the manufacturer could fix it and send it ba...
Read more

Learning Something New: EDA on Guitars

-
Image
This is an acoustic guitar Today’s post is inspired by my childhood dream of learning to play the guitar. For years, I’d daydream about strumming chords and creating melodies, but it always felt like something I’d do “someday.”  That day finally arrived when I jokingly shared this dream aloud, and my dad decided it was time to make it a reality. Yesterday, he surprised me with my first guitar—a sleek, acoustic guitar with nylon strings. The moment I picked it up, I was both excited and intimidated. I immediately started tuning it and spent an hour practicing E-minor and A-minor chords.  My fingers quickly grew sore, and faint ridges were left behind from pressing on the strings—but I didn’t mind.  There was something unexpectedly soothing about the vibration of the strings resonating through the guitar, as if the instrument itself was encouraging me to keep going. Learning a new skill is a reminder of how persistence pays off. I know that mastering the guitar will take ti...
Read more

Is it OK to kick a robot dog?

-
Image
Boston Dynamics created a robot dog named Spot that can dance Is it okay to kick a robot dog? It’s a funny question on the surface. It’s not alive . It doesn’t feel pain. So… who cares? Lately I’ve been reading a book on AI Ethics by philosopher Mark Coeckelberg, the book is filled with tricky questions that make you stop and rethink our relationship with machines—especially the smart ones. Let me walk you through a few of them, with a few everyday examples to help make sense of it. Q1: Should We Hold Robots Responsible for Their Actions? Imagine this: a self-driving car runs a red light and causes an accident. Who do we blame? The car? (It was the one driving!) The engineers who built it? The company that sold it? Mark brings up a similar question in the book: “We don’t hold very young children responsible for what they do because they don’t know better—should the same be done for AI?”  Q2: What are the things that should only be done by humans? Let’s say AI gets really, really...
Read more

2026: Think Like a Polymath and Ask Better Questions

-
Image
  "You have not because you ask not" - James 4:2 Today’s inspiration comes from a recent conversation I had with a friend about AI. It took about five minutes for us to agree on one thing: AI is a supercharged dictionary. It retrieves, remixes, and summarizes information that already exists at blistering speed.  Where AI Shines (And Where It Doesn’t) AI is already doing useful, practical work across industries: In finance , it scans transactions for anomalies—very useful when you’re trying to spot fraud faster than a licensing officer giving out a ticket. In education , it tutors students on demand, explaining concepts in multiple ways without getting tired (or vex). In government and utilities , it helps analyze reports, policies, and data trends that would otherwise sit unread in a folder labeled “Final_Final_v7”. But notice the pattern. AI accelerates known work . It doesn’t decide what work matters. It doesn’t wake up one morning and ask, “Why does this system feel i...
Read more

Tableau, Power BI and My Preference

-
Image
Power BI is one of the fastest-growing skills overall according to Coursera's Skill Report 2024  Today’s post is inspired by my decision to learn more about Power BI over Tableau. My bias stems from the fact that Power BI was my first data visualization love, and you never forget your first! Now, when you're in the dashboard creation game, you're likely to be familiar with Tableau and Power BI (PBI for short). If not, think of these tools as canvases for placing your data visualizations such as donut charts and histograms to tell a cohesive story around a specific problem you are trying to solve.  I want to explore the key differences between the two to form a more balanced argument when discussing with a Tableau enthusiast who claims that  "Tableau is better" (very funny). Just so you know, I don’t outright hate Tableau. In fact, I use it for most of the dashboards I create at work. The Tableau community is fantastic, and the tool allows for highly customized vis...
Read more

The Human Side of Tech: Emotional Intelligence

-
Image
  The only way to deal with emotions is to find a way to express them. The term gained prominence with the publication of Daniel Goleman's book "Emotional Intelligence" in 1995, but the underlying ideas have been studied and discussed by psychologists for decades. At its core,  Emotional Intelligence means having a deep awareness of emotions—both your own and those of others.  This heightened sensitivity serves as a foundation for conflict resolution and relationship cultivation. Simply asking someone how their day is going and observing their facial expressions and tone of voice makes a difference.  In life, change is the only constant; hence, we can't always expect our coworkers to be equally responsive and cheerful every day. It's crucial to recognize that they might be facing challenges we're unaware of, such as dealing with the recent loss of a family member or an undisclosed injury. Our ability to detect signs of distress not only enables us to offer bet...
Read more

Data Stacks: Google, Microsoft and Amazon

-
Image
Stack: a pile of objects, typically one that is neatly arranged. Conversations about tech preferences tend to get heated, whether it’s Apple vs Android, Windows vs macOS, or the eternal debate about pineapple on pizza. But lately, I’ve found myself drawn to something : data stacks. Specifically, why do organizations choose Microsoft, Amazon, or Google as their cloud platform? Microsoft has quietly become the stack of choice for many enterprises, but why? What’s the real difference between AWS and Azure, and is one easier to learn than the other? More importantly, are we so locked into these proprietary tools that we’re missing out on better, open-source alternatives? Learning a new tool takes time, and that time investment often keeps us tethered to one ecosystem. But with so much innovation happening, it’s worth asking: Are we keeping our minds open to what’s out there? To answer these questions, it helps to ...
Read more