Open in app
Home
Notifications
Lists
Stories

Write
Samhita Alla
Samhita Alla

Home

About

Published in Better Programming

·Jul 21

Is Airflow the Right Choice for Machine Learning Too?

A look at the differences between ETL and machine learning tasks — Apache Airflow is an open source platform that can be used to author, monitor, and schedule data pipelines. It is used by companies like Airbnb, Lyft, and Twitter and has been the go-to tool in the data engineering ecosystem. With an increased necessity for orchestration of data pipelines, Airflow witnessed…

Programming

5 min read

Is Airflow the Right Choice for Machine Learning Too?
Is Airflow the Right Choice for Machine Learning Too?

Published in Union-ai

·May 26

MLOps with Flyte: The Convergence of Workflows Between Machine Learning and Engineering

So your company is building jaw-dropping machine learning (ML) models that are performant and outputting the best results. The next task is to promote the models to production. It seems easy. After all, the most complex phase — building ML models — yielded a fruitful result. And shouldn’t it be…

Mlops

11 min read

MLOps with Flyte: The Convergence of Workflows Between Machine Learning and Engineering
MLOps with Flyte: The Convergence of Workflows Between Machine Learning and Engineering

Published in Towards Data Science

·May 11

Build an Event-Driven Neural Style Transfer Application Using AWS Lambda

To build a production-ready ML application and ensure its stability in the long run, we need to take care of a long checklist of requirements which include the ease with which the models could be iterated, reproducibility, infrastructure, automation, resources, memory, and so on. On top of that, we need…

Deep Learning

8 min read

Build an Event-Driven Neural Style Transfer Application Using AWS Lambda
Build an Event-Driven Neural Style Transfer Application Using AWS Lambda

Published in Better Programming

·Feb 11

5 Open-Source Tools That Can Help You Build ML Pipelines With Ease

All production-friendly — ML isn’t all about training a K-means classifier on Iris data in a Jupyter notebook. You might want to train tons of data using a complex ML model in the presence of high-end infrastructure. Now, this cannot be done with a single tool. We need a collection of them! With…

Programming

5 min read

5 Open-Source Tools That Can Help You Build ML Pipelines With Ease
5 Open-Source Tools That Can Help You Build ML Pipelines With Ease

Published in Union-ai

·Dec 8, 2021

Data-Parallel Distributed Training With Horovod and Flyte

Understand how Horovod and Flyte, along with Spark and MPIOperator, simplify building robust distributed data pipelines — This blog is with reference to a talk titled “Efficient Data Parallel Distributed Training with Flyte, Spark & Horovod”, presented by Katrina Rogan and Ketan Umare at OSPOCon 2021, Seattle. To get the ball rolling, let’s understand what the title implies.

Distributed Training

6 min read

Data-Parallel Distributed Training With Horovod and Flyte
Data-Parallel Distributed Training With Horovod and Flyte

Published in Union-ai

·Nov 11, 2021

Bring ML Close to Data Using Feast and Flyte

And handle feature-engineered data effectively in an ML pipeline — This blog is with reference to a talk titled “Self-serve Feature Engineering Platform Using Flyte and Feast,” which was presented by Ketan Umare and Felix Wang at OSPOCon 2021, Seattle. Feature engineering is one of the greatest challenges in applied machine learning. It is the process of transforming raw data…

Programming

4 min read

Bring ML Close to Data Using Feast and Flyte
Bring ML Close to Data Using Feast and Flyte

Published in Union-ai

·Sep 30, 2021

Meet Flyte at Hacktoberfest 2021

Open-source is growing fast, so are its contributors. At Flyte, we have had meaningful contributions from many contributors who have helped us improve Flyte’s codebase and made us think through unseen perspectives. We have always wanted to have more such contributions to expand our horizons. …

Open Source

4 min read

Meet Flyte at Hacktoberfest 2021
Meet Flyte at Hacktoberfest 2021

Published in Union-ai

·Sep 6, 2021

Build Indestructible Pipelines With Flyte

Understand how Flyte offers Recoverability and Reproducibility — We all love “undoing” when things don’t work as expected. Imagine the pain we would have to experience without such an option; we can’t just revert to or pull from what we have been working on before. From the perspective of machine learning or data pipelines, going back in time…

Mlops

7 min read

Build Indestructible Pipelines With Flyte
Build Indestructible Pipelines With Flyte

Published in Towards Data Science

·Jul 30, 2021

How to Use the Multiprocessing Package in Python

Understand multiprocessing in no more than 6 minutes — Multiprocessing is quintessential when a long-running process has to be speeded up or multiple processes have to execute parallelly. Executing a process on a single core confines its capability, which could otherwise spread its tentacles across multiple cores. …

Python

6 min read

How to Use the Multiprocessing Package in Python
How to Use the Multiprocessing Package in Python

Published in Union-ai

·Jul 16, 2021

Map Tasks in Flyte

Highly performant means to shard and process large datasets in parallel — MapReduce is a prominent terminology in the Big Data vocabulary owing to the ease of handling large datasets with the “map” and “reduce” operations. …

Machine Learning

4 min read

Map Tasks in Flyte
Map Tasks in Flyte
Samhita Alla

Samhita Alla

Software Engineer and Tech Evangelist @Flyte

Following
  • TDS Editors

    TDS Editors

  • Alessandro Butler

    Alessandro Butler

  • Ev Williams

    Ev Williams

  • Susan Li

    Susan Li

  • AI4ALL Team

    AI4ALL Team

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Knowable