daft_dataframe's profile picture. Scalable analytics, ML and data processing through a single unified interface: the Daft Python Dataframe (https://github.com/Eventual-Inc/Daft)

Daft

@daft_dataframe

Scalable analytics, ML and data processing through a single unified interface: the Daft Python Dataframe (https://github.com/Eventual-Inc/Daft)

Pinned

Want a chance to win Nvidia DGX Spark - the $4500 AI super computer? Come visit us at Ray Summit tomorrow!

daftengine's tweet image. Want a chance to win Nvidia DGX Spark - the $4500 AI super computer?

Come visit us at Ray Summit tomorrow!

Daft reposted

And I believe the updates daft has made should prove it even faster! 🚀 The new UDFs upcoming are also a great improvement in ergonomics

Deep learning training & inference need highly optimized data loading to keep expensive GPUs busy - you want data ready when the GPU needs it. Machine Learning Engineer Hampus Londögård (@hlondogard) explored how Daft shines for this challenge: - Multi-modal namespace - Smooth…

daftengine's tweet image. Deep learning training & inference need highly optimized data loading to keep expensive GPUs busy - you want data ready when the GPU needs it.

Machine Learning Engineer Hampus Londögård (@hlondogard) explored how Daft shines for this challenge:
- Multi-modal namespace
- Smooth…


Deep learning training & inference need highly optimized data loading to keep expensive GPUs busy - you want data ready when the GPU needs it. Machine Learning Engineer Hampus Londögård (@hlondogard) explored how Daft shines for this challenge: - Multi-modal namespace - Smooth…

daftengine's tweet image. Deep learning training & inference need highly optimized data loading to keep expensive GPUs busy - you want data ready when the GPU needs it.

Machine Learning Engineer Hampus Londögård (@hlondogard) explored how Daft shines for this challenge:
- Multi-modal namespace
- Smooth…

"For teams working primarily with structured data, what's the learning curve like for adopting Daft?" Kevin W., Daft's Founding Engineer says: If you're using SQL: Your existing SQL code works in Daft with minimal or no changes. If you're using Spark: We have Spark Connect…


Daft reposted

It's been a busy few months for the Daft Team in open-source, so we put together a special Fall edition blog post to highlight achievements across: - AI Functions and Providers (prompt, classify_image) - UDFs (Statefull, Async, Batch, and Generators) - daft.File Upgrades (+ new…

itsEvKlev's tweet image. It's been a busy few months for the Daft Team in open-source, so we put together a special Fall edition blog post to highlight achievements across:

- AI Functions and Providers (prompt, classify_image)
- UDFs (Statefull, Async, Batch, and Generators) 
- daft.File Upgrades (+ new…

That's a wrap for us at the Ray Summit! We chatted with 200+ people about their multimodal data workloads, batch inference needs, complex ETL jobs, and a lot more. We also gave out awesome prizes - a DGX Spark and two pink iPads to lucky winners. Thank you for stopping by!

daftengine's tweet image. That's a wrap for us at the Ray Summit!

We chatted with 200+ people about their multimodal data workloads, batch inference needs, complex ETL jobs, and a lot more.

We also gave out awesome prizes - a DGX Spark and two pink iPads to lucky winners.

Thank you for stopping by!

Daft reposted

We’re live at Ray Summit 2025! Come chat with the team to learn more about the @daftengine — running models on your data 😎😎😎

JayChia5's tweet image. We’re live at Ray Summit 2025! Come chat with the team to learn more about the @daftengine — running models on your data 😎😎😎

LLM batch inference is often costly and slow - GPUs sit idle between batches and caches evict useful data. Today we're releasing a new inference backend in Daft that can cut batch inference time in half for workloads with common prefixes. We developed Dynamic Prefix Bucketing -…

daftengine's tweet image. LLM batch inference is often costly and slow - GPUs sit idle between batches and caches evict useful data.

Today we're releasing a new inference backend in Daft that can cut batch inference time in half for workloads with common prefixes. We developed Dynamic Prefix Bucketing -…

Daft reposted

Just shipped: Faster-Whisper Pipeline for endless STT + Summaries + Subtitles + Chinese Translations + Embeddings Shouldn't matter how long your audio is or how many files you need to process. Enjoy! blog: daft.ai/blog/simplifyi…

itsEvKlev's tweet image. Just shipped: Faster-Whisper Pipeline for endless STT + Summaries + Subtitles + Chinese Translations + Embeddings
Shouldn't matter how long your audio is or how many files you need to process. Enjoy!

blog: daft.ai/blog/simplifyi…

Is Daft battle-tested vs alternatives like Spark and Ray Data? Spark: @essential_ai's @timr1126 processed 23.6B web documents (24T tokens) at 32,000 requests/second per VM: "We pushed Daft to the limit and it's battle tested... If we had to do the same thing in Spark, we would…


A use case spotlight 💡 @CloudKitchens shared how they revamped their ML infrastructure, creating what they call the DREAM stack: - Daft as their "latest and greatest kitchen gadget" for ETL, analytics, and AI/ML at scale - Ray as a distributed compute engine for data and AI…

daftengine's tweet image. A use case spotlight 💡

@CloudKitchens shared how they revamped their ML infrastructure, creating what they call the DREAM stack:

- Daft as their "latest and greatest kitchen gadget" for ETL, analytics, and AI/ML at scale
- Ray as a distributed compute engine for data and AI…

GitHub's Dev Advocate @peckjon built an AI image search engine with Daft + @GitHubCopilot 🪄 What he liked about Daft: ✨ Native image processing - treats images as actual data, not file paths ⚡ Chainable operations: decode() → resize() → encode() 📊 SQL queries on…


We kicked off our Daft contributor syncs again, the first in a long while! If you missed it, we just published the recording: na2.hubs.ly/H01rL370 Over the past few months, the team has made huge strides in architecture, model-based functionality, and UDFs - all aimed at…

daftengine's tweet card. Daft Contributor Sync | Sep 2025

youtube.com

YouTube

Daft Contributor Sync | Sep 2025


This is why we love and value our Daft community 🩷 One of our community members recently shared how he first discovered Daft - as he says, while searching for startups that were "selling gold shovels during a gold rush." He stumbled upon Daft, found it open source and credible…


Loading...

Something went wrong.


Something went wrong.