Have you heard of the One BILLION Row Challenge? It's a viral coding trend where engineers calculate min, mean, and max in the least amount of time possible from a text file of 1 BILLION ROWS.
I figured this would be a great opportunity to show off the future of AI-powered coding demonstrating how you can supercharge your software engineering skills using Copilots like Aider, and Cursor and tech like Electron and DuckDB. In our AI Devlog walkthrough, we break down how to tackle the min, mean, and max calculation challenge on a massive dataset using DuckDB. We'll use the latest version of turbo4, an OpenAI assistants API wrapper that enables you to build knowledge bases directly from URLs. Your custom turbo4 assistant can then consume the knowledge base and generate code for you.
This channel is dedicated to helping you transform from a traditional coder to an Agentic engineer, adept in leveraging the potency of AI-enhanced coding techniques and next-gen tools like the Assistants API from OpenAI to elevate your productivity and capability in the modern coding landscape.
We start by setting up an Electron app and guide you through using Typescript, the Vuetify framework for Vue UI components, and DuckDB's in-memory database for handling ONE BILLION rows of data efficiently. Our focus is on clear, applied knowledge, we don't care about typescript types we care about learning how to build like we're an engineer of the future. We'll utilize Two AI Coding assistants: Aider and Cursor. We'll talk and show what they're both good at and where they're weak. By following our methodical approach, you'll learn valuable strategies for improving prompt engineering abilities and get ahead of the AI wave that's redefining software engineering. Subscribe to our channel for more professional insights into AI coding, and check out our description for links to Aider, Cursor, and the Assistants API documentation.
Massive shout out to all the engineers who have participated in the One BILLION Row Challenge and all the engineers that's code has been used as a knowledge base to build large language models.
💻 One Billion Row Challenge - Electron Edition
github.com/disler/1brc-electron
🌎 2024 Predictions For AI & LLM Engineers
• 2024 Predictions for A...
🔗 Resources
1 BRC Original - www.morling.dev/blog/one-bill...
1 BRC DuckDB Post - rmoff.net/2024/01/03/1%EF%B8%...
DuckDB - duckdb.org/
Aider - aider.chat/
Cursor - cursor.sh/
Electron Vite Vue Typescript Starter - github.com/Deluze/electron-vu...
Vuetify Server Table - vuetifyjs.com/en/components/d...
Vuetify Pagination - vuetifyjs.com/en/components/p...
Electron - www.electronjs.org/
LLM In CLI - github.com/simonw/llm
📖 Chapters
00:00 - One Billion Row Challenge
01:28 - Let Cursor Code For You
04:25 - Let Aider Code For You
10:44 - Electron IPC
14:30 - Generating (not quite) 1 Billion Rows
15:30 - OpenAI Assistants API Via Turbo4
19:00 - Build Micro Knowledge Bases
24:00 - Agent DuckDB SQL & Typescript Generation
27:20 - SWEET DuckDB Commands
29:26 - Cleaning up pageTable.ts
31:05 - End to End Electron App
33:40 - AI Coding the Frontend
44:47 - One Billion Rows In Electron
49:00 - Recap & Big Picture Agentic Engineering
53:55 - Talk To Your Database (text to sql to results)
#promptengineering #aider #copilot