Database Development

Communities

Reddit

• Getting started with database development (/r/databasedevelopment)

Articles and Blog Posts

• SQLite is really easy to compile
• SimpleDB: A Basic RDBMS Built From Scratch
• Extending SQLite with Rust to support Excel files as virtual tables
• Log Structured Merge Trees (LSM)
• Tutorial: Building a database from Scratch
• How to Build a Relational Database From Scratch

PostgreSQL

• Blog posts:
  • Following a Select Statement Through Postgres Internals
  • Looking Inside Postgres at a GiST Index
  • Introduction to PostgreSQL physical storage
  • Why We Built YugabyteDB by Reusing the PostgreSQL Query Layer
• Books:
  • The Internals of PostgreSQL for database administrators and system developers.
  • My summary of "The Art of PostgreSQL"
• Documentations:
  • PostgreSQL Architecture
• Projects:
  • pgx - Build Postgres Extensions with Rust!

SQLite

• Let's Build a Simple Database by cstack - Writing a SQLite clone from scratch in C.
• chidb is a programming assignments developed at the UChicago for CS undergraduate courses. chidb is a didactic relational database management system (RDBMS) designed for teaching how a RDBMS is built internally, from the data organization in files all the way up to the SQL parser and query optimizer. The design of chidb is based on SQLite, with several simplifying assumptions that make it possible to develop a complete chidb implementation over the course of a quarter or semester.
• Tools:
  • Sqlite3 Page Explorer - Cross Platform app to explore internal organisation of tables and indices.
• Go SQL DB - A pure Golang SQL database for database theory research.

Theory and Research

ComSci theory and research.

Papers

• Bao: Making Learned Query Optimization Practical (PDF) by MIT et al., 2021.
• On Automatic Database Management System Tuning Using Machine Learning (PDF) by Dana Van Aken, CMU-CS, 2017. The research formed the foundation of OtterTune automatic database tuning service.
• The Design of Postgres (PDF) by Michael Stonebraker and Lawrence A. Rowe, 1986.

Courses

• CMU 15-445/645 Databases Systems (Fall 2020) taught by Prof. Andy Pavlo.

Lists

• Awesome Database Development - Awesome materials about database development.