CS631 : Implementation techniques in DBMS

Spring 2012


Previous years:2006, 2005 (Exams in 2005: midsem and endsem)
Instructor: S. Sudarshan
Teaching Assistants: TBA
Textbook Database System Concepts, Silberschatz, Korth and Sudarshan, 6th edition (2010), McGraw Hill.
Other reading material will be made available periodically
Book Slides, Errata, solutions to selected exercises and other resources are available at: http://db-book.com

Course contents We will be covering Implementation techniques including storage and indexing, query processing, and transaction processing (Chapters 10-16), Database architectures (Chapters 17-19), Advanced Topics (Chapters 22-26). Chapters 27-29 will be self study, but will be touched upon briefly in class. We will also cover several research papers during the course. This year we will have an increased focus on Big Data, a hot area today. As part of the course assignments, you will write Map-Reduce programs on the Hadoop system. The infrastructure for your course project will be (by default) PostgreSQL, but if you wish to do it on any other infrastructure, you can discuss it with me.

Evaluation scheme Quizes 20%, Mid-sem 20%, Assignments + Project 20%, and End-sem 40% Homeworks: 5% (sure this adds up to 105% so what?)
Note : All quizzes will be surprise quizzes. The best N-1 out of N quiz scores will be counted.
Audit Requirements: Must attend all classes and take all exams. No need to do homeworks/assignments/projects.

Lecture schedule TBA:
Office hours: TBA
Project Information TBA Project Groups TBA Information about Projects TBA
PostgreSQL Resources Click Here (Instruction on creating patch files for submitting your project (thanks to Ramdas Rao for this).)

Schedule of Lectures (from an earlier offering, WILL BE UPDATED)

Lecture Date TopicNotes
1 Jan 3 Introductin/Overview + Chapter 10: Storage and File Structure Assignment: Download and compile PostgreSQL, and open in Eclipse, using instructions provided here
2 Jan 10 Chapter 10: Storage and File Structure (Cont.) Physical Storage in PostgreSQL, Look inside above link for information on file layout, database page layout, and free space map (and lots more details src/backend/storage/freespace/README). And how PostgreSQL stores oversized attributes using the TOAST technique
3 Jan 13 Guest Lecture: Anupam Singh, Jovian Data: A multidimensional database for the cloud talk part 1, part 2
4 Jan 17 Chapter 11: Indexing Index access method interface in PostgreSQL (read only if you want to create new index types)
5 Jan 20 Chapter 11: Indexing (Cont.) Assignment on indexing and record representation (on moodle)
6 Jan 24 Chapter 12: Query Processing .
7 Jan 27 Chapter 12: Query Processing (Cont.) .
8 Jan 31 Intro. to Query Optimization .
8a Feb 1 Extra class: Overview of PostgreSQL internals -1 PostgreSQL resources, in particular see Tom Lane's talk
9 Feb 3 Chapter 13: Query Optimization (Cont.) Statistics in PostgreSQL, and examples of row estimation in PostgreSQL in particular see how PostgreSQL special cases most common values (MCVs).
10 Feb 7 Chapter 13: Query Optimization (Cont.) Assignments on query plans in PostgreSQL
10a Feb 8 Extra class: Overview of PostgreSQL internals -2, Debugging in Eclipse ..
11 Feb 10 Chapter 14 Transactions .
12 Feb 14 Chapter 15: Concurrency Control .
13 Feb 17 Chapter 15: Conc. Control (Cont) (Assignment on concurrency control on PostgreSQL)
Feb 21 No Class (Midsem) .
Feb 25 Midsemester Exam .
14 Mar ?? Chapter 16: Recovery .
15 Mar ?? Chapter 16: Recovery (Cont) ..
16 Mar ?? Chapter 17: Database Architecture .
17 Mar ?? Chapter 18: Parallel Databases .
18 Mar ?? Chapter 19: Distributed Databases .
19 Mar ?? Chapter 19: (Cont.) .
20 Apr ?? Chapter 23: XML .
20 Apr ?? Chapter 23: XML .
21 Apr ?? OLAP and Warehousing ..
22 Apr ?? Advanced Application Development and Database Tuning .
23 Apr ?? Advanced Data Types .
24 Apr ?? Last class: Overview of Database Research .