We may also cover several research papers during the course.
As in the last two offerings, we will have an increased focus on Big Data, starting with using Big Data systems, and then diving into their internals. You will also set up PostgreSQL, and learn how to make small changes to it as part of the course assignments.
The infrastructure for your course project will be your choice of
PostgreSQL or any of the open source big data systems.
If you wish to do it on any other infrastructure, you can discuss it with me.
Evaluation scheme This semester I expect about 50% of the marks will be for endsem exams, and the rest for continuous evaluation quizzes, assignments and projects. This is subject to change.
Audit Requirements: Must attend all classes and take all exams. No need to do homeworks/assignments/projects.
|2||Aug 19, 21||Chapter 12 and 13: Physical Storage Systems and Data Storage Structures|| Assignment: Download and compile PostgreSQL, and open in Eclipse, using instructions provided here|
Physical Storage in PostgreSQL, Look inside above link for information on file layout, database page layout, and free space map (and lots more details src/backend/storage/freespace/README). And how PostgreSQL stores oversized attributes using the TOAST technique
|3||Aug 26, 28||Chapter 14: Indexing||Index access method interface in PostgreSQL (read only if you want to create new index types)|
|4||Sep 2, 4||Chapter 15: Query Processing||.|
|TBD||Extra class: Overview of PostgreSQL internals -1||PostgreSQL resources, in particular see Tom Lane's talk|
|5||Sep 9, 11, 16||Chapter 16: Query Optimization||
Statistics in PostgreSQL,
and examples of row estimation in PostgreSQL in particular see how PostgreSQL special cases most common values (MCVs).
Assignments on query plans in PostgreSQL
|TBD||Extra class: Overview of PostgreSQL internals -2, Debugging in Eclipse||..|
|6||Sep 18, 23||Chapter 17 Transactions||.|
|7||Sep 23, 25, 30||Chapter 18: Concurrency Control||.|
|8||Oct 2, 7||Chapter 19: Recovery||.|
|?? - ??||No Class (Midsem Exam)||.|
|9||Oct 16||Chapter 10: Big Data|
|10||Oct 18||Chapter 20: Database Architecture|
|11||Oct 23, 25||Parallel and Distributed Storage||.|
|12||Oct 30, Nov 1||Parallel and Distributed Query Processing|
|13||Nov 6, 8, 13||Parallel and Distributed Transaction Processing||.|
|14||Nov 15||RAFT: In search of an Understandable Consensus Algorithm, Diego Ongarro and John Ousterhout, USENIX ATC 2014||.|