Overview | In-Memory Data Management

The listed learning units belong to the course In-Memory Data Management. Do you want to access all course content?

Week 1

The first week will give you an understanding of origins of enterprise computing. It is vital to know the historic development which lead to the emergence of current hardware as we know it now in order to understand the decisions made in the past. Many characteristics of current applications, like materialized aggregates and a reduction of detail in the stored information, have their roots in the past. While these measures were helpful in former systems, they form an obstacle which has to be overcome now in order to allow for new, dynamic applications.

Week 2

Within the second week, the differences between a horizontal, row oriented layout and a columnar layout are discussed. Concepts like compression and partitioning are introduced. Based on that, you will get an explanation of the internal steps performed inside the database to carry out the fundamental relational operations insert, update and delete. The week concludes with a fundamental difference of SanssouciDB to most other databases: the insert only approach. Following this concept, we circumvent several pitfalls concerning referential integrity and additionally gain the foundation for a gap-less time travel feature.

Compression

Video

Self Test: Compression

Self-test

Data Layout

Video

Self Test: Data Layout

Self-test

Row vs. Column Layout (Excursion)

Video

Partitioning

Video

Self Test: Partitioning

Self-test

Insert

Video

Self Test: Insert

Self-test

Update

Video

Self Test: Update

Self-test

Delete

Video

Self Test: Delete

Self-test

Insert-Only

Video

Self Test: Insert Only

Self-test

Material

Text

Assignment Week 2

Graded Test

Week 3

The content of week 3 focuses on more advanced structures and operations within the database. The differential buffer, a means to prevent frequent resorting of the dictionaries and rewriting of the attribute vectors, is explained in further detail. Subsequently, also the merge process, which incorporates the changes from the differential buffer into the main store, is illustrated. The retrieval of information via the select statement, as well as related concepts like tuple reconstruction, early and late materialization, or a closer examination of the achieved scan speed, are also part of this week's schedule. The description of the join operation, which is used to connect information from different tables, concludes this week.

Select

Video

Self Test: Select

Self-test

Tupel Reconstruction

Video

Self Test: Tuple Reconstruction

Self-test

Scan Performance

Video

Self Test: Scan Performance

Self-test

Materialization Strategies

Video

Self Test: Materialization Strategies

Self-test

Differential Buffer

Video

Self Test: Differential Buffer

Self-test

Merge

Video

Self Test: Merge

Self-test

Join

Video

Self Test: Join

Self-test

Excursion: Hash-based Radix Partition Join

Video

Material

Text

Assignment Week 3

Graded Test

Week 4

Week 4 is all about aggregation. Aggregations are the centerpiece of every business analytics application. Given that huge impact of aggregates on all parts of a business, it is of great importance to understand what aggregate functions are, why we remove all materialized aggregates and go for aggregation on the fly. You will further learn how to greatly reduce the costs of this on demand approach by using the aggregate cache and understand its connection to the differential buffer and the merge process.

Query Processing

Video

Query Optimization

Video

Self Test: Query Optimization

Self-test

Query Scheduling

Video

Self Test: Query Scheduling

Self-test

Indices

Video

Self Test: Indices

Self-test

Aggregate Functions

Video

Self Test: Aggregate Functions

Self-test

Aggregate Cache

Video

Self Test: Aggregate Cache

Self-test

Material

Text

Assignment Week 4

Graded Test

Week 5

Week 5 sheds light on some more inner mechanisms of the database. What happens in emergency situations, when for example the power is turned off? Logging and recovery are vital parts to know in order to understand why an in-memory database is as secure as a traditional disk based one. Further, the benefits of replicas are explained. We conclude the week with an outlook onto the implications that arise with the tremendously increased speed at hands.

Overview: Logging and Recovery

Video

Logging Approaches

Video

Logging Details

Video

Self Test: Logging

Self-test

Recovery

Video

Self Test: Recovery

Self-test

Replication

Video

Self Test: Replication

Self-test

Replication Approaches (Excursion)

Video

Workload Management and Scheduling

Video

Self Test: Workload Management and Scheduling

Self-test

Multiversion Concurrency Control (MVCC)

Video

Self Test: Multiversion Concurrency Control

Self-test

Implications on Application Development

Video

Self Test: Implications on Application Development

Self-test

Predictive Maintenance (Excursion)

Video

Material

Text

Assignment Week 5

Graded Test

User survey - Video subtitles

Survey

Week 6

Week 6 will give some insights going further than the internal workings of a database. We will have a look into trending topics such as machine learning and cryptocurrencies and will relate these recent trends to databases and their applicability within (enterprise) computing.

Database-Driven Data Aging

Video

Self Test: Database-Driven Data Aging

Self-test

Actual and Historical Partitions

Video

Self Test: Actual and Historical Partitions

Self-test

What's in it for Enterprises (Excursion)

Video

Genome Analysis

Video

Self Test: Genome Analysis

Self-test

Showcase: Virtual Patient Explorer (Excursion)

Video

Introduction to Blockchain Technology

Video

Crypto Currencies (Excursion)

Video

Use Cases for Blockchain Technology

Video

What is Machine Learning? (Excursion)

Video

State-of-the-Art in Machine Learning (Excursion)

Video

Reinforcement Learning (Excursion)

Video

Material

Text

Assignment Week 6

Graded Test

Exam

The final exam will cover all content from the previous weeks and test your understanding of the course as a whole.

Exam Welcome

Text

Exam

Graded Test

Survey

Course Statistics

Text