DiscoverScale Cast – A podcast about big data, distributed systems, and scalabilityDisk-Based Parallel Computation, Rubik’s Cube, and Checkpointin
Disk-Based Parallel Computation, Rubik’s Cube, and Checkpointin

Disk-Based Parallel Computation, Rubik’s Cube, and Checkpointin

Update: 2008-03-29
Share

Description

This talk takes us on a journey through three varied, but interconnected

topics. First, our research lab has engaged in a series of disk-based

computations extending over five years. Disks have traditionally

been used for filesystems, for virtual memory, and for databases.

Disk-based computation opens up an important fourth use: an abstraction

for multiple disks that allows parallel programs to treat them in a

manner similar to RAM. The key observation is that 50 disks have

approximately the same parallel bandwidth as a _single_ RAM subsystem.

This leaves latency as the primary concern. A second key is the use

of techniques like delayed duplicate detection to avoid latency


link to video

Comments 
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Disk-Based Parallel Computation, Rubik’s Cube, and Checkpointin

Disk-Based Parallel Computation, Rubik’s Cube, and Checkpointin

burtonator