CMPUT429/CMPE382 Winter 2001

4/1/02


Click here to start


Table of Contents

CMPUT429/CMPE382 Winter 2001

Centralized Shared Memory Multiprocessor

Distributed Memory Machine Architecture

Distributed Shared Memory (Clusters of SMP)

Popular Flynn Categories

Major MIMD Styles

Decentralized Memory versions

Performance Metrics: Latency and Bandwidth

Parallel Architecture

Parallel Framework

Shared Address Model Summary

Shared Address/Memory Multiprocessor Model

Example of SMP machine: Pentium “quad pack”

Message Passing Model

Data Parallel Model (SIMD)

Data Parallel Model

Advantages of shared-memory communication model

Advantages of message-passing communication model

Communication Models

What Does Coherency Mean?

Potential HW Coherency Solutions

Basic Snoopy Protocols

Basic Snoopy Protocols

Snooping Cache Variations

An Example Snoopy Protocol

Snoopy, Cache Invalidation Protocol (Example)

PPT Slide

PPT Slide

PPT Slide

PPT Slide

PPT Slide

Snoopy-Cache State Machine-I

Snoopy-Cache State Machine-II

Snoopy-Cache State Machine-III

Example

Example: Step 1

Example: Step 2

Example: Step 3

Example: Step 4

Example: Step 5

Implementation Complications

Implementing Snooping Caches

Implementing Snooping Caches

Fundamental Issues

Fundamental Issue #1: Naming

Fundamental Issue #1: Naming

Fundamental Issue #2: Synchronization

Larger MPs

Distributed Directory MPs

Directory Protocol

Directory Protocol

Directory Protocol Messages

State Transition Diagram for an Individual Cache Block in a Directory Based System

CPU -Cache State Machine

State Transition Diagram for the Directory

Directory State Machine

Example Directory Protocol

Example Directory Protocol

Example

Example

Example

Example

Example

Example

Implementing a Directory

Synchronization

Uninterruptable Instruction to Fetch and Update Memory

Uninterruptable Instruction to Fetch and Update Memory

User Level Synchronization—Operation Using this Primitive

Another MP Issue: Memory Consistency Models

Programmer’s Abstraction for a Sequential Consistency Model

Memory Consistency Model

Summary

Author: Randy H. Katz

Email: amaral@cs.ualberta.ca

Home Page: www.cs.ualberta.ca

Download presentation source