gsalmasi.com
Parallel Computing
Parallel Computing

The book is a collection of things I learned and things I wish I'd known while I was director of IBM's Research Parallel Processor Prototype (RP3) project. The chapters are ordered so that the fundamental factors involved are discussed first, then the needed software, and then the hardware choices (see the table of contents below). The text is sprinkled with sidebars in the style of the "Straight Arrow Trail Cards" that I liked so much as a kid, some of which I've included, along with an actual Trail Card.

I want to express special thanks to my co-author Allan Gottlieb.

  1. Overview
  2. Sample Applications
  3. Technological Constraints and Opportunities
  4. Computational Models and Selected Algorithms
  5. Languages and Programming Environments
  6. Compilers
  7. Operating Systems
  8. Interconnection Networks
  9. SIMD Parallel Architectures
  10. MIMD Parallel Architectures
  11. Hybrid Parallel Architectures


Experimental speedup vs computation-to-communication model (solid lines)
 
A genuine Straight Arrow Trail Card