Parallel Programming Patterns Working with Concurrency in OpenMP, MPI, Java, and OpenCL

by Mattson, Timothy G.; Massingill, Berna; Sanders, Beverly

• ISBN13: 9780321685995
• ISBN10: 0321685997
• Format: Hardcover
• Copyright: 2025-02-03
• Publisher: Addison-Wesley Professional

Summary

From cloud computing to smartphones, today's highest-growth software environments depend on parallel programming. That's why parallel programming is increasingly viewed as a foundational job skill expected of every professional developer. However, parallel computing requires traditional application developers to think and work differently; that's why it's so often viewed as difficult.

 

In Parallel Programming Patterns, three leading experts cut through the complexity, showing how to "think parallel," and offering practical solutions to many of the challenges you'll encounter. Drawing on immense experience programming parallel systems and teaching others to do so, the authors cover all this, and more:

• What you need to know about concurrency in parallel programs, parallel architecture, and the jargon of parallel computing
• How to find concurrency and decompose tasks and data
• How to select and work with algorithm and supporting structures
• How to work with implementation mechanisms for UE management, synchronization, and communication
• Getting started with OpenMP, MPI, and concurrent programming in Java

Table of Contents

Preface
1. A Pattern Language for Parallel Programming
2. Background and Jargon of Parallel Computing
3. The Finding Concurrency Design Space
4. The Algorithm Structure Design Space
5. The Supporting Structures Design Space
6. The Implementation Mechanisms Design Space
Appendix A. A Brief Introduction to OpenMP
Appendix B. A Brief Introduction to MPI
Appendix C. A Brief Introduction to Concurrent Programming in Java
Glossary
Bibliography