A. Abbas,
Grid Computing: A Practical Guide to Technology and Applications,
Charles River Media, Hingham, MA, 2004.
G. S. Almasi and A. Gottlieb,
Highly Parallel Computing, 2nd ed.,
Benjamin/Cummings, Redwood City, CA, 1994.
F. Berman, A. Hey, and G. Fox, eds.,
Grid Computing: Making the Global Infrastructure a Reality,
John Wiley & Sons, New York, 2003.
A. Chalmers and J. Tidmus,
Practical Parallel Processing,
International Thomson, Boston, 1996.
B. Codenotti and M. Leoncini,
Introduction to Parallel Processing,
Addison-Wesley, Reading, MA, 1993.
J. M. Crichlow,
Introduction to Distributed and Parallel Computing,
Prentice Hall, Englewood Cliffs, NJ, 1988.
Y. Deng, Applied Parallel Computing, World Scientific, Hackensak, NJ,
2011.
G. R. Desrochers, Principles of Parallel and Multiprocessing,
McGraw-Hill, New York, 1987.
J. Dongarra, et al., eds.,
Sourcebook of Parallel Computing,
Morgan Kaufmann, San Francisco, 2003.
K. Dowd and C. R. Severance,
High Performance Computing, 2nd. ed.,
O'Reilly, Sebastopol, CA, 1998.
H. El-Rewini and T. G. Lewis,
Distributed and Parallel Computing,
Manning, Greenwich, CT, 1998.
I. Foster and C. Kesselman, eds.,
The Grid: Blueprint for a New Computing Infrastructure,
Morgan Kaufmann, San Francisco, 1999.
I. Foster and C. Kesselman, eds.,
The Grid 2: Blueprint for a New Computing Infrastructure,
Morgan Kaufmann, San Francisco, 2003.
T. J. Fountain,
Parallel Computing: Principles and Practice,
Cambridge University Press, New York, 1994.
F. Gebali,
Algorithms and Parallel Computing,
John Wiley & Sons, New York, 2011.
R. W. Hockney and C. R. Jesshope,
Parallel Computers 2: Architecture, Programming and Algorithms,
Institute of Physics Publishing, Philadelphia, 1988.
R. M. Hord,
Understanding Parallel Supercomputing,
IEEE Press, New York, 1999.
E. V. Krishnamurthy,
Parallel Processing: Principles and Practice,
Addison-Wesley, Reading, MA, 1989.
H. F. Jordan and G. Alaghband,
Fundamentals of Parallel Processing,
Prentice Hall, Upper Saddle River, NJ, 2003.
E. L. Leiss,
Parallel and Vector Computing: A Practical Introduction,
McGraw-Hill, New York, 1995.
T. G. Lewis and H. El-Rewini,
Introduction to Parallel Computing,
Prentice Hall, Englewood Cliffs, NJ, 1992.
G. J. Lipovski and M. Malek, Parallel Computing: Theory and
Comparisons, John Wiley & Sons, New York, 1987.
D. I. Moldovan,
Parallel Processing: From Applications to Systems,
Morgan Kaufmann, San Mateo, CA, 1993.
H. S. Morse,
Practical Parallel Computing,
Academic Press, New York, 1994.
W. P. Petersen and P. Arbenz,
Introduction to Parallel Computing: A Practical Guide with Examples
in C,
Oxford University Press, New York, 2004.
M. J. Quinn,
Parallel Computing: Theory and Practice,
McGraw-Hill, New York, 1994.
S. Rajasekaran and J. Reif, eds.,
Handbook of Parallel Computing: Models, Algorithms, and Applications,
Chapman & Hall/CRC, Boca Raton, FL, 2008.
S. H. Roosta,
Parallel Processing and Parallel Algorithms: Theory and Computation,
Springer, New York, 2000.
J. A. Sharp, An Introduction to Distributed and Parallel Processing,
Blackwell, London, 1987.
A. Y. Zomaya, ed.,
Parallel and Distributed Computing Handbook,
McGraw-Hill, New York, 1996.
Parallel Programming
G. R. Andrews,
Concurrent Programming: Principles and Practice,
Benjamin/Cummings, Redwood City, CA, 1991.
G. R. Andrews,
Foundations of Multithreaded, Parallel, and Distributed Programming,
Addison-Wesley, Reading, MA, 2000.
R. G. Babb, ed.,
Programming Parallel Processors,
Addison-Wesley, Reading, MA, 1988.
L. Baker and B. J. Smith,
Parallel Programming,
McGraw-Hill, New York, 1996.
B. E. Bauer,
Practical Parallel Programming,
Academic Press, New York, 1992.
M. Ben-Ari,
Principles of Concurrent and Distributed Programming,
2nd ed., Addison-Wesley, Reading, MA, 2006.
G. E. Blelloch,
Vector Models for Data-Parallel Computing,
MIT Press, Cambridge, MA, 1990.
T. Braunl,
Parallel Programming: An Introduction,
Prentice Hall, Englewood Cliffs, NJ, 1993.
S. Brawer,
Introduction to Parallel Programming,
Academic Press, New York, 1989.
C. Breshears,
The Art of Concurrency: A Thread Monkey's Guide to Writing Parallel
Applications
, O'Reilly Media, Sebastopol, CA, 2009.
P. Brinch Hansen,
Studies in Computational Science: Parallel Programming Paradigms,
Prentice Hall, Englewood Cliffs, NJ, 1995.
A. Burns and G. Davies,
Concurrent Programming,
Addison-Wesley, Reading, MA, 1993.
N. Carriero and D. Gelernter,
How to Write Parallel Programs: A First Course,
MIT Press, Cambridge, MA, 1990.
K. M. Chandy and J. Misra,
Parallel Program Design: A Foundation,
Addison-Wesley, Reading, MA, 1988.
K. M. Chandy and S. Taylor,
An Introduction to Parallel Programming,
Jones & Bartlett, Boston, 1992.
I. T. Foster,
Designing and Building Parallel Programs,
Addison-Wesley, Reading, MA, 1995.
Available online
S. Goedecker and A. Hoisie,
Performance Optimization of Numerically Intensive Codes,
SIAM, Philadelphia, 2001.
G. Hager and G. Wellein,
Introduction to High Performance Computing for Scientists and Engineers,
CRC Press, Boca Raton, FL, 2011.
M. Herlihy and N. Shavit,
The Art of Multiprocessor Programming,
Morgan Kaufmann, San Francisco, 2008.
C. A. R. Hoare,
Communicating Sequential Processes,
Prentice Hall, Englewood Cliffs, NJ, 1985.
A. H. Karp, “Programming for parallelism,” IEEE
Computer Vol. 20, No. 9, pp. 43-57, 1987
J. Kepner,
Parallel MATLAB for Multicore and Multinode Computers,
SIAM, Philadelphia, 2009.
D. B. Kirk and W. W. Hwu,
Programming Massively Parallel Processors: A Hands-on Approach,
Morgan Kaufmann, San Francisco, 2010.
A. L. Lastovetsky,
Parallel Computing on Heterogeneous Networks,
John Wiley & Sons, New York, 2003.
B. P. Lester,
The Art of Parallel Programming, 2nd ed.,
1st World Publishing, Fairfield, IA, 2006.
C. Lin and L. Snyder,
Principles of Parallel Programming,
Addison-Wesley, Boston, 2008.
P. Luszczek,
Parallel programming in MATLAB,
Internat. J. High Perf. Comput. Appl.,
23:277-283, 2009.
T. G. Mattson, B. A. Sanders, and B. L. Massingill,
Patterns for Parallel Programming,
Addison-Wesley, Boston, 2005.
J. L. Ortega-Arjona,
Patterns for Parallel Software Design,
Wiley, New York, 2010.
R. H. Perrott,
Parallel Programming,
Addison-Wesley, Reading, MA, 1987.
M. J. Quinn,
Parallel Programming in C with MPI and OpenMP,
McGraw-Hill, New York, 2003
S. Ragsdale, ed.,
Parallel Programming,
McGraw-Hill, New York, 1991.
T. Rauber and G. Runger,
Parallel Programming for Multicore and Cluster Systems,
Springer, New York, 2010.
B. Wilkinson and M. Allen,
Parallel Programming, 2nd ed.,
Prentice Hall, Upper Saddle River, NJ, 2004.
G. V. Wilson,
Practical Parallel Programming,
MIT Press, Cambridge, MA, 1995.
Parallel Programming Languages and Systems
C. Amza, A. Cox, S. Dwarkadas, P. Keleher, H. Lu, R. Rajamony, W. Yu, and
W. Zwaenepoel, “TreadMarks: Shared Memory Computing on Networks of
Workstations,” IEEE Computer, Vol. 29, No. 2, February 1996,
pp. 18-28.
Available online
D. F. Bacon, S. L. Graham, and O. J. Sharp, “Compiler transformations
for high-performance computing,” ACM Computing Surveys Vol. 26,
pp. 345-420, 1994
H. E. Bal, J. G. Steiner, and A. S. Tanenbaum, Programming languages
for distributed computing systems, ACM Computing Surveys Vol. 21,
pp. 261-322, 1989
D. R. Butenhof,
Programming with POSIX Threads,
Addison-Wesley, Reading, MA, 1997.
R. Chandra, R. Menon, L. Dagum, D. Kohr, D. Maydan, and J. McDonald,
Parallel Programming in OpenMP,
Morgan Kaufmann, San Francisco, 2000.
B. Chapman, G. Jost, and R. van der Pas,
Using OpenMP: Portable Shared Memory Parallel Programming,
MIT Press, 2008.
A. Geist, A. Beguelin, J. Dongarra, W. Jiang, R. Manchek, and V. Sunderam,
PVM: Parallel Virtual Machine, A User's Guide and Tutorial for Networked
Parallel Computing,
MIT Press, Cambridge, MA, 1994.
Available online
W. Gropp, S. Huss-Lederman, A. Lumsdaine, E. Lusk, B. Nitzberg, W. Saphir,
and M. Snir,
MPI: The Complete Reference, Vol. 2, The MPI Extensions,
MIT Press, Cambridge, MA, 1998.
W. Gropp, E. Lusk, and A. Skjellum,
Using MPI: Portable Parallel Programming with the Message-Passing
Interface, 2nd ed.,
MIT Press, Cambridge, MA, 1999.
W. Gropp, E. Lusk, and R. Thakur,
Using MPI-2: Advanced Features of the Message Passing Interface,
MIT Press, Cambridge, MA, 1999.
P. J. Hatcher and M. J. Quinn,
Data-Parallel Programming on MIMD Computers,
MIT Press, Cambridge, MA, 1991.
S. Kleiman, D. Shah, and B. Smaalders, Programming with Threads,
Prentice Hall, Upper Saddle River, NJ, 1996.
C. H. Koelbel, D. B. Loveman, R. S. Schreiber, G. L. Steele, and M. E. Zosel,
The High Performance Fortran Handbook,
MIT Press, Cambridge, MA, 1994.
B. Nichols, D. Buttlar, and J. P. Farrell,
Pthreads Programming,
O'Reilly & Associates, Sebastopol, CA, 1996.
P. S. Pacheco, Parallel Programming with MPI, Morgan Kaufmann,
San Francisco, 1997.
P. S. Pacheco, An Introduction to Parallel Programming,
Morgan Kaufmann, San Francisco, 2011.
S. Prasad, Multithreading Programming Techniques, McGraw-Hill,
New York, 1997.
M. Snir, S. Otto, S. Huss-Lederman, D. Walker, and J. Dongarra,
MPI: The Complete Reference, Vol. 1, The MPI Core, 2nd ed.,
MIT Press, Cambridge, MA, 1998.
1st ed. available online
M. J. Sottile, T. G. Mattson, and C. E. Rasmussen,
Introduction to Concurrency in Programming Languages,
CRC Press, Boca Raton, FL, 2009.
G. V. Wilson and P. Lu, eds.,
Parallel Programming Using C++,
MIT Press, Cambridge, MA, 1996.
M. Wolfe,
High Performance Compilers for Parallel Computing,
Addison-Wesley, Reading, MA, 1996.
Parallel Architectures
R. Buyya, editor,
High Performance Cluster Computing,
two volumes, Prentice Hall, Upper Saddle River, NJ, 1999.
D. E. Culler, J. P. Singh, and A. Gupta,
Parallel Computer Architecture,
Morgan Kaufmann, San Francisco, 1998.
A. L. DeCegama, Parallel Processing Architectures and VLSI Hardware,
Prentice Hall, Englewood Cliffs, NJ, 1989.
J. Duato, S. Yalamanchili, and L. Ni, Interconnection Networks: An
Engineering Approach, IEEE Computer Society Press, 1997.
M. J. Flynn,
Computer Architecture: Pipelined and Parallel Processor Design,
Jones & Bartlett, Sudbury, MA, 1995.
K. Hwang and F. A. Briggs,
Computer Architecture and Parallel Processing,
McGraw-Hill, New York, 1984.
K. Hwang,
Advanced Computer Architecture: Parallelism, Scalability,
Programmability,
McGraw-Hill, New York, 1993.
K. Hwang and Z. Xu,
Scalable Parallel Computing,
McGraw-Hill, New York, 1998.
D. E. Lenoski and W.-D. Weber,
Scalable Shared-Memory Multiprocessing,
Morgan Kaufmann, San Francisco, 1995.
G. F. Pfister,
In Search of Clusters: The Ongoing Battle in Lowly Parallel
Computing, 2nd ed.,
Prentice Hall, Upper Saddle River, NJ, 1998.
D. A. Reed and R. M. Fujimoto,
Multicomputer Networks: Message-Based Parallel Processing,
MIT Press, Cambridge, MA, 1987.
H. J. Siegel, Interconnection Networks for Large-Scale
Parallel Processing, D. C. Heath, 1985.
H. S. Stone,
High-Performance Computer Architecture, 3rd ed.,
Addison-Wesley, Reading, MA, 1993.
A. Varma and C. S. Raghavendra, Interconnection Networks for
Multiprocessors and Multicomputers: Theory and Practice,
IEEE Computer Society, 1994
Parallel Algorithms (theoretical)
S. G. Akl,
The Design and Analysis of Parallel Algorithms,
Prentice Hall, Englewood Cliffs, NJ, 1989.
S. G. Akl,
Parallel Computation: Models and Methods,
Prentice Hall, Upper Saddle River, NJ, 1997.
K. A. Berman and J. L. Paul,
Fundamentals of Sequential and Parallel Algorithms,
PWS Publishing, Boston, 1997.
P. Chaudhuri,
Parallel Algorithms: Design and Analysis,
Prentice Hall, Englewood Cliffs, NJ, 1992.
A. Gibbons and W. Rytter,
Efficient Parallel Algorithms,
Cambridge University Press, New York, 1988.
A. Gibbons and P. Spirakis, eds.,
Lectures on Parallel Computation,
Cambridge University Press, New York, 1993.
R. Greenlaw, H. J. Hoover, and W. L. Ruzzo,
Limits to Parallel Computation: P-Completeness Theory,
Oxford University Press, New York, 1995.
J. JaJa,
An Introduction to Parallel Algorithms,
Addison-Wesley, Reading, MA, 1992.
L. H. Jamieson, D. B. Gannon, and R. J. Douglass, eds.,
The Characteristics of Parallel Algorithms,
MIT Press, Cambridge, MA, 1987.
J. Reif, ed.,
Synthesis of Parallel Algorithms,
Morgan Kaufmann, San Mateo, CA, 1993.
J. R. Smith,
The Design and Analysis of Parallel Algorithms,
Oxford University Press, New York, 1993.
C. Xavier and S. S. Iyengar,
Introduction to Parallel Algorithms,
John Wiley & Sons, New York, 1998.
Parallel Algorithms (practical)
H. Casanova, A. Legrand, and Y. Robert,
Parallel Algorithms,
CRC Press, Boca Raton, FL, 2009.
M. Cosnard and D. Trystram,
Parallel Algorithms and Architectures,
International Thomson, Boston, 1995.
A. Grama, A. Gupta, G. Karypis, and V. Kumar,
Introduction to Parallel Computing, 2nd ed.,
Addison-Wesley, Boston, 2003.
S. Lakshmivarahan and S. K. Dhall,
Analysis and Design of Parallel Algorithms: Arithmetic and Matrix
Problems,
McGraw-Hill, New York, 1990.
F. T. Leighton,
Introduction to Parallel Algorithms and Architectures: Arrays, Trees,
Hypercubes,
Morgan Kaufmann, San Mateo, CA, 1992.
R. Miller and Q. F. Stout,
Parallel Algorithms for Regular Architectures: Meshes and Pyramids,
MIT Press, Cambridge, MA, 1996.
B. Parhami,
Introduction to Parallel Processing: Algorithms and Architectures,
Plenum, New York, 1999.
M. J. Quinn,
Designing Efficient Algorithms for Parallel Computers,
McGraw-Hill, New York, 1987.
S. Ranka and S. Sahni,
Hypercube Algorithms,
Springer, New York, 1990.
Parallel Numerical Algorithms and Applications
D. Bader, ed.,
Petascale Computing: Algorithms and Applications,
Chapman & Hall/CRC, Boca Raton, FL, 2007.
J. M. Bahi, S. Contassot-Vivier, and R. Couturier,
Parallel Iterative Algorithms,
Chapman & Hall/CRC, Boca Raton, FL, 2007.
D. P. Bertsekas and J. N. Tsitsiklis,
Parallel and Distributed Computation: Numerical Methods,
Prentice Hall, Englewood Cliffs, NJ, 1989.
R. H. Bisseling,
Parallel Scientific Computation: A Structured Approach using BSP and MPI,
Oxford University Press, New York, 2004.
A. M. Bruaset and A. Tveito, eds., Numerical Solution of Partial
Differential Equations on Parallel Computers, Springer, New York, 2006.
K. Burrage,
Parallel and Sequential Methods for Ordinary Differential Equations,
Oxford University Press, New York, 1995.
G. F. Carey, ed.,
Parallel Supercomputing: Methods, Algorithms and Applications,
John Wiley & Sons, New York, 1989.
Y. Censor and S. A. Zenios,
Parallel Optimization: Theory, Algorithms, and Applications,
Oxford University Press, New York, 1997.
E. Chu and A. George,
Inside the FFT Black Box: Serial and Parallel Fast Fourier Transform
Algorithms,
CRC Press, Boca Raton, FL, 1999.
C. C. Douglas, G. Haase, and U. Langer,
A Tutorial on Elliptic PDE Solvers and Their Parallelization,
SIAM, Philadelphia, 2003.
L. D. Fosdick, E. R. Jessup, C. J. C. Schauble, and G. Domik,
An Introduction to High-Performance Scientific Computing,
MIT Press, Cambridge, MA, 1996.
G. C. Fox, M. A. Johnson, G. A. Lyzenga, S. W. Otto, J. K. Salmon, and
D. W. Walker,
Solving Problems on Concurrent Processors,
Prentice Hall, Englewood Cliffs, NJ, 1988.
G. C. Fox, R. D. Williams, and P. C. Messina,
Parallel Computing Works!,
Morgan Kaufmann, San Francisco, 1994.
Available online
T. L. Freeman and C. Phillips,
Parallel Numerical Algorithms,
Prentice Hall, Englewood Cliffs, NJ, 1992.
G. Golub and J. M. Ortega,
Scientific Computing: An Introduction with Parallel Computing,
Academic Press, New York, 1993.
G. E. Karniadakis and R. M. Kirby,
Parallel Scientific Computing in C++ and MPI,
Cambridge University Press, New York, 2003.
D. E. Keyes, A. Sameh, and V. Venkatakrishnan, eds.,
Parallel Numerical Algorithms,
Kluwer Academic Publishers, Boston, 1997.
A. E. Koniges, ed.
Industrial Strength Parallel Computing,
Morgan Kaufmann, San Francisco, 2000.
E. J. Kontoghiorghes,
Parallel Algorithms for Linear Models: Numerical Methods and Estimation
Problems,
Kluwer Academic Publishers, Boston, 2000.
E. J. Kontoghiorghes, editor,
Handbook of Parallel Computing and Statistics
Chapman & Hall/CRC, Boca Raton, FL, 2006.
J. M. Ortega and R. G. Voigt,
Solution of Partial Differential Equations on Vector and Parallel
Computers,
SIAM, Philadelphia, 1985.
W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery,
Numerical Recipes in Fortran 90,
Cambridge University Press, New York, 1996.
A. Quarteroni and A. Valli,
Domain Decomposition Methods for Partial Differential Equations,
Oxford University Press, New York, 1999.
U. Schendel,
Introduction to Numerical Methods for Parallel Computers,
John Wiley & Sons, New York, 1984.
L. R. Scott, T. W. Clark, and B. Bagheri,
Scientific Parallel Computing,
Princeton University Press, Princeton, NJ, 2005.
R. W. Shonkwiler and L. Lefton,
An Introduction to Parallel and Vector Scientific Computing,
Cambridge University Press, New York, 2006.
B. F. Smith, P. E. Bjorstad, and W. D. Gropp,
Domain Decomposition: Parallel Multilevel Methods for Elliptic
Partial Differential Equations,
Cambridge University Press, New York, 1996.
E. F. Van de Velde,
Concurrent Scientific Computing,
Springer, New York, 1994.
R. E. White,
Computational Mathematics: Models, Methods, and Analysis
with MATLAB and MPI,
Chapman & Hall, New York, 2004.
Parallel Matrix Computations
P. Arbenz, M. Paprzycki, A. H. Sameh, and V. Sarin, eds.,
High Performance Algorithms for Structured Matrix Problems,
Nova Science Publishers, Commack, NY, 1999.
J. W. Demmel, M. T. Heath, and H. A. van der Vorst,
“Parallel Numerical Linear Algebra,”
Acta Numerica, 2 (1993), pp. 111-197.
Available online
J. J. Dongarra, I. S. Duff, D. C. Sorenson, and H. A. van der Vorst,
Numerical Linear Algebra for High-Performance Computers,
SIAM, Philadelphia, 1998.
K. A. Gallivan, M. T. Heath, E. Ng, J. M. Ortega, B. W. Peyton,
R. J. Plemmons, C. H. Romine, A. H. Sameh, and R. G. Voigt,
Parallel Algorithms for Matrix Computations,
SIAM, Philadelphia, 1990.
G. H. Golub and C. F. Van Loan,
Matrix Computations, 3rd ed.,
Johns Hopkins University Press, Baltimore, 1996.
J. J. Modi,
Parallel Algorithms and Matrix Computation,
Oxford University Press, New York, 1988.
C. Murthy, K. Murthy, and S. Aluru,
New Parallel Algorithms for Direct Solution of Linear Equations,
John Wiley & Sons, New York, 2001.
J. M. Ortega,
Introduction to Parallel and Vector Solution of Linear Systems,
Plenum Press, New York, 1988.
Y. Robert,
The Impact of Vector and Parallel Architectures on the Gaussian
Elimination Algorithm,
John Wiley & Sons, New York, 1990.
