Parallel Programming

Learning Outcomes: 
After learning the course the students should be able to:
• Describe different types of parallelism, their principles and structures
• Comprehend the principles, techniques, and practices relevant to the design and implementation of parallel computing systems
• Construct parallel algorithms for distributed and shared memory parallel systems
Syllabus: 
Unit NoTopics
1

Introduction

Fundamentals and evolution of computer architectures, Flynn’s classification, parallel and vector computers, system attributes affecting performance, Multiprocessors and Multicomputers : shared memory-UMA,NUMA,COMA, Distributed memory, MIMD and SIMD supercomputers , PRAM introduction and basic models : CRCW, CRER, ERCW,EREW.   

2

Working into parallel

Conditions of parallelism, program partitioning and scheduling, flow mechanisms, System interconnection techniques : Static – Ring ,Mesh , Dynaic

3

Principles of scalable performance

Performance matrices and measures : Degree of parallelism and speedup , Parallel programming applications, Speedup performance and scalability

4

Hardware Technologies

Advance processors technology : superscalar and vector processors, Memory : Hierarchy technology , virtual memory , cache and shared memory organization, Pipelining : Linear and Non-linear pipeline processors, Instruction , arithmetic, superscalar pipeline design 

5

Parallel and Scalable Architectures

Multiprocessors and Computers: Cache coherence Mechanisms, Message passing mechanisms, Vector processing principles, SIMD computer organizations, Multi-threaded architecture

6

Parallel Programming Development Environments and Tools

Parallel programming Models, Languages and Compilers, 

Text Books: 
Name : 
Computer architecture and parallel processing
Author: 
by Kai Hwang
Name : 
Parallel Computers – Architecture and Programming
Author: 
by V. Rajaraman
C. Siva Ram Murthy
Reference Books: 
Name: 
Introduction to Parallel Programming
Author: 
by Steven Braver
Name: 
Parallel Programming in C with MPI and OpenMP
Author: 
Michael J. Quinn
Publication: 
Tata McGraw-Hill
Syllabus PDF: 
AttachmentSize
PDF icon Sem 6 CBA-Parallel Programming.pdf191.43 KB
branch: 
CBA
Course: 
2018
Stream: 
B.Tech