Singapore University of Social Sciences

Introduction to Parallel Computing

Introduction to Parallel Computing (ICT323)

Applications Open: 01 May 2023

Applications Close: 15 June 2023

Next Available Intake: July 2023

Course Types: Modular Undergraduate Course

Language: English

Duration: 6 months

Fees: $1514 View More Details on Fees

Area of Interest: Science and Technology

Schemes: Alumni Continuing Education (ACE)

Funding: To be confirmed

School/Department: School of Science and Technology


ICT323 introduces parallel computing as cost effective method for the fast solutions of computationally large and data-intensive problems. It covers basic concepts of parallel computing, parallel platforms and communication methods, shared and distributed memory architecture, GPU and CUDA programming, and examples of parallel computing models. Students will learn to leverage hardware architectures and standard tools like OpenMP and MPI to achieve parallelisation and high performance computing. The experiment labs will guide students use tools to simulate parallel programs and acquire hands-on skills.

Level: 3
Credit Units: 5
Presentation Pattern: EVERY JAN


  • Why Parallel Computing?
  • Applications of Parallel Computing
  • Parallel System Architecture
  • Communication for Parallel Computing
  • Principles of Message-Passing Programming
  • Message Passing Interface (MPI)
  • Multithreading and Shared Memory Programming
  • OpenMP Programming Model
  • GPU architecture and concepts
  • Introduction to CUDA Programming Model
  • Grid Computing and Cloud Computing
  • Parallel Computing with MapReduce

Learning Outcome

  • Describe the concepts and importance of parallel computing
  • Illustrate shared and distributed memory architectures
  • Compare different parallel programming models
  • Differentiate CPU and GPU
  • Practice parallel computing with MPI
  • Experiment OpenMP for parallel computing
Back to top
Back to top