COE 420 Parallel Computing

جودة المقرر بشكل عام: فيه صعوبة خصوصا مع الدكتور مايز لأنه يعامل الطلاب كباحثين


المواضيع التي يغطيها المقرر: المقرر طويل

كود:

[LEFT]
1.[INTRODUCTION] The Need and Feasibility of Parallel Computing, Technology Trends, Microprocessor Performance Attributes, Goal of Parallel Computing. Computing Elements, Programming Models, Flynn's Classification, Multiprocessors Vs. Multicomputers. Current Trends In Parallel Architectures, Communication Architecture.

2.[CONVERGENCE] Parallel Architectures Convergence: Communication Architecture, Communication Abstraction. Naming, Operations, Ordering, Replication. Communication Cost Model.

3.[//ISSUES] Parallel Programs: Conditions of Parallelism. Asymptotic Notations for Algorithm Analysis, PRAM. Levels of Parallelism, Hardware Vs. Software Concurrency. Data Vs. Functional Parallelism. Amdahl’s Law, DOP, Concurrency Profile. Steps in Creating Parallel Programs: Decomposition, Assignment, Orchestration, Mapping.

4.[EXAMPLE] Parallelization of An Example Program: Ocean simulation Iterative equation solver

5.[//ISSUES] Cluster Computing: Origins, Broad Issues in Heterogeneous Computing (HC). Message-Passing Programming. Overview of Message Passing Interface 

6.[STEPS] Considerations in Parallel Program Creation Steps for Performance

7.[TEKS] Basic Parallel Programming Techniques and Examples. Massively Parallel Computations: Pixel-based Image Processing. Divide-and-conquer Problem Partitioning: Parallel Bucket Sort, Numerical Integration, Gravitational N-Body Problem. Pipelined Computations: Addition, Insertion Sort, Solving Upper-triangular System of Linear Equations. Synchronous Iteration: Barriers, Iterative Solution of Linear Equations. Dynamic Load Balancing: Centralized, Distributed, Moore's Shortest Path Algorithim

8.[STATIC//DYNAMIC] Network Properties and Requirements For Parallel Processing. Static Point-to-point Connection Network Topologies. Network Embeddings. Dynamic Connection Networks

9.[SKIPPED] Parallel System Performance: Evaluation & Scalability. Workload Selection. Parallel Performance Metrics Revisited. . Application/Workload Scaling Models of Parallel Computers. Parallel System Scalability

10.[COHERNCE] The Cache Coherence Problem in Shared Memory Multiprocessors. Cache Coherence Approaches. Snoopy Bus-Snooping Cache Coherence Protocols: Write-invalidate: MSI, MESI, Write-Update: Dragon

11.[SKIPPED] Cache Coherence in Scalable Distributed Memory Machines: Hierarchical Snooping, Directory-based cache coherence.[/LEFT]

الكتاب المستخدم للمقرر: سلايدات

الأسئلة والأمثلة المستخدمة في المقرر: ليست كثيرة فتحتاج تبحث بنفسك

مدى فائدته في الناحية التطبيقية: تحتاجه في مجال البحث بشكل خاص وفي مجال تطوير برمجيات مسرعة على مختلف الأنظمة Shared Memory, Message Passing, Data Parallel

مصادر:
COE 502 Parallel Processing Architectures
http://faculty.kfupm.edu.sa/COE/mayez/Teaching.html