lOMoARcPSD|37802648
TABLE OF CONTENTS
Ex.No. Date Title of the Experiments Page No. Marks Signature
Write a simple Program to demonstrate
1 an OpenMP Fork-Join Parallelism
Create a program that computes a simple
matrix-vector multiplication b=Ax,
2
either in C/C++. Use OpenMP directives
to make it run in parallel.
Create a program that computes the sum
of all the elements in an array A (C/C+
+) or a program that finds the largest
3
number in an array A. Use OpenMP
directives to make it run in
parallel
Write a simple Program demonstrating
4 Message-Passing logic using OpenMP.
Implement the All-Pairs Shortest-Path
5 Problem (Floyd's Algorithm) Using
OpenMP
Implement a program Parallel Random
6 Number Generators using Monte Carlo
Methods in OpenMP
Write a Program to demonstrate MPI-
7 broadcast-and-collective-communication
in C.
Write a Program to demonstrate MPI-
8 scatter-gather-and-all gather in C.
Write a Program to demonstrate MPI-
9 send-and-receive in C.
Write a Program to demonstrate by
10 performing-parallel-rank-with-MPI in C
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
MULTICORE ARCHITECTURE AND PROGRAMMING
1. Write a simple Program to demonstrate an OpenMP Fork-Join Parallelism.
AIM:
To write a simple program for demonstration of an OpenMP Fork-JoinParallelism.
ALGORITHM:
Step1: Start
Step 2: Create a program that computes a simple matrix vector
multiplication.
Step 3: Input the values for the matrix. Step 4:
Calculate the multiplicative value.Step 5: Output
the value.
Step 6: Stop
PROGRAM:
#include<stdio.h>
#include <omp.h> int
main(void)
{
printf("Before: total thread number is %d\n", omp_get_num_threads());
#pragmaomp parallel
{
printf("Thread id is %d\n",omp_get_thread_num());
}
printf("After: total thread number is %d\n", omp_get_num_threads());return 0;
}
OUTPUT:
Input: mat1[3][2] = { {1, 1}, {2, 2}, {3, 3} }
mat2[2][3] = { {1, 1, 1}, {2, 2, 2} }
Output: result[3][3] = { {3, 3, 3}, {6, 6, 6}, {9, 9, 9} }
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
Result:
Thus the program has been executed successfully.
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
2. Create a program that computes a simple matrix-vector multiplication b=Ax,either
inC/C++. Use OpenMP directives to make it run in parallel.
AIM:
To create a program that computes a simple matrix-vector multiplicationb=Ax, either
in C/C++. Use OpenMP directives to make it run in parallel.
ALGORITHM:
Step 1: Start
Step 2: Creation of program to compute b=AxStep 3:
Get the input of two matrices
Step 4: Multiply the given matrices Step
5: Output the resultant matrix Step 6:
Stop
PROGRAM:
#include <stdio.h>
#include <omp.h>
int main() {
float A[2][2] = {{1,2},{3,4}};
float b[] = {8,10};
float c[2];
int i,j;
// computes A*b #pragmaomp
parallel forfor (i=0; i<2; i++) {
c[i]=0;
for (j=0;j<2;j++) {
c[i]=c[i]+A[i][j]*b[j];
}
}
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
// prints result for
(i=0; i<2; i++) {
printf("c[%i]=%f \n",i,c[i]);
}
return 0;
}
OUTPUT:
Input: mat1[3][2] = { {1, 1}, {2, 2}, {3, 3} }
mat2[2][3] = { {1, 1, 1}, {2, 2, 2} }
Output: result[3][3] = { {3, 3, 3}, {6, 6, 6}, {9, 9, 9} }
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
Result:
Thus the program has been executed successfully.
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
3. Create a program that computes the sum of all the elements in an array A (C/C++) or a
program that finds the largest number in an array A. Use OpenMPdirectives to make it run
in parallel.
AIM:
To create a program that computes the sum of all the elements in an
array.
ALGORITHM:
Step 1: Start
Step 2: Creation of a program for computing the sum of all the elementsan array.
Step 3: Input the array elements.Step
4: Process of addition.
Step 5: Print the resultant sum.Step
6: Stop.
PROGRAM:
#include<omp.h> #include
<bits/stdc++.h>
usingnamespace std;
intmain(){
vector<int>arr{3,1,2,5,4,0};
queue<int> data;
intarr_sum=accumulate(arr.begin(),arr.end(),0);
intarr_size=arr.size();
intnew_data_size, x, y;
for(inti=0;i<arr_size;i++){
data.push(arr[i]);
}
omp_set_num_threads(ceil(arr_size/2));
#pragmaomp parallel
{
#pragmaomp critical
{
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
new_data_size=data.size();
for(int j=1; j<new_data_size; j=j*2){x
=data.front();
data.pop();
y =data.front();
data.pop();
data.push(x+y);
}
}
cout<<"Array prefix sum:"<<data.front()<<endl;
if(arr_sum==data.front())
{cout<<"Correct sum"<<endl;
}else{ cout<<"Incorrect Answer"<<endl;
}
return0;
}
OUTPUT:
Array of elements: 1 5 7 9 11
Sum: 33
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
Result:
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
Thus the program has been executed successfully.
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
4. Write a simple Program demonstrating Message-Passing logic usingOpenMP.
AIM:
To write a simple program demonstrating Message-Passing logic usingOpenMP.
ALGORITHM:
Step 1: Start
Step 2: Creation of simple program demonstratingmessage-
passing logic.
Step 3: The message creation for transformation across web.Step 4:
Input the message.
Step 5: Process and print the result.Step 6:
Stop
PROGRAM:
#include <omp.h>
#include <stdio.h>
#include <stdlib.h>
int main(int argc, char* argv[])
{
// Beginning of parallel region
#pragmaomp parallel
{
printf("Hello World... from thread = %d\n",
omp_get_thread_num());
}
// Ending of parallel region
}
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
OUTPUT:
Hello World
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
Result:
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
Thus the program has been executed successfully.
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
5. Implement the All-Pairs Shortest-Path Problem (Floyd's Algorithm) UsingOpenMP.
AIM:
To write a program implementing All-Pairs Shortest-Path Problem
(Flyod’s Algorithm) using OpenMP.
ALGORITHM:
Step 1: Start
Step 2: Get the input of all pairs of co-ordinates
Step 3: Process the path and sort out the shortest pathStep 4:
Print the resultant path
Step 5: Stop
PROGRAM:
#include <stdio.h>
#include <math.h>
#include <stdlib.h>
#include <time.h>
#include <omp.h>
//Define the number of nodes in the graph#define N
1200
//Define minimum function that will be used later on to calcualte minimumvalues between
two numbers
#ifndef min
#define min(a,b) (((a) < (b)) ? (a) : (b))#endif
//Define matrix of size N * N to store distances between nodes
//Initialize all distances to zero int
distance_matrix[N][N] = {0};
int main(int argc, char *argv[])
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
{
int nthreads;
int src, dst, middle;
//Initialize the graph with random distancesfor (src =
0; src< N; src++)
{
for (dst = 0; dst< N; dst++)
{
// Distance from node to same node is 0. So, skipping these elementsif(src != dst) {
//Distances are generated to be between 0 and 19
distance_matrix[src][dst] = rand() % 20;
}
}
}
//Define time variable to record start time for execution of programdouble
start_time = omp_get_wtime();
for (middle = 0; middle < N; middle++)
{
int * dm=distance_matrix[middle];for (src
= 0; src< N; src++)
{
int * ds=distance_matrix[src];for
(dst = 0; dst< N; dst++)
{
ds[dst]=min(ds[dst],ds[middle]+dm[dst]);
}
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
}
}
double time = omp_get_wtime() - start_time; printf("Total time for
sequential (in sec):%.2f\n", time);
for(nthreads=1; nthreads<= 10; nthreads++) {
//Define different number of threads
omp_set_num_threads(nthreads);
// Define iterator to iterate over distance matrix
//Define time variable to record start time for execution of programdouble
start_time = omp_get_wtime();
/* Taking a node as mediator
check if indirect distance between source and distance via mediatoris less than
direct distance between them */
#pragmaomp parallel shared(distance_matrix)for
(middle = 0; middle < N; middle++)
{
int * dm=distance_matrix[middle];
#pragma omp parallel for private(src, dst) schedule(dynamic)for (src = 0;
src< N; src++)
{
int * ds=distance_matrix[src];for
(dst = 0; dst< N; dst++)
{
ds[dst]=min(ds[dst],ds[middle]+dm[dst]);
}
}
}
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
double time = omp_get_wtime() - start_time;
printf("Total time for thread %d (in sec):%.2f\n", nthreads, time);
}
return 0;
Input: The cost matrix of the graph.
036∞∞∞∞
3021∞∞∞
620142∞
∞1102∞4
∞∞42021
∞∞2∞201
∞∞∞4110
Output:
Matrix of all pair shortest
path.0 3 4 5 6 7 7
3021344
4201323
5110233
6332021
7423201
7433110
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
Result:
Thus the program has been executed successfully.
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
6. Implement a program Parallel Random Number Generators using MonteCarlo
Methods in OpenMP.
AIM:
To implement a program Parallel Random Number Generators usingMonte
Carlo Methods in OpenMP.
ALGORITHM:
Step 1: Start
Step 2: Get the input of random number
Step 3: Process it using Monte Carlo Methods in OpenMPStep 4:
Get the output of estimated value.
Step 5: Stop
PROGRAM:
#include <omp.h>
#include <stdio.h>
#include <stdlib.h>
#include <time.h>
// Function to find estimated
// value of PI using Monte
// Carlo algorithm
void monteCarlo(int N, int K)
{
// Stores X and Y coordinates
// of a random point
double x, y;
// Stores distance of a random
// point from origin
double d;
// Stores number of points
// lying inside circleint
pCircle = 0;
// Stores number of points
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
// lying inside squareint
pSquare = 0;
int i = 0;
// Parallel calculation of random
// points lying inside a circle
#pragma omp parallel firstprivate(x, y, d, i) reduction(+ : pCircle, pSquare)
num_threads(K)
{
// Initializes random points
// with a seed
srand48((int)time(NULL));
for (i = 0; i< N; i++) {
// Finds random X co-ordinatex =
(double)drand48();
// Finds random X co-ordinatey =
(double)drand48();
// Finds the square of distance
// of point (x, y) from origind =
((x * x) + (y * y));
// If d is less than or
// equal to 1if
(d <= 1) {
// Increment pCircle by 1
pCircle++;
}
// Increment pSquare by 1
pSquare++;
}
}
// Stores the estimated value of PI
double pi = 4.0 * ((double)pCircle / (double)(pSquare));
// Prints the value in pi
printf("Final Estimation of Pi = %f\n", pi);
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
// Driver Codeint
main()
{
// Input
int N = 100000;
int K = 8;
// Function call
monteCarlo(N, K);
OUTPUT:
Final Estimation of Pi =3.1320757
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
Result:
Thus the program has been executed successfully
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
7. Write a Program to demonstrate MPI-broadcast-and-collective-
communication in C.
AIM:
To write a program to demonstrate MPI-broadcast-and-collective
communication in C.
ALGORITHM:
Step 1: Start
Step 2: Get the values for broadcasting.
Step 3: Process using MPI-broadcast-and-collective communicationStep 4:
Print the output
Step 5: Stop
PROGRAM:
#include<mpi.h>
#include<stdio.h>
intmain(intargc, char** argv) {int
rank;
intbuf;
MPI_Status status;
MPI_Init(&argc, &argv);
MPI_Comm_rank(MPI_COMM_WORLD, &rank);
if(rank == 0) {
buf = 777;
MPI_Bcast(&buf, 1, MPI_INT, 0, MPI_COMM_WORLD);
}
else {
MPI_Recv(&buf, 1, MPI_INT, 0, 0, MPI_COMM_WORLD, &status);
printf("rank %d receiving received %d\n", rank, buf);
}
MPI_Finalize();
return0;
}
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
OUTPUT:
>>> ./run.py my_bcast
mpirun -n 2
./my_bcast
Process 0
2 broadcasting
received datadata
100 100
from root
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
Result:
Thus the program has been executed successfully
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
8. Write a Program to demonstrate MPI-scatter-gather-and-all gather in C
AIM:
To write a program to demonstrate MPI-scatter-gather-and-all gather.
ALGORITHM:
Step 1: Start
Step 2: Get an array of random numbers as input. Step 3:
Compute the average of array of numbers. Step 4: Process
and print the result.
Step 5: Stop
PROGRAM:
#include <stdio.h>
#include <stdlib.h>
#include <time.h>
#include <mpi.h>
#include <assert.h>
// Creates an array of random numbers. Each number has a value from 0 - 1float
*create_rand_nums(int num_elements) {
float *rand_nums = (float *)malloc(sizeof(float) * num_elements);
assert(rand_nums != NULL);
int i;
for (i = 0; i<num_elements; i++) { rand_nums[i] =
(rand() / (float)RAND_MAX);
}
return rand_nums;
}
// Computes the average of an array of numbers float
compute_avg(float *array, int num_elements) {float sum = 0.f;
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
int i;
for (i = 0; i<num_elements; i++) {sum
+= array[i];
}
return sum / num_elements;
}
int main(int argc, char** argv) {if
(argc != 2) {
fprintf(stderr, "Usage: avgnum_elements_per_proc\n");exit(1);
}
int num_elements_per_proc = atoi(argv[1]);
// Seed the random number generator to get different results each time
srand(time(NULL));
MPI_Init(NULL, NULL);
int world_rank; MPI_Comm_rank(MPI_COMM_WORLD,
&world_rank);int world_size;
MPI_Comm_size(MPI_COMM_WORLD, &world_size);
// Create a random array of elements on the root process. Its total
// size will be the number of elements per process times the number
// of processes
float *rand_nums = NULL;if
(world_rank == 0) {
rand_nums = create_rand_nums(num_elements_per_proc * world_size);
}
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
// For each process, create a buffer that will hold a subset of the entire
// array
float *sub_rand_nums = (float *)malloc(sizeof(float) *
num_elements_per_proc);
assert(sub_rand_nums != NULL);
// Scatter the random numbers from the root process to all processes in
// the MPI world
MPI_Scatter(rand_nums, num_elements_per_proc, MPI_FLOAT,
sub_rand_nums,
num_elements_per_proc, MPI_FLOAT, 0, MPI_COMM_WORLD);
// Compute the average of your subset
float sub_avg = compute_avg(sub_rand_nums, num_elements_per_proc);
// Gather all partial averages down to all the processes float *sub_avgs
= (float *)malloc(sizeof(float) * world_size);assert(sub_avgs != NULL);
MPI_Allgather(&sub_avg, 1, MPI_FLOAT, sub_avgs, 1, MPI_FLOAT,
MPI_COMM_WORLD);
// Now that we have all of the partial averages, compute the
// total average of all numbers. Since we are assuming each processcomputed
// an average across an equal amount of elements, this computation will
// produce the correct answer.
float avg = compute_avg(sub_avgs, world_size);
printf("Avg of all elements from proc %d is %f\n", world_rank, avg);
// Clean up
if (world_rank == 0) {
free(rand_nums);
}
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
free(sub_avgs);
free(sub_rand_nums);
MPI_Barrier(MPI_COMM_WORLD);
MPI_Finalize();
}
OUTPUT:
>>> ./run.py avg
/home/kendall/bin/mpirun -n 4 ./avg 100Avg of
all elements is 0.478699
Avg computed across original data is 0.478699
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
Result:
Thus the program has been executed successfully
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
9.Write a Program to demonstrate MPI-send-and-receive in C.
AIM:
To write a program to demonstrate MPI-send-and-receive in C.
ALGORITHM:
Step 1: Start
Step 2: Create a program to demonstrate MPI-send-and-receive.Step 3:
Input the message to send and receive.
Step 4: Process the message and print the output message.Step 5: Stop
PROGRAM:
intmain(intargc, char ** argv)
{
int * array;
int tag=1; int
size; int
rank;
MPI_Status status;
MPI_Init (&argc,&argv);
MPI_Comm_size (MPI_COMM_WORLD,&size);
MPI_Comm_rank (MPI_COMM_WORLD,&rank);
if (rank == 0)
{
array = malloc (10 * sizeof(int)); // Array of 10 elementsif(!array)
// error checking
{
MPI_Abort (MPI_COMM_WORLD,1);
}
MPI_Send(&array,10,MPI_INT,1,tag,MPI_COMM_WORLD);
}
if (rank == 1)
{
MPI_Recv (&array,10,MPI_INT,0,tag,MPI_COMM_WORLD,&status);
// more code here
}
MPI_Finalize();
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
OUTPUT:
>>> ./run.py send_recv
mpirun –n/2 ./send_recv
Process 1 received number -1 from process 0
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
Result:
Thus the program has been executed successfully.
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
10. Write a Program to demonstrate by performing-parallel-rank-with-MPI in C
AIM:
To write a program for demonstrating performing-parallel-rank-with-MPI in C.
ALGORITHM:
Step 1: Start
Step 2:
PROGRAM:
#include <stdio.h> #include
<stdlib.h> #include <mpi.h>
#include "tmpi_rank.h"
#include <time.h>
int main(int argc, char** argv) {
MPI_Init(NULL, NULL);
int world_rank; MPI_Comm_rank(MPI_COMM_WORLD,
&world_rank);int world_size;
MPI_Comm_size(MPI_COMM_WORLD, &world_size);
// Seed the random number generator to get different results each time
srand(time(NULL) * world_rank);
float rand_num = rand() / (float)RAND_MAX;
int rank;
TMPI_Rank(&rand_num, &rank, MPI_FLOAT, MPI_COMM_WORLD); printf("Rank for %f
on process %d - %d\n", rand_num, world_rank, rank);
MPI_Barrier(MPI_COMM_WORLD);
MPI_Finalize();
}
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
OUTPUT:
>>> ./run.py random_rank Mpirun –n
4 ./random_rank 100
Rank for 0.242578 on process 0 – 0
Rank for 0.894732 on process 1 – 3
Rank for 0.789463 on process 2 – 2
Rank for 0.684195 on process 3 – 1
Downloaded by Soundharya Subramanian ([email protected])
lOMoARcPSD|37802648
Result:
Thus the program has been executed successfully.
Downloaded by Soundharya Subramanian ([email protected])
