Objectives

In this session, you will learn to:

Identify the algorithms that can be used to sort data Sort data by using bubble sort Sort data by using selection sort Sort data by using insertion sort Sort data by using shell sort

Sorting Data

Suppose, you have to invite your friends and relatives for your birthday party. For this, you need to give them a call. You are looking for the telephone number of a friend named Steve in a telephone directory with 10,000 records. However, the records are stored randomly and not in any particular order.

Sorting Data (Contd.)

To search for the telephone number of your friend in such a directory, you would need to scan each entry in the directory in a sequential manner. This would be very time consuming. How can you solve this problem?

Sorting Data (Contd.)

A simple solution to save time, and search records efficiently is sorting. Sorting is the process of arranging data in some pre-defined order or sequence. The order can be either ascending or descending. If the data is ordered, you can directly go to the section that stores the names starting with S, thereby reducing the number of records to be traversed.

Selecting a Sorting Algorithm

Sorting is implemented in a program by using an algorithm. Some sorting algorithms are:

Bubble sort Selection sort Insertion sort Merge sort Quick sort Radix sort Heap sort To select an appropriate algorithm, you need to consider the following: Execution time Storage space Programming effort

Sorting Data by Using Bubble Sort

Bubble sort algorithm:

Is one of the simplest sorting algorithms Works by repeatedly scanning through the list, comparing adjacent elements, and swapping them if they are in the wrong order

Implementing Bubble Sort Algorithm

To understand the implementation of bubble sort algorithm, consider an unsorted list of numbers stored in an array.

0
arr

1 2

2 6

3 7

4 3

Implementing Bubble Sort Algorithm (Contd.)

Let us sort this unsorted list.

0
arr

1 2

2 6

3 7

4 3

Implementing Bubble Sort Algorithm (Contd.)

Pass 1 n=5 Compare the element stored at index 0 with the element stored at index 1.

0
arr

1 2

2 6

3 7

4 3

Implementing Bubble Sort Algorithm (Contd.)

Pass 1 n=5 Swap the values if they are not in the correct order.

Swap 0
arr

1 5 2

2 6

3 7

4 3

2 5

Implementing Bubble Sort Algorithm (Contd.)

Pass 1 n=5 Compare the element stored at index 1 with the element stored at index 2 and swap the values if the value at index 1 is greater than the value at index 2.
No Change 0
arr

1 5

2 6

3 7

4 3

Implementing Bubble Sort Algorithm (Contd.)

Pass 1 n=5 Compare the element stored at index 2 with the element stored at index 3 and swap the values if the value at index 2 is greater than the value at index 3.
No Change 0
arr

1 5

2 6

3 7

4 3

Implementing Bubble Sort Algorithm (Contd.)

Pass 1 n=5 Compare the element stored at index 3 with the element stored at index 4 and swap the values if the value at index 3 is greater than the value at index 4.
Swap 0
arr

1 5

2 6

3 3 7

4 7 3

Implementing Bubble Sort Algorithm (Contd.)

Pass 1 n=5 Compare the element stored at index 3 with the element stored at index 4 and swap the values if the value at index 3 is greater than the value at index 4.
0
arr

1 5

2 6

3 3

Largest element is placed at its correct position after Pass 1

Implementing Bubble Sort Algorithm (Contd.)

Pass 2 n=5 Compare the element stored at index 0 with the element stored at index 1 and swap the values if the value at index 0 is greater than the value at index 1.
No Change 0
arr

1 5

2 6

3 3

Implementing Bubble Sort Algorithm (Contd.)

Pass 2 n=5 Compare the element stored at index 1 with the element stored at index 2 and swap the values if the value at index 1 is greater than the value at index 2.
No Change 0
arr

1 5

2 6

3 3

Implementing Bubble Sort Algorithm (Contd.)

Pass 2 n=5 Compare the element stored at index 2 with the element stored at index 3 and swap the values if the value at index 2 is greater than the value at index 3.
Swap 0
arr

1 5

2 3 6

3 6 3

Implementing Bubble Sort Algorithm (Contd.)

Pass 2 n=5 Compare the element stored at index 2 with the element stored at index 3 and swap the values if the value at index 2 is greater than the value at index 3.
0
arr

1 5

2 3

Second largest element is placed at its correct position after Pass 2

Implementing Bubble Sort Algorithm (Contd.)

Pass 3 n=5 Compare the element stored at index 0 with the element stored at index 1 and swap the values if the value at index 0 is greater than the value at index 1.
No Change 0
arr

1 5

2 3

Implementing Bubble Sort Algorithm (Contd.)

Pass 3 n=5 Compare the element stored at index 1 with the element stored at index 2 and swap the values if the value at index 1 is greater than the value at index 2.
Swap 0
arr

1 5 3

2 5 3

Implementing Bubble Sort Algorithm (Contd.)

Pass 3 n=5 Compare the element stored at index 2 with the element stored at index 3 and swap the values if the value at index 2 is greater than the value at index 3.
0
arr

1 3

Third largest element is placed at its correct position after Pass 3

Implementing Bubble Sort Algorithm (Contd.)

Pass 4 n=5 Compare the element stored at index 0 with the element stored at index 1 and swap the values if the value at index 0 is greater than the value at index 1.
No Change 0
arr

1 3

Implementing Bubble Sort Algorithm (Contd.)

Pass 4 n=5 Compare the element stored at index 0 with the element stored at index 1 and swap the values if the value at index 0 is greater than the value at index 1.
0
arr

3 5

Fourth largest element is placed at its correct position after Pass 4

Implementing Bubble Sort Algorithm (Contd.)

Pass 4 n=5 At the end of Pass 4, the elements are sorted.

0
arr

3 5

Implementing Bubble Sort Algorithm (Contd.)

Write an algorithm to implement bubble sort. Algorithm for bubble sort:

1. Set pass = 1. 2. Repeat step 3 varying j from 0 to n 1 pass. 3. If the element at index j is greater than the element at index j + 1, swap the two elements. 4. Increment pass by 1. 5. If pass <= n 1, go to step 2.

void bubble_sort(int array[], int size) { int temp, pass, i; for (pass = 0; pass < size-1; pass++) for (i = 0; i < size-pass-1; i++) if (array[i] > array[i+1]) { temp = array[i]; array[i] = array[i+1]; array[i+1] = temp; } }

void main(void) { int array[30], i,size; clrscr(); printf("enter the size of the Array:\n"); scanf("%d",&size); printf("Enter the values::\n"); for (i = 0; i < size; i++) scanf("%d",&array[i]); printf("\n Unsorted list is as follows\n"); for (i = 0; i < size; i++) printf(" %d", array[i]); bubble_sort(array, size); printf("\n Sorted list is as follows\n"); for (i = 0; i < size; i++) printf("%d ", array[i]); getch(); }

Determining the Efficiency of Bubble Sort Algorithm

The efficiency of a sorting algorithm is measured in terms of number of comparisons. In bubble sort, there are n 1 comparisons in Pass 1, n 2 comparisons in Pass 2, and so on. Total number of comparisons = (n 1) + (n 2) + (n 3) + + 3 + 2 + 1 = n(n 1)/2. n(n 1)/2 is of O(n2) order. Therefore, the bubble sort algorithm is of the order O(n2).

Just a minute

What is the order of growth of the bubble sort algorithm?

Answer:
The bubble sort algorithm has a quadratic order of growth.

Just a minute

While implementing bubble sort algorithm, how many comparisons will be performed in Pass 1.

Answer:
n 1 comparisons

Sorting Data by Using Selection Sort

Selection sort algorithm:

Has a quadratic order of growth and is therefore suitable for sorting small lists only Scans through the list iteratively, selects one item in each scan, and moves the item to its correct position in the list

Implementing Selection Sort Algorithm

To understand the implementation of selection sort algorithm, consider an unsorted list of numbers stored in an array.

0
arr

105 120 10

200 20

Implementing Selection Sort Algorithm (Contd.)

Let us sort this unsorted list.

0
arr

105 120 10

200 20

Implementing Selection Sort Algorithm (Contd.)

Pass 1 n=5 Search the minimum value in the array, arr[0] to arr[n 1].

0
arr

105 120 10

200 20

min

Implementing Selection Sort Algorithm (Contd.)

Pass 1 n=5 Search the minimum value in the array, arr[0] to arr[n 1]. Swap the minimum value with the value at index 0.
Swap 0
arr

105 120 105 200 20 10 10

min

Implementing Selection Sort Algorithm (Contd.)

Pass 1 n=5 Search the minimum value in the array, arr[0] to arr[n 1]. Swap the minimum value with the value at index 0.

0
arr

10 120 105 200 20

The smallest value is placed at its correct location after Pass 1

Implementing Selection Sort Algorithm (Contd.)

Pass 2 n=5 Search the minimum value in the array, arr[1] to arr[n 1]. Swap the minimum value with the value at index 1.
Swap 0
arr

10 120 105 200 120 20 20

min

Implementing Selection Sort Algorithm (Contd.)

Pass 2 n=5 Search the minimum value in the array, arr[1] to arr[n 1]. Swap the minimum value with the value at index 1.

0
arr

10 120 105 200 120 20 20

The second smallest value is placed at its correct location after Pass 2

Implementing Selection Sort Algorithm (Contd.)

Pass 3 n=5 Search the minimum value in the array, arr[2] to arr[n 1]. Swap the minimum value with the value at index 2.

0
arr

10 120 105 200 120 20 20

min

Implementing Selection Sort Algorithm (Contd.)

Pass 3 n=5 Search the minimum value in the array, arr[2] to arr[n 1]. Swap the minimum value with the value at index 2.

0
arr

10 120 105 200 120 20 20

min The third smallest value is placed at its correct location after Pass 3

Implementing Selection Sort Algorithm (Contd.)

Pass 4 n=5 Search the minimum value in the array, arr[3] to arr[n 1]. Swap the minimum value with the value at index 3.
Swap 0
arr

10 120 105 120 120 20 200 200 20

min

Implementing Selection Sort Algorithm (Contd.)

Pass 4 n=5 Search the minimum value in the array, arr[3] to arr[n 1]. Swap the minimum value with the value at index 3.

0
arr

10 120 105 120 200 20 200 20

The fourth smallest value is placed at its correct location after Pass 4

Implementing Selection Sort Algorithm (Contd.)

Pass 4 n=5 The list is now sorted.

0
arr

10 120 105 120 200 20 200 20

Implementing Selection Sort Algorithm (Contd.)

Write an algorithm to implement selection sort. Algorithm for selection sort:

1. Repeat steps 2 and 3 varying j from 0 to n 2 2. Find the minimum value in arr[j] to arr[n 1]:
a. Set min_index = j b. Repeat step c varying i from j + 1 to n 1 c. If arr[i] < arr[min_index]:
i. min_index = i

3. Swap arr[j] with arr[min_index]

void selection_sort(int array[], int size) { int temp, i, j,min_index; for (i = 0; i < size-1; i++) { min_index=i; for(j=i+1;j<size;j++) { if(array[j]<array[min_index]) min_index=j; } temp=array[i]; //swap(array[i],array[min_index]); array[i]=array[min_index]; array[min_index]=temp; } }

Determining the Efficiency of Selection Sort Algorithm In selection sort, there are n 1 comparisons during Pass 1 to find the smallest element, n 2 comparisons during Pass 2 to find the second smallest element, and so on. Total number of comparisons = (n 1) + (n 2) + (n 3) + + 3 + 2 + 1 = n(n 1)/2 n(n 1)/2 is of O(n2) order. Therefore, the selection sort algorithm is of the order O(n2).

Just a minute

Read the following statement and specify whether it is true or false:

The efficiency of selection sort algorithm is same as that of the bubble sort algorithm.

Answer:
True

Just a minute

How many comparisons are performed in the second pass of the selection sort algorithm?

Answer:
n2

Sorting Data by Using Insertion Sort

Insertion sort algorithm:

Has a quadratic order of growth and is therefore suitable for sorting small lists only Is much more efficient than bubble sort, and selection sort, if the list that needs to be sorted is nearly sorted

Implementing Insertion Sort Algorithm

To understand the implementation of insertion sort algorithm, consider an unsorted list of numbers stored in an array.

0
arr

3 10

4 20

70

80 30

Implementing Insertion Sort Algorithm (Contd.)

To sort this list by using the insertion sort algorithm:

You need to divide the list into two sublists, sorted and unsorted.

0
arr

3 10

4 20

70

80 30

Implementing Insertion Sort Algorithm (Contd.)

To sort this list by using the insertion sort algorithm:

You need to divide the list into two sublists, sorted and unsorted. Initially, the sorted list has the first element and the unsorted list has the remaining 4 elements. 0 70 1 2 3 10 4 20

80 30

Sorted List

Unsorted List

Implementing Insertion Sort Algorithm (Contd.)

Pass 1 Place the first element from the unsorted list at its correct position in the sorted list.

0 70

3 10

4 20

80 30

Sorted List

Unsorted List

Implementing Insertion Sort Algorithm (Contd.)

Pass 1 Place the first element from the unsorted list at its correct position in the sorted list.

0 70

1 80

2 30

10 20

Sorted List

Unsorted List

Implementing Insertion Sort Algorithm (Contd.)

Pass 2 Place the first element from the unsorted list at its correct position in the sorted list.

0 70

1 80

2 30

10 20

Sorted List

Unsorted List

Implementing Insertion Sort Algorithm (Contd.)

Pass 2 Place the first element from the unsorted list at its correct position in the sorted list.

30

70 80

10 20

Sorted List

Unsorted List

Implementing Insertion Sort Algorithm (Contd.)

Pass 3 Place the first element from the unsorted list at its correct position in the sorted list.

30

70 80

10 20

Sorted List

Unsorted List

Implementing Insertion Sort Algorithm (Contd.)

Pass 3 Place the first element from the unsorted list at its correct position in the sorted list.

1 30

4 20

10

70 80

Sorted List

Unsorted List

Implementing Insertion Sort Algorithm (Contd.)

Pass 4 Place the first element from the unsorted list at its correct position in the sorted list.

1 30

4 20

10

70 80

Sorted List

Unsorted List

Implementing Insertion Sort Algorithm (Contd.)

Pass 4 Place the first element from the unsorted list at its correct position in the sorted list.

0 10

3 70

4 80

20 30

Sorted List

Unsorted List

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

Let us now write an algorithm to implement insertion sort algorithm.

2. 3. 4.

0
arr

3 10

4 20
5.

70

80 30

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =1

2. 3. 4.

0
arr

3 10

4 20
5.

70

80 30

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =1

2. 3. 4.

0
arr

3 10

4 20
5.

70

80 30

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =1 temp = 80

2. 3. 4.

0
arr

3 10

4 20
5.

70

80 30

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =1 temp = 80

2. 3. 4.

0
arr

3 10

4 20
5.

70

80 30

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =1 temp = 80 arr[j] < temp

2. 3. 4.

0
arr

3 10

4 20
5.

70

80 30

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =1 temp = 80 arr[j] < temp

2. 3. 4.

0
arr

3 10

4 20
5.

70

80 30

Value temp is stored at its correct position in the sorted list

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =1

2. 3. 4.

0
arr

3 10

4 20
5.

70

80 30

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =2

2. 3. 4.

0
arr

3 10

4 20
5.

70

80 30

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =2

2. 3. 4.

0
arr

3 10

4 20
5.

70

80 30

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =2 temp = 30

2. 3. 4.

0
arr

3 10

4 20
5.

70

80 30

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =2 temp = 30

2. 3. 4.

0
arr

3 10

4 20
5.

70

80 30

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =2 temp = 30

2. 3. 4.

0
arr

3 10

4 20
5.

70

80 30

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =2 temp = 30

2. 3. 4.

0
arr

3 10

4 20
5.

70

80 30 80

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =2 temp = 30

2. 3. 4.

0
arr

2 80

3 10

4 20
5.

70

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =2 temp = 30

2. 3. 4.

0
arr

3 10

4 20
5.

70

70 80

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =2 temp = 30 j = 1

2. 3. 4.

0
arr

3 10

4 20
5.

70 80

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =2 temp = 30 j = 1

2. 3. 4.

0
arr

3 10

4 20
5.

30

70 80

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =2

2. 3. 4.

0
arr

3 10

4 20
5.

30

70 80

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =3

2. 3. 4.

0
arr

3 10

4 20
5.

30

70 80

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =3 temp = 10

2. 3. 4.

0
arr

3 10

4 20
5.

30

70 80

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =3 temp = 10

2. 3. 4.

0
arr

3 10

4 20
5.

30

70 80

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =3 temp = 10

2. 3. 4.

0
arr

3 10

4 20
5.

30

70 80

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =3 temp = 10

2. 3. 4.

0
arr

3 80 10

4 20
5.

30

70 80

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =3 temp = 10

2. 3. 4.

0
arr

1 70

3 80

4 20
5.

30

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =3 temp = 10

2. 3. 4.

0
arr

1 70

2 70

3 80

4 20
5.

30

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =3 temp = 10

2. 3. 4.

0
arr

2 70

3 80

4 20
5.

30

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =3 temp = 10

2. 3. 4.

0
arr

1 30

2 70

3 80

4 20
5.

30

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =3 temp = 10 j = 1

2. 3. 4.

0
arr

1 30

2 70

3 80

4 20
5.

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =3 temp = 10 j = 1

2. 3. 4.

0
arr

1 30

2 70

3 80

4 20
5.

10

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =3

2. 3. 4.

0
arr

1 30

2 70

3 80

4 20
5.

10

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =4

2. 3. 4.

0
arr

1 30

2 70

3 80

4 20
5.

10

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =4 temp = 20

2. 3. 4.

0
arr

1 30

2 70

3 80

4 20
5.

10

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =4 temp = 20

2. 3. 4.

0
arr

1 30

2 70

3 80

4 20
5.

10

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =4 temp = 20

2. 3. 4.

0
arr

1 30

2 70

3 80

4 20
5.

10

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =4 temp = 20

2. 3. 4.

0
arr

1 30

2 70

3 80

4 80 20
5.

10

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =4 temp = 20

2. 3. 4.

0
arr

1 30

2 70

4 80
5.

10

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =4 temp = 20

2. 3. 4.

0
arr

1 30

2 70

3 70

4 80
5.

10

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =4 temp = 20

2. 3. 4.

0
arr

1 30

3 70

4 80
5.

10

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =4 temp = 20

2. 3. 4.

0
arr

1 30

2 30

3 70

4 80
5.

10

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =4 temp = 20

2. 3. 4.

0
arr

2 30

3 70

4 80
5.

10

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =4 temp = 20

2. 3. 4.

0
arr

1 20

2 30

3 70

4 80
5.

10

Implementing Insertion Sort Algorithm (Contd.)

1. Repeat steps 2, 3, 4, and 5 varying i from 1 to n 1 Set temp = arr[i] Set j = i 1 Repeat until j becomes less than 0 or arr[j] becomes less than or equal to temp: a. Shift the value at index j to index j + 1 b. Decrement j by 1 Store temp at index j + 1

n=5 i =4

2. 3. 4.

0
arr

1 20

2 30

3 70

4 80
5.

10

j
The list is now sorted

void insertion_sort (int array[], int n) { int temp, i, j; for (i = 1 ; i < n; i++) { temp = array [i]; j=i-1; while (j>=0 && array[j]>temp) { array[j+1]=array [j]; j--; } array[j+1]=temp;

Determining the Efficiency of Insertion Sort Algorithm

To sort a list of size n by using insertion sort, you need to perform (n 1) passes. Best Case Efficiency:
Best case occurs when the list is already sorted. In this case, you will have to make only one comparison in each pass. In n 1 passes, you will need to make n 1 comparisons. The best case efficiency of insertion sort is of the order O(n).

Worst Case Efficiency:

Worst case occurs when the list is sorted in the reverse order. In this case, you need to perform one comparison in the first pass, two comparisons in the second pass, three comparisons in the third pass, and n 1 comparisons in the (n 1)th pass. The worst case efficiency of insertion sort is of the order O(n2).

Just a minute

A sales manager has to do a research on best seller cold drinks in the market for the year 2004-2006. David, the software developer, has a list of all the cold drink brands along with their sales figures stored in a file. David has to provide the sorted data to the sales manager. The data in the file is more or less sorted. Which sorting algorithm will be most efficient for sorting this data and why?

Answer:
Insertion sort provides better efficiency than bubble sort and selection sort when the list is partially sorted. Therefore, David should use the insertion sort algorithm.

Sorting Data by Using Shell Sort

Shell sort algorithm:

Insertion sort is an efficient algorithm only if the list is already partially sorted and results in an inefficient solution in an average case. To overcome this limitation, a computer scientist, D.L. Shell proposed an improvement over the insertion sort algorithm. The new algorithm was called shell sort after the name of its proposer.

Implementing Shell Sort Algorithm

Shell sort algorithm:

Improves insertion sort by comparing the elements separated by a distance of several positions to form multiple sublists Applies insertion sort on each sublist to move the elements towards their correct positions Helps an element to take a bigger step towards its correct position, thereby reducing the number of comparisons

Implementing Shell Sort Algorithm (Contd.)

To understand the implementation of shell sort algorithm, consider an unsorted list of numbers stored in an array.

0
arr

3 10

4 80

5 20

6 90

7 110

8 75

9 60

10 45

70

30 40

Implementing Shell Sort Algorithm (Contd.)

To apply shell sort on this array, you need to:

Select the distance by which the elements in a group will be separated to form multiple sublists. Apply insertion sort on each sublist to move the elements towards their correct positions.

0
arr

3 10

4 80

5 20

6 90

7 110

8 75

9 60

10 45

70

30 40

Implementing Shell Sort Algorithm (Contd.)

Increment = 3 0 3 6 List Pass = 1 1= 70 10 90 9 1 List 2 = 30 4 7 10

60

80 110 45

2 List 3 = 0
arr

40 1

20 75 2 3 10 4 80 5 20 6 90 7 110 8 75 9 60 10 45

70

30 40

Implementing Shell Sort Algorithm (Contd.)

0 List 1 = 10 70 3 6 9 90 60 List 2 = 1 30 4 7 10

60 70 10 90

80 110 45 45 80 110

2 List 3 = 20 40

40 75 20

Apply insertion sort to sort the The lists are sorted three lists

Implementing Shell Sort Algorithm (Contd.)

0 List 1 = 10 3 6 9 90 List 2 = 1 30 4 45 7 80 10 110

60 70

2 List 3 = 0
arr

20 2

40 75 3 60 4 45 5 40 6 70 7 80 8 75 9 10

10

30 20

90 110

Implementing Shell Sort Algorithm (Contd.)

0 2 4 Increment = 2 List 1 = 10 2 20 45 Pass = 6 70 8 10

75 110

1 List 2 = 0
arr

7 80 5 40

9 90 6 70 7 80 8 75 9 10

30 2

60 40 3 60 4 45

10

30 20

90 110

Implementing Shell Sort Algorithm (Contd.)

0 List 1 = 2 4 6 70 8 10

10

20 45

75 110

1 List 2 = 30

7 80

9 90

60 40

Apply insertion sort on each sublist

Implementing Shell Sort Algorithm (Contd.)

0 List 1 = 2 4 6 70 8 10

10

20 45

75 110

1 List 2 = 30

7 80

9 90

40 60

The lists are now sorted

Implementing Shell Sort Algorithm (Contd.)

0 List 1 = 2 4 6 70 8 10

10

20 45

75 110

1 List 2 = 0
arr

7 80 5 60

9 90 6 70 7 80 8 75 9 10

30 2

40 60 3 40 4 45

10

30 20

90 110

Implementing Shell Sort Algorithm (Contd.)

Increment = 1 Pass = 3

0
arr

3 40

4 45

5 60

6 70

7 80

8 75

10

10

30 20

90 110

Apply insertion sort to sort the list

Implementing Shell Sort Algorithm (Contd.)

Increment = 1 Pass = 3

0
arr

3 40

4 45

5 60

6 70

7 75

8 80

10

10

20 30

90 110

The list is now sorted

Just a minute

Which of the following sorting algorithms compares the elements separated by a distance of several positions to sort the data? The options are:
1. 2. 3. 4. Insertion sort Selection sort Bubble sort Shell sort

Answer:
4. Shell sort

Summary

In this session, you learned that:

Sorting is a process of arranging data in some pre-defined order of a key value. The order can be either ascending or descending. There are various sorting algorithms that are used to sort data. Some of them are:
Bubble sort Selection sort Insertion sort Shell sort Merge sort Quick sort Heap sort

Summary (Contd.)

To select an appropriate algorithm, you need to consider the following:

Execution time Storage space Programming effort

Bubble sort and selection algorithms have a quadratic order of growth, and are therefore suitable for sorting small lists only. Insertion sort performs different number of comparisons depending on the initial ordering of elements. When the elements are already in the sorted order, insertion sort needs to make very few comparisons. Insertion sort is an efficient algorithm than bubble sort and selection sort if the list that needs to be sorted is nearly sorted.

Summary (Contd.)

Shell sort improves insertion sort by comparing the elements separated by a distance of several positions. This helps an element to take a bigger step towards its correct position, thereby reducing the number of comparisons.