NAG Library Chapter Introduction

m01 – Sorting and Searching


Scope of the Chapter

This chapter is concerned with sorting numeric or character data. It handles only the simplest types of data structure and it is concerned only with internal sorting – that is, sorting a set of data which can all be stored within the program.
If you have large files of data or complicated data structures to be sorted you should use a comprehensive sorting program or package.

Background to the Problems


The usefulness of sorting is obvious (perhaps a little too obvious, since sorting can be expensive and is sometimes done when not strictly necessary). Sorting may traditionally be associated with data processing and non-numerical programming, but it has many uses within the realm of numerical analysis. For example, within the NAG C Library, sorting is used to arrange eigenvalues in ascending order of absolute value, in the manipulation of sparse matrices, and in the ranking of observations for nonparametric statistics.
The general problem may be defined as follows. We are given N items of data
Each item Ri contains a key Ki which can be ordered relative to any other key according to some specified criterion (for example, ascending numeric value). The problem is to determine a permutation
which puts the keys in order:
Sometimes we may wish actually to rearrange the items so that their keys are in order; for other purposes we may simply require a table of indices so that the items can be referred to in sorted order; or yet again we may require a table of ranks, that is, the positions of each item in the sorted order.
For example, given the single-character items, to be sorted into alphabetic order the indices of the items in sorted order are and the ranks of the items are
Indices may be converted to ranks, and vice versa, by simply computing the inverse permutation.
The items may consist solely of the key (each item may simply be a number). On the other hand, the items may contain additional information (for example, each item may be an eigenvalue of a matrix and its associated eigenvector, the eigenvalue being the key). In the latter case there may be many distinct items with equal keys, and it may be important to preserve the original order among them (if this is achieved, the sorting is called ‘stable’).
There are a number of ingenious algorithms for sorting. For a fascinating discussion of them, and of the whole subject, see Knuth (1973).
The Quicksort algorithm, used by nag_quicksort (m01csc), is not stable in this sense; hence an alternative function, nag_stable_sort (m01ctc), is provided which does perform a stable sort, but requires more internal workspace, and may be slower.


Searching is a process of retrieving data stored in a computer's memory.
The general problem may be defined as follows:
There are a number of different search algorithms. For more on the subject, see Knuth (1973) and Wirth (2004).

Functionality Index

Determined ranks of the data, 
            arbitrary types nag_rank_sort (m01dsc)
Pre-determined ranks of the data, 
        arbitrary types nag_reorder_vector (m01esc)
Searching (i.e., exact match or the nearest lower value): 
    binary search, 
            integer numbers nag_search_int (m01nbc)
            null terminated strings nag_search_char (m01ncc)
            real numbers nag_search_double (m01nac)
    search for a match to a given key nag_search_vector (m01fsc)
Service functions, 
    invert a permutation (ranks to indices or vice versa) nag_make_indices (m01zac)
Sorting (i.e., rearranging into sorted order): 
    chain sort, 
        linked list of items, 
            arbitrary types nag_chain_sort (m01cuc)
    quick sort, 
            arbitrary types nag_quicksort (m01csc)
            real numbers nag_double_sort (m01cac)
    stable sort, 
            arbitrary types nag_stable_sort (m01ctc)

Auxiliary Functions Associated with Library Function Arguments


Functions Withdrawn or Scheduled for Withdrawal



Knuth D E (1973) The Art of Computer Programming (Volume 3) (2nd Edition) Addison–Wesley
Wirth N (2004) Algorithms and Data Structures 35–36 Prentice Hall
© The Numerical Algorithms Group Ltd, Oxford, UK. 2017