NAG Toolbox Chapter Introduction

D05 — integral equations

This chapter is concerned with the numerical solution of integral equations. Provision will be made for most of the standard types of equation (see Background to the Problems). The following are, however, specifically excluded:

(a)	Equations arising in the solution of partial differential equations by integral equation methods. In cases where the prime purpose of an algorithm is the solution of a partial differential equation it will normally be included in Chapter D03.
(b)	Calculation of inverse integral transforms. This problem falls within the scope of Chapter C06.

Any functional equation in which the unknown function appears under the sign of integration is called an integral equation. Integral equations arise in a great many branches of science; for example, in potential theory, acoustics, elasticity, fluid mechanics, radiative transfer, theory of population, etc. In many instances the integral equation originates from the conversion of a boundary value problem or an initial value problem associated with a partial or an ordinary differential equation, but many problems lead directly to integral equations and cannot be formulated in terms of differential equations.

Integral equations are of many types; here we attempt to indicate some of the main distinguishing features with particular regard to the use and construction of algorithms.

In the classical theory of integral equations one distinguishes between Fredholm equations and Volterra equations. In a Fredholm equation the region of integration is fixed, whereas in a Volterra equation the region is variable. Thus, the equation is an example of Fredholm equation, and the equation is an example of a Volterra equation.

Here the forcing function $f\left(t\right)$ and the kernel function $K\left(t,s,y\left(s\right)\right)$ are prescribed, while $y\left(t\right)$ is the unknown function to be determined. (More generally the integration and the domain of definition of the functions may extend to more than one dimension.) The parameter $\lambda$ is often omitted; it is, however, of importance in certain theoretical investigations (e.g., stability) and in the eigenvalue problem discussed below.

If in (1) or (2), $c=0$, the integral equation is said to be of the first kind. If $c=1$, the equation is said to be of the second kind.

Equations (1) and (2) are linear if the kernel $K\left(t,s,y\left(s\right)\right)=k\left(t,s\right)y\left(s\right)$, otherwise they are nonlinear.

Note:  in a linear integral equation, $k\left(t,s\right)$ is usually referred to as the kernel. We adopt this convention throughout.

These two types of equations are broadly analogous to problems of initial- and boundary value type for an ordinary differential equation (ODE); thus the Volterra equation, characterised by a variable upper limit of integration, is amenable to solution by methods of marching type whilst most methods for treating Fredholm equations lead ultimately to the solution of an approximating system of simultaneous algebraic equations. For comprehensive discussion of numerical methods see Atkinson (1976), Baker (1977), Brunner and van der Houwen (1986) and Delves and Walsh (1974). In what follows, the term ‘integral equation’ is used in its general sense, and the type is distinguished when appropriate.

When considering numerical methods for integral equations, particular attention should be paid to the character of the kernel, which is usually the main factor governing the choice of an appropriate quadrature formula or system of approximating functions. Various commonly occurring types of singularity call for individual treatment.

Likewise provision can be made for cases of symmetry, periodicity or other special structure, where the solution may have special properties and/or economies may be effected in the solution process. We note in particular the following cases to which we shall often have occasion to refer in the description of individual algorithms.

(a)	A linear integral equation with a kernel $k\left(t,s\right)=k\left(s,t\right)$ is said to be symmetric. This property plays a key role in the theory of Fredholm integral equations.
(b)	If $k\left(t,s\right)=k\left(a+b-t,a+b-s\right)$ in a linear integral equation, the kernel is called centro-symmetric.
(c)	If in Equations (1) or (2) the kernel has the form $K\left(t,s,y\left(s\right)\right)=k\left(t-s\right)g\left(s,y\left(s\right)\right)$, the equation is called a convolution integral equation; in the linear case $g\left(s,y\left(s\right)\right)=y\left(s\right)$.
(d)	If the kernel in (1) has the form $$\begin{array}{l}K\left(t,s,y\left(s\right)\right)=K_1\left(t,s,y\left(s\right)\right)\text{, \hspace{1em}}a\le s\le t\text{,}\\ K\left(t,s,y\left(s\right)\right)=K_2\left(t,s,y\left(s\right)\right)\text{, \hspace{1em}}t<s\le b\text{,}\end{array}$$   where the functions $K_1$ and $K_2$ are well behaved, whilst $K$ or its $s$-derivative is possibly discontinuous, may be described as discontinuous or of ‘split’ type; in the linear case $K\left(t,s,y\left(s\right)\right)=k\left(t,s\right)y\left(s\right)$ and consequently $K_1=k_{1}y$ and $K_2=k_{2}y$. Examples are the commonly occurring kernels of the type $k\left(\left|t-s\right|\right)$ and the Green's functions (influence functions) which arise in the conversion of ODE boundary value problems to integral equations. It is also of interest to note that the Volterra equation (2) may be conceived as a Fredholm equation with kernel of split type, with $K_2\left(t,s,y\left(s\right)\right)\equiv 0$; consequently methods designed for the solution of Fredholm equations with split kernels are also applicable to Volterra equations.

An integral equation may be called singular if either

(a)	its kernel contains a singularity, or
(b)	the range of integration is infinite,

and it is said to be weakly singular if the kernel becomes infinite at $s=t$

Sometimes a solution can be effected by a simple adaptation of a method applicable to a nonsingular equation: for example, an infinite range may be truncated at a suitably chosen point. In other cases, however, theoretical considerations will dictate the need for special methods and algorithms. Examples are:

(i)	Integral equations with singular kernels of Cauchy type;
(ii)	Equations of Wiener–Hopf type;
(iii)	Various dual integral equations arising in the solution of boundary value problems of mathematical physics;
(iv)	The well-known Abel integral equation, an equation of Volterra type, whose kernel contains an inverse square root singularity at $s=t$.

Problems of inversion of integral transforms also fall under this heading but, as already remarked, they lie outside the scope of this chapter.

Closely connected with the linear Fredholm integral equation of the second kind is the eigenvalue problem represented by the homogeneous equation If $\lambda$ is chosen arbitrarily this equation in general possesses only the trivial solution $y\left(t\right)=0$. However, for a certain critical set of values of $\lambda$, the characteristic values or eigenvalues (the latter term is sometimes reserved for the reciprocals $\mu =1/\lambda$), there exist nontrivial solutions $y\left(t\right)$, termed characteristic functions or eigenfunctions, which are of fundamental importance in many investigations. The analogy with the eigenproblem of linear algebra is readily apparent, and indeed most methods of solution of equation (3) entail reduction to an approximately equivalent algebraic problem

The Fredholm integral equation of the first kind belong to the class of ‘ill-posed’ problems; even supposing that a solution corresponding to the prescribed $f\left(t\right)$ exists, a slight perturbation of $f\left(t\right)$ may give rise to an arbitrarily large variation in the solution $y\left(t\right)$. Hence the equation may be closely satisfied by a function bearing little resemblance to the ‘true’ solution. The difficulty associated with this instability is aggravated by the fact that in practice the specification of $f\left(t\right)$ is usually inexact.

Nevertheless a great many physical problems (e.g., in radiography, spectroscopy, stereology, chemical analysis) are appropriately formulated in terms of integral equations of the first kind, and useful and meaningful ‘solutions’ can be obtained with the aid of suitable stabilizing procedures. See Chapters 12 and 13 of Delves and Walsh (1974) for further discussion and references.

Consider the nonlinear Fredholm equation of the second kind The numerical solution of equation (6) is usually accomplished either by simple iteration or by a more sophisticated iterative scheme based on Newton's method; in the latter case it is necessary to solve a sequence of linear integral equations. Convergence may be demonstrated subject to suitable conditions of Lipschitz continuity of the functions $K$ with respect to the parameter $y$.

Examples of Fredholm type (for which the provision of algorithms is contemplated) are:

(a)	the Uryson equation $$u\left(t\right)-\underset{0}{\overset{1}{\int }}F\left(t,s,u\left(s\right)\right)ds=0\text{, \hspace{1em}}0\le t\le 1\text{,}$$ (7)
(b)	the Hammerstein equation $$u\left(t\right)-\underset{0}{\overset{1}{\int }}k\left(t,s\right)g\left(s,u\left(s\right)\right)ds=0\text{, \hspace{1em}}0\le t\le 1\text{,}$$ (8)

where $F$ and $g$ are arbitrary functions.

Consider the Volterra integral equation of the first kind Clearly it is necessary that $f\left(a\right)=0$; otherwise no solution to (9) can exist. The following types of Volterra integral equations of the first kind occur in real life problems:

• equations with unbounded kernel at $s=t$,
• equations with sufficiently smooth kernel.

These types belong also to the class of ‘ill-posed’ problems. However, the instability is appreciably less severe in the equations with unbounded kernel. In general, a nonsingular Volterra equation of the first kind presents less computational difficulty than the Fredholm equation (5) with a smooth kernel.

A Volterra equation of the first kind may, under suitable conditions, be converted by differentiation to one of the second kind or by integration by parts to an equation of the second kind for the integral of the wanted function.

A very general Volterra equation of the second kind is given by The resemblance of Volterra equations to ODEs suggests that the underlying methods for ODE problems can be applied to Volterra equations. Indeed this turns out to be the case. The main advantages of implementing these methods are their well-developed theoretical background, i.e., convergence and stability; see Brunner and van der Houwen (1986) and Wolkenfelt (1982).

Many Volterra integral equations arising in real life problems have a convolution kernel (see Structure of Kernel(c)); see Brunner and van der Houwen (1986) for references. However, a subclass of these equations which have kernels of the form where $\left\{{\lambda }_j\right\}$ are real, can be converted into a system of linear or nonlinear ODEs; see Brunner and van der Houwen (1986).

For more information on the theoretical and the numerical treatment of integral equations we refer you to Atkinson (1976), Baker (1977), Brunner and van der Houwen (1986), Cochran (1972) and Delves and Walsh (1974).

The choice of function will depend first of all upon the type of integral equation to be solved.

(a)

Linear equations nag_inteq_fredholm2_split (d05aa) is applicable to an equation with a discontinuous or ‘split’ kernel as defined in Structure of Kernel(d). Here, however, both the functions $k_1$ and $k_2$ are required to be defined (and well-behaved) throughout the square $a\le s$, $t\le b$. nag_inteq_fredholm2_smooth (d05ab) is applicable to an equation with a smooth kernel. Note that nag_inteq_fredholm2_split (d05aa) may also be applied to this case, by setting $k_1=k_2=k$, but nag_inteq_fredholm2_smooth (d05ab) is more efficient.

(a)

Linear equations nag_inteq_fredholm2_split (d05aa) may be used to solve a Volterra equation by defining $k_2$ (or $k_1$) to be identically zero. (See also (b).)

(b)

Nonlinear equations nag_inteq_volterra2 (d05ba) is applicable to a nonlinear convolution Volterra integral equation of the second kind. The kernel function has the form $$K\left(t,s,y\left(s\right)\right)=k\left(t-s\right)g\left(s,y\left(s\right)\right)\text{.}$$   The underlying methods used in the function are the reducible linear multistep methods. You have a choice of variety of these methods. This function can also be used for linear $g$. nag_inteq_abel2_weak (d05bd) is applicable to a nonlinear convolution equation having a weakly-singular kernel (Abel). The kernel function has the form $$K\left(t,s,y\left(s\right)\right)=\frac{k\left(t-s\right)}{\sqrt{t-s}}g\left(s,y\left(s\right)\right)\text{.}$$   The underlying methods used in the function are the fractional linear multistep methods based on Backward Difference Formula (BDF, see Initial Value Problems in the D02 Chapter Introduction) methods. This function can also be used for linear $g$.

nag_inteq_volterra_weights (d05bw) generates the weights associated with Adams' and BDF linear multistep methods. These weights can be used for the solution of nonsingular Volterra integral and integro-differential equations of general type.

nag_inteq_abel_weak_weights (d05by) generates the weights associated with BDF linear multistep methods. These weights can be used for the solution of weakly-singular Volterra (Abel) integral equations of general type.

Many of the functions in this chapter require you to supply procedures defining the kernels and other given functions in the equations. It is important to test these independently before using them in conjunction with NAG Toolbox functions.

Atkinson K E (1976) A Survey of Numerical Methods for the Solution of Fredholm Integral Equations of the Second Kind SIAM, Philadelphia

Baker C T H (1977) The Numerical Treatment of Integral Equations Oxford University Press

Brunner H and van der Houwen P J (1986) The Numerical Solution of Volterra Equations CWI Monographs, North-Holland, Amsterdam

Cochran J A (1972) The Analysis of Linear Integral Equations McGraw–Hill

Delves L M and Walsh J (1974) Numerical Solution of Integral Equations Clarendon Press, Oxford

Wolkenfelt P H M (1982) The construction of reducible quadrature rules for Volterra integral and integro-differential equations IMA J. Numer. Anal. 2 131–152