naginterfaces.library.nonpar.test_​ks_​1sample

naginterfaces.library.nonpar.test_ks_1sample(x, dist, par, estima, ntype)

test_ks_1sample performs the one sample Kolmogorov–Smirnov test, using one of the distributions provided.

For full information please refer to the NAG Library document for g08cb

https://support.nag.com/numeric/nl/nagdoc_30/flhtml/g08/g08cbf.html

Parameters

xfloat, array-like, shape $\left(n\right)$

The sample observations $x_1,x_2,\dots ,x_n$.

diststr

The theoretical (null) distribution from which it is suspected the data may arise.

$dist=\text{‘U'}$

The uniform distribution over $(a,b)$.

$dist=\text{‘N'}$

The Normal distribution with mean $\mu$ and variance ${\sigma }^2$.

$dist=\text{‘G'}$

The gamma distribution with shape parameter$\alpha$ and scale parameter $\beta$, where the mean $=\alpha \beta$.

$dist=\text{‘BE'}$

The beta distribution with shape parameters $\alpha$ and $\beta$, where the mean $=\alpha /(\alpha +\beta )$.

$dist=\text{‘BI'}$

The binomial distribution with the number of trials, $m$, and the probability of a success, $p$.

$dist=\text{‘E'}$

The exponential distribution with parameter $\lambda$, where the mean $=1/\lambda$.

$dist=\text{‘P'}$

The Poisson distribution with parameter $\mu$, where the mean $=\mu$.

$dist=\text{‘NB'}$

The negative binomial distribution with the number of trials, $m$, and the probability of success, $p$.

$dist=\text{‘GP'}$

The generalized Pareto distribution with shape parameter $\xi$ and scale $\beta$.

Any number of characters may be supplied as the actual parameter, however only the characters, maximum $2$, required to uniquely identify the distribution are referenced.

parfloat, array-like, shape $\left(2\right)$

If $estima=\text{‘S'}$, $par$ must contain the known values of the parameter(s) of the null distribution as follows.

If a uniform distribution is used, $par\left[0\right]$ and $par\left[1\right]$ must contain the boundaries $a$ and $b$ respectively.

If a Normal distribution is used, $par\left[0\right]$ and $par\left[1\right]$ must contain the mean, $\mu$, and the variance, ${\sigma }^2$, respectively.

If a gamma distribution is used, $par\left[0\right]$ and $par\left[1\right]$ must contain the parameters $\alpha$ and $\beta$ respectively.

If a beta distribution is used, $par\left[0\right]$ and $par\left[1\right]$ must contain the parameters $\alpha$ and $\beta$ respectively.

If a binomial distribution is used, $par\left[0\right]$ and $par\left[1\right]$ must contain the parameters $m$ and $p$ respectively.

If an exponential distribution is used, $par\left[0\right]$ must contain the parameter $\lambda$.

If a Poisson distribution is used, $par\left[0\right]$ must contain the parameter $\mu$.

If a negative binomial distribution is used, $par\left[0\right]$ and $par\left[1\right]$ must contain the parameters $m$ and $p$ respectively.

If a generalized Pareto distribution is used, $par\left[0\right]$ and $par\left[1\right]$ must contain the parameters $\xi$ and $\beta$ respectively.

If $estima=\text{‘E'}$, $par$ need not be set except when the null distribution requested is either the binomial or the negative binomial distribution in which case $par\left[0\right]$ must contain the parameter $m$.

estimastr, length 1

$estima$ must specify whether values of the parameters of the null distribution are known or are to be estimated from the data.

$estima=\text{‘S'}$

Values of the parameters will be supplied in the array $par$ described above.

$estima=\text{‘E'}$

Parameters are to be estimated from the data except when the null distribution requested is the binomial distribution or the negative binomial distribution in which case the first parameter, $m$, must be supplied in $par\left[0\right]$ and only the second parameter, $p$, is estimated from the data.

ntypeint

The test statistic to be calculated, i.e., the choice of alternative hypothesis.

$ntype=1$

Computes $D_n$, to test $H_0$ against $H_1$,

$ntype=2$

Computes $D_n^{+}$, to test $H_0$ against $H_2$,

$ntype=3$

Computes $D_n^{-}$, to test $H_0$ against $H_3$.

Returns

parfloat, ndarray, shape $\left(2\right)$

If $estima=\text{‘S'}$, $par$ is unchanged; if $estima=\text{‘E'}$, and $dist=\text{‘BI'}$ or $dist=\text{‘NB'}$ then $par\left[1\right]$ is estimated from the data; otherwise $par\left[0\right]$ and $par\left[1\right]$ are estimated from the data.

dfloat

The Kolmogorov–Smirnov test statistic ($D_n$, $D_n^{+}$ or $D_n^{-}$ according to the value of $ntype$).

zfloat

A standardized value, $Z$, of the test statistic, $D$, without any correction for continuity.

pfloat

The probability, $p$, associated with the observed value of $D$ where $D$ may be $D_n,D_n^{+}$ or $D_n^{-}$ depending on the value of $ntype$ (see Notes).

sxfloat, ndarray, shape $\left(n\right)$

The sample observations, $x_1,x_2,\dots ,x_n$, sorted in ascending order.

Raises

NagValueError

(errno $1$)

On entry, $n=⟨value⟩$.

Constraint: $n\ge 3$.

(errno $2$)

On entry, $dist=⟨value⟩$.

Constraint: $dist=\text{‘U'},\text{‘N'},\text{‘G'},\text{‘BE'},\text{‘BI'},\text{‘E'},\text{‘P'},\text{‘NB'}\text{or}\text{‘GP'}$.

(errno $3$)

On entry, $ntype=⟨value⟩$.

Constraint: $ntype=1$, $2$ or $3$.

(errno $4$)

On entry, $estima=⟨value⟩$.

Constraint: $estima=\text{‘E'}\text{or}\text{‘S'}$.

(errno $5$)

On entry, $estima=\text{‘S'}$ and $par\left[0\right]=⟨value⟩$; $par\left[1\right]=⟨value⟩$.

Constraint: for the generalized Pareto distribution with $par\left[0\right]<0$, $0\le x[\text{i}-1]\le -par\left[1\right]/par\left[0\right]$, for $\text{i}=1,2,\dots ,n$.

(errno $5$)

On entry, $estima=\text{‘S'}$ and $par\left[1\right]=⟨value⟩$.

Constraint: for the generalized Pareto distribution, $par\left[1\right]>0$.

(errno $5$)

On entry, $estima=\text{‘S'}$ and $par\left[1\right]=⟨value⟩$.

Constraint: for the negative binomial distribution, $0<par\left[1\right]<1$.

(errno $5$)

On entry, $dist=\text{‘NB'}$ and $m=par\left[0\right]=⟨value⟩$.

Note that $m$ must always be supplied.

Constraint: for the negative binomial distribution, $1\le par\left[0\right]<1/eps$, where $eps=\text{machine precision}$, see machine.precision.

(errno $5$)

On entry, $estima=\text{‘S'}$ and $par\left[0\right]=⟨value⟩$.

Constraint: for the Poisson distribution, $0<par\left[0\right]<1000000$.

(errno $5$)

On entry, $estima=\text{‘S'}$ and $par\left[0\right]=⟨value⟩$.

Constraint: for the exponential distribution, $par\left[0\right]>0$.

(errno $5$)

On entry, $estima=\text{‘S'}$ and $par\left[1\right]=⟨value⟩$.

Constraint: for the binomial distribution, $0<par\left[1\right]<1$.

(errno $5$)

On entry, $dist=\text{‘BI'}$ and $m=par\left[0\right]=⟨value⟩$.

Note that $m$ must always be supplied.

Constraint: for the binomial distribution, $1\le par\left[0\right]<1/eps$, where $eps=\text{machine precision}$, see machine.precision.

(errno $5$)

On entry, $estima=\text{‘S'}$ and $par\left[0\right]=⟨value⟩$; $par\left[1\right]=⟨value⟩$.

Constraint: for the beta distribution, $0<par\left[0\right]$ and $par\left[1\right]\le 1000000$.

(errno $5$)

On entry, $estima=\text{‘S'}$ and $par\left[0\right]=⟨value⟩$; $par\left[1\right]=⟨value⟩$.

Constraint: for the gamma distribution, $par\left[0\right]$ and $par\left[1\right]>0$.

(errno $5$)

On entry, $estima=\text{‘S'}$ and $par\left[1\right]=⟨value⟩$.

Constraint: for the Normal distribution, $par\left[1\right]>0$.

(errno $5$)

On entry, $estima=\text{‘S'}$ and $par\left[0\right]=⟨value⟩$; $par\left[1\right]=⟨value⟩$.

Constraint: for the uniform distribution, $par\left[0\right]<par\left[1\right]$.

(errno $6$)

On entry, $dist=\text{‘GP'}$ and $estima=\text{‘E'}$.

The parameter estimates are invalid; the data may not be from the generalized Pareto distribution.

(errno $6$)

On entry, $dist=\text{‘E'}\text{or}\text{‘P'}$ and all observations are zero.

Constraint: at least one $x[\text{i}-1]>0$, for $\text{i}=1,2,\dots ,n$.

(errno $6$)

On entry, $dist=\text{‘BI'}$ and all observations are zero or $m$.

Constraint: at least one $0.0<x[\text{i}-1]<par\left[0\right]$, for $\text{i}=1,2,\dots ,n$.

(errno $6$)

On entry, $dist=\text{‘G'},\text{‘E'},\text{‘P'},\text{‘NB'}\text{or}\text{‘GP'}$ and at least one observation is negative.

Constraint: $x[\text{i}-1]\ge 0$, for $\text{i}=1,2,\dots ,n$.

(errno $6$)

On entry, $dist=\text{‘BI'}$ and at least one observation is illegal.

Constraint: $0\le x[\text{i}-1]\le par\left[0\right]$, for $\text{i}=1,2,\dots ,n$.

(errno $6$)

On entry, $dist=\text{‘BE'}$ and at least one observation is illegal.

Constraint: $0\le x[\text{i}-1]\le 1$, for $\text{i}=1,2,\dots ,n$.

(errno $6$)

On entry, $dist=\text{‘U'}$ and at least one observation is illegal.

Constraint: $par\left[0\right]\le x[\text{i}-1]\le par\left[1\right]$, for $\text{i}=1,2,\dots ,n$.

(errno $7$)

On entry, $dist=\text{‘U'},\text{‘N'},\text{‘G'},\text{‘BE'}\text{or}\text{‘GP'}$, $estima=\text{‘E'}$ and the whole sample is constant. Thus the variance is zero.

(errno $8$)

On entry, $dist=\text{‘NB'}$, $par\left[0\right]=⟨value⟩$, $par\left[1\right]=⟨value⟩$.

The variance $par\left[0\right]\times (1-par[1\left]\right)/\left(par\right[1]\times par[1\left]\right)$ exceeds 1000000.

(errno $8$)

On entry, $dist=\text{‘BI'}$, $par\left[0\right]=⟨value⟩$, $par\left[1\right]=⟨value⟩$.

The variance $par\left[0\right]\times par\left[1\right]\times (1-par[1\left]\right)$ exceeds 1000000.

(errno $9$)

On entry, $dist=\text{‘G'}$ and in the computation of the incomplete gamma function by specfun.gamma_incomplete the convergence of the Taylor series or Legendre continued fraction fails within $600$ iterations.

Notes

The data consist of a single sample of $n$ observations denoted by $x_1,x_2,\dots ,x_n$. Let $S_n\left(x_{\left(i\right)}\right)$ and $F_0\left(x_{\left(i\right)}\right)$ represent the sample cumulative distribution function and the theoretical (null) cumulative distribution function respectively at the point $x_{\left(i\right)}$ where $x_{\left(i\right)}$ is the $i$th smallest sample observation.

The Kolmogorov–Smirnov test provides a test of the null hypothesis $H_0$: the data are a random sample of observations from a theoretical distribution specified by you against one of the following alternative hypotheses:

1. $H_1$: the data cannot be considered to be a random sample from the specified null distribution.

2. $H_2$: the data arise from a distribution which dominates the specified null distribution. In practical terms, this would be demonstrated if the values of the sample cumulative distribution function $S_n\left(x\right)$ tended to exceed the corresponding values of the theoretical cumulative distribution function $F_0\left(x\right)$.

3. $H_3$: the data arise from a distribution which is dominated by the specified null distribution. In practical terms, this would be demonstrated if the values of the theoretical cumulative distribution function $F_0\left(x\right)$ tended to exceed the corresponding values of the sample cumulative distribution function $S_n\left(x\right)$.

One of the following test statistics is computed depending on the particular alternative null hypothesis specified (see the description of the argument $ntype$ in Parameters).

For the alternative hypothesis $H_1$.

$D_n$ – the largest absolute deviation between the sample cumulative distribution function and the theoretical cumulative distribution function. Formally $D_n=max\{D_n^{+},D_n^{-}\}$.

For the alternative hypothesis $H_2$.

$D_n^{+}$ – the largest positive deviation between the sample cumulative distribution function and the theoretical cumulative distribution function. Formally $D_n^{+}=max\{S_n\left(x_{\left(i\right)}\right)-F_0\left(x_{\left(i\right)}\right),0\}$ for both discrete and continuous null distributions.

For the alternative hypothesis $H_3$.

$D_n^{-}$ – the largest positive deviation between the theoretical cumulative distribution function and the sample cumulative distribution function. Formally if the null distribution is discrete then $D_n^{-}=max\{F_0\left(x_{\left(i\right)}\right)-S_n\left(x_{\left(i\right)}\right),0\}$ and if the null distribution is continuous then $D_n^{-}=max\{F_0\left(x_{\left(i\right)}\right)-S_n\left(x_{(i-1)}\right),0\}$.

The standardized statistic $Z=D\times \sqrt{n}$ is also computed where $D$ may be $D_n,D_n^{+}$ or $D_n^{-}$ depending on the choice of the alternative hypothesis. This is the standardized value of $D$ with no correction for continuity applied and the distribution of $Z$ converges asymptotically to a limiting distribution, first derived by Kolmogorov (1933), and then tabulated by Smirnov (1948). The asymptotic distributions for the one-sided statistics were obtained by Smirnov (1933).

The probability, under the null hypothesis, of obtaining a value of the test statistic as extreme as that observed, is computed. If $n\le 100$ an exact method given by Conover (1980), is used. Note that the method used is only exact for continuous theoretical distributions and does not include Conover’s modification for discrete distributions. This method computes the one-sided probabilities. The two-sided probabilities are estimated by doubling the one-sided probability. This is a good estimate for small $p$, that is $p\le 0.10$, but it becomes very poor for larger $p$. If $n>100$ then $p$ is computed using the Kolmogorov–Smirnov limiting distributions, see Feller (1948), Kendall and Stuart (1973), Kolmogorov (1933), Smirnov (1933) and Smirnov (1948).

References

Conover, W J, 1980, Practical Nonparametric Statistics, Wiley

Feller, W, 1948, On the Kolmogorov–Smirnov limit theorems for empirical distributions, Ann. Math. Statist. (19), 179–181

Kendall, M G and Stuart, A, 1973, The Advanced Theory of Statistics (Volume 2), (3rd Edition), Griffin

Kolmogorov, A N, 1933, Sulla determinazione empirica di una legge di distribuzione, Giornale dell’ Istituto Italiano degli Attuari (4), 83–91

Siegel, S, 1956, Non-parametric Statistics for the Behavioral Sciences, McGraw–Hill

Smirnov, N, 1933, Estimate of deviation between empirical distribution functions in two independent samples, Bull. Moscow Univ. (2(2)), 3–16

Smirnov, N, 1948, Table for estimating the goodness of fit of empirical distributions, Ann. Math. Statist. (19), 279–281