NAG FL Interface
g13nef (cp_​binary_​user)

1 Purpose

g13nef detects change points in a univariate time series, that is, the time points at which some feature of the data, for example the mean, changes. Change points are detected using binary segmentation for a user-supplied cost function.

2 Specification

Fortran Interface
Subroutine g13nef ( n, beta, minss, mdepth, chgpfn, ntau, tau, y, iuser, ruser, ifail)
Integer, Intent (In) :: n, minss, mdepth
Integer, Intent (Inout) :: iuser(*), ifail
Integer, Intent (Out) :: ntau, tau(*)
Real (Kind=nag_wp), Intent (In) :: beta
Real (Kind=nag_wp), Intent (Inout) :: y(*), ruser(*)
External :: chgpfn
C Header Interface
#include <nag.h>
void  g13nef_ (const Integer *n, const double *beta, const Integer *minss, const Integer *mdepth,
void (NAG_CALL *chgpfn)(const Integer *side, const Integer *u, const Integer *w, const Integer *minss, Integer *v, double cost[], double y[], Integer iuser[], double ruser[], Integer *info),
Integer *ntau, Integer tau[], double y[], Integer iuser[], double ruser[], Integer *ifail)
The routine may be called by the names g13nef or nagf_tsa_cp_binary_user.

3 Description

Let y1:n=yj:j=1,2,,n denote a series of data and τ=τi:i=1,2,,m denote a set of m ordered (strictly monotonic increasing) indices known as change points with 1τin and τm=n. For ease of notation we also define τ0=0. The m change points, τ, split the data into m segments, with the ith segment being of length ni and containing yτi-1+1:τi.
Given a cost function, Cyτi-1+1:τi, g13nef gives an approximate solution to
minimize m,τ i=1 m Cyτi-1+1:τi + β  
where β is a penalty term used to control the number of change points. The solution is obtained in an iterative manner as follows:
  1. 1.Set u=1, w=n and k=0
  2. 2.Set k=k+1. If k>K, where K is a user-supplied control parameter, then terminate the process for this segment.
  3. 3.Find v that minimizes
    Cyu:v + Cyv+1:w  
  4. 4.Test
    Cyu:v + Cyv+1:w + β < Cyu:w (1)
  5. 5.If inequality (1) is false then the process is terminated for this segment.
  6. 6.If inequality (1) is true, then v is added to the set of change points, and the segment is split into two subsegments, yu:v and yv+1:w. The whole process is repeated from step 2 independently on each subsegment, with the relevant changes to the definition of u and w (i.e., w is set to v when processing the left-hand subsegment and u is set to v+1 when processing the right-hand subsegment.
The change points are ordered to give τ.

4 References

Chen J and Gupta A K (2010) Parametric Statistical Change Point Analysis With Applications to Genetics Medicine and Finance Second Edition Birkhäuser

5 Arguments

1: n Integer Input
On entry: n, the length of the time series.
Constraint: n2.
2: beta Real (Kind=nag_wp) Input
On entry: β, the penalty term.
There are a number of standard ways of setting β, including:
SIC or BIC
β=p×logn.
AIC
β=2p.
Hannan-Quinn
β=2p×loglogn.
where p is the number of parameters being treated as estimated in each segment. The value of p will depend on the cost function being used.
If no penalty is required then set β=0. Generally, the smaller the value of β the larger the number of suggested change points.
3: minss Integer Input
On entry: the minimum distance between two change points, that is τi-τi-1minss.
Constraint: minss2.
4: mdepth Integer Input
On entry: K, the maximum depth for the iterative process, which in turn puts an upper limit on the number of change points with m2K.
If K0 then no limit is put on the depth of the iterative process and no upper limit is put on the number of change points, other than that inherent in the length of the series and the value of minss.
5: chgpfn Subroutine, supplied by the user. External Procedure
chgpfn must calculate a proposed change point, and the associated costs, within a specified segment.
The specification of chgpfn is:
Fortran Interface
Subroutine chgpfn ( side, u, w, minss, v, cost, y, iuser, ruser, info)
Integer, Intent (In) :: side, u, w, minss
Integer, Intent (Inout) :: iuser(*), info
Integer, Intent (Out) :: v
Real (Kind=nag_wp), Intent (Inout) :: y(*), ruser(*)
Real (Kind=nag_wp), Intent (Out) :: cost(3)
C Header Interface
void  chgpfn_ (const Integer *side, const Integer *u, const Integer *w, const Integer *minss, Integer *v, double cost[], double y[], Integer iuser[], double ruser[], Integer *info)
1: side Integer Input
On entry: flag indicating what chgpfn must calculate and at which point of the Binary Segmentation it has been called.
side=-1
only Cyu:w need be calculated and returned in cost1, neither v nor the other elements of cost need be set. In this case, u=1 and w=n.
side=0
all elements of cost and v must be set. In this case, u=1 and w=n.
side=1
the segment, yu:w, is a left-hand side subsegment from a previous iteration of the Binary Segmentation algorithm. All elements of cost and v must be set.
side=2
the segment, yu:w, is a right-hand side subsegment from a previous iteration of the Binary Segmentation algorithm. All elements of cost and v must be set.
The distinction between side=1 and 2 may allow for chgpfn to be implemented in a more efficient manner. See Section 10 for one such example.
The first call to chgpfn will always have side=-1 and the second call will always have side=0. All subsequent calls will be made with side=1 or 2.
2: u Integer Input
On entry: u, the start of the segment of interest.
3: w Integer Input
On entry: w, the end of the segment of interest.
4: minss Integer Input
On entry: the minimum distance between two change points, as passed to g13nef.
5: v Integer Output
On exit: if side=-1 then v need not be set.
if side-1 then v, the proposed change point. That is, the value which minimizes
minimize v Cyu:v + Cyv+1:w  
for v=u+minss-1 to w-minss.
6: cost3 Real (Kind=nag_wp) array Output
On exit: costs associated with the proposed change point, v.
If side=-1 then cost1=Cyu:w and the remaining two elements of cost need not be set.
If side-1 then
  • cost1= Cyu:v + Cyv+1:w .
  • cost2= Cyu:v .
  • cost3= Cyv+1:w .
7: y* Real (Kind=nag_wp) array User Data
chgpfn is called with y as supplied to g13nef. You are free to use the array y to supply information to chgpfn.
y is supplied in addition to iuser and ruser for ease of coding as in most cases chgpfn will require (functions of) the time series, y.
8: iuser* Integer array User Workspace
9: ruser* Real (Kind=nag_wp) array User Workspace
chgpfn is called with the arguments iuser and ruser as supplied to g13nef. You should use the arrays iuser and ruser to supply information to chgpfn.
10: info Integer Input/Output
On entry: info=0.
On exit: in most circumstances info should remain unchanged.
If info is set to a strictly positive value then g13nef terminates with ifail=51.
If info is set to a strictly negative value the current segment is skipped (i.e., no change points are considered in this segment) and g13nef continues as normal. If info was set to a strictly negative value at any point and no other errors occur then g13nef will terminate with ifail=52.
chgpfn must either be a module subprogram USEd by, or declared as EXTERNAL in, the (sub)program from which g13nef is called. Arguments denoted as Input must not be changed by this procedure.
Note: chgpfn should not return floating-point NaN (Not a Number) or infinity values, since these are not handled by g13nef. If your code inadvertently does return any NaNs or infinities, g13nef is likely to produce unexpected results.
6: ntau Integer Output
On exit: m, the number of change points detected.
7: tau* Integer array Output
Note: the dimension of the array tau must be at least minnminss,2mdepth if mdepth>0, and at least nminss otherwise.
On exit: the first m elements of tau hold the location of the change points. The ith segment is defined by yτi-1+1 to yτi, where τ0=0 and τi=taui,1im.
The remainder of tau is used as workspace.
8: y* Real (Kind=nag_wp) array User Data
y is not used by g13nef, but is passed directly to chgpfn and may be used to pass information to this routine. y will usually be used to pass (functions of) the time series, y of interest.
9: iuser* Integer array User Workspace
10: ruser* Real (Kind=nag_wp) array User Workspace
iuser and ruser are not used by g13nef, but are passed directly to chgpfn and may be used to pass information to this routine.
11: ifail Integer Input/Output
On entry: ifail must be set to 0, -1 or 1 to set behaviour on detection of an error; these values have no effect when no error is detected.
A value of 0 causes the printing of an error message and program execution will be halted; otherwise program execution continues. A value of -1 means that an error message is printed while a value of 1 means that it is not.
If halting is not appropriate, the value -1 or 1 is recommended. If message printing is undesirable, then the value 1 is recommended. Otherwise, the value 0 is recommended. When the value -1 or 1 is used it is essential to test the value of ifail on exit.
On exit: ifail=0 unless the routine detects an error or a warning has been flagged (see Section 6).

6 Error Indicators and Warnings

If on entry ifail=0 or -1, explanatory error messages are output on the current error message unit (as defined by x04aaf).
Errors or warnings detected by the routine:
ifail=11
On entry, n=value.
Constraint: n2.
ifail=31
On entry, minss=value.
Constraint: minss2.
ifail=51
User requested termination by setting info=value.
ifail=52
User requested a segment to be skipped by setting info=value.
ifail=-99
An unexpected error has been triggered by this routine. Please contact NAG.
See Section 7 in the Introduction to the NAG Library FL Interface for further information.
ifail=-399
Your licence key may have expired or may not have been installed correctly.
See Section 8 in the Introduction to the NAG Library FL Interface for further information.
ifail=-999
Dynamic memory allocation failed.
See Section 9 in the Introduction to the NAG Library FL Interface for further information.

7 Accuracy

Not applicable.

8 Parallelism and Performance

g13nef is threaded by NAG for parallel execution in multithreaded implementations of the NAG Library.
Please consult the X06 Chapter Introduction for information on how to control and interrogate the OpenMP environment used within this routine. Please also consult the Users' Note for your implementation for any additional implementation-specific information.

9 Further Comments

g13ndf performs the same calculations for a cost function selected from a provided set of cost functions. If the required cost function belongs to this provided set then g13ndf can be used without the need to provide a cost function routine.

10 Example

This example identifies changes in the scale parameter, under the assumption that the data has a gamma distribution, for a simulated dataset with 100 observations. A penalty, β of 3.6 is used and the minimum segment size is set to 3. The shape parameter is fixed at 2.1 across the whole input series.
The cost function used is
Cyτi-1+1:τi = 2 a ni logSi - log a ni  
where a is a shape parameter that is fixed for all segments and ni=τi-τi-1+1.

10.1 Program Text

Program Text (g13nefe.f90)

10.2 Program Data

Program Data (g13nefe.d)

10.3 Program Results

Program Results (g13nefe.r)
This example plot shows the original data series and the estimated change points.
GnuplotProduced by GNUPLOT 4.6 patchlevel 3 0 0.5 1 1.5 2 2.5 3 3.5 4 0 10 20 30 40 50 60 70 80 90 100 Value Time Example Program Simulated time series and the corresponding changes in scale b, assuming y = Ga(2.1,b) gnuplot_plot_1