The COM-negative binomial distribution: modeling overdispersion and ultrahigh zero-inflated count data
In this paper, we focus on the COM-type negative binomial distribution with three parameters, which belongs to COM-type class distributions and family of equilibrium distributions of arbitrary birth-death process. Besides, we show abundant distributional properties such as overdispersion and underdispersion, log-concavity, log-convexity (infinite divisibility), pseudo compound Poisson, stochastic ordering and asymptotic approximation. Some characterizations including sum of equicorrelated geometrically distributed r.v.’s, conditional distribution, limit distribution of COM-negative hypergeometric distribution, and functional operator characterization are given for theoretical properties. COM-negative binomial distribution was applied to overdispersion and ultrahigh zero-inflated data sets. We employ maximum likelihood method to estimate the parameters and the goodness-of-fit are evaluated by the discrete Kolmogorov-Smirnov test.
keywords:overdispersion, zero-inflated data, compound Poisson distribution, infinite divisibility, discrete Kolmogorov-Smirnov test MSC2010: 60E07 60A05 62F10
Before 2005, Conway-Maxwell-Poisson distribution (denoted as COM-Poisson distribution) had been rarely used since Conway and Maxwell (1962) briefly introduced it for modeling of queuing systems with state-dependent service time, see also Wimmer and Altmann (1999), Wimmer et al. (1995). About ten years ago, the COM-Poisson distribution with two parameters was revived by Shmueli et al. (2005) as a generalization of Poisson distribution. More recently, there has been a fast growth of researches on COM-Poisson distribution in terms of related statistical theory and applied methodology, see Sellers et al. (2012) and the references therein. The probability mass function(p.m.f.) is given by
where and . We denote (1) as .
Kokonendji et al. (2008) proved that COM-Poisson distribution was overdispersed when and underdispersed when . Another extension of Poisson is negative binomial, which is a noted discrete distribution with overdispersion property and is widely applied in actuarial sciences(see Denuit et al. (2007), Kaas et al. (2008)). The p.m.f. of the negative binomial r.v is
where and .
In this paper, we introduce a new extension of the negative binomial distribution (denoted by CMNB) depending on three parameters by replacing in (2) with and divide the normalization constant .
A r.v. is said to follow COM-negative binomial distribution with three parameters if the p.m.f. is given by
where and .
In another point of view, the alternative form of (3) can be written as
When , we will show that COM-negative binomial (3) is discrete compound Poisson, which has wide application in risk theory (includes non-life insurance) as well, see Zhang et al. (2014) and the references therein. We plot 12 cases of COM-negative binomial p.m.f. in Figture 1 in the end of this section.
It is easy to see that our COM-negative binomial distribution belongs to the COM-type extension of class. The class distribution is a famous family of distributions which sometimes refers to Katz class (see remarks in section 2.3.1 of Johnson et al. (2005)). It has significant applications in non-life insurance mathematics, especially for modelling claim counts( loss models, collective risk models), see Kaas et al. (2008), Denuit et al. (2007). A classic result in non-life insurance textbooks states that the class distribution only contains degenerate, binomial, Poisson and the negative binomial distribution. After adding a new parameter , we define the COM-type extension of distribution, and it is convenient to see that degenerate, COM-Poisson, COM-binomial and COM-negative binomial belong to this class of distributions.
Shmueli et al. (2005) firstly proposed the COM-binomial distribution which is presented as a sum of equicorrelated Bernoulli variables. Borges et al. (2014) studied some properties and an asymptotic approximation (e.g. COM-binomial approximates to COM-Poisson under some conditions) of this family of distributions in detail. We will show that some results of COM-Poisson can be extended in our COM-negative binomial distribution. Kadane (2016) gives the exchangeably properties, sufficient statistics and multivariate extension of COM-binomial distribution.
Another variant of COM-negative binomial distribution has been studied by Imoto (2014), it just replaces the term in (2) by and then divides the normalization constant. We will give adequate reasons to support our extension in succeeding sections. Chakraborty and Imoto (2016) considered the extended COM-Poisson distribution (ECOMP):
where the parameter space is . ECOMP distribution combines Imoto (2014)’s extension () and our extension of COM-negative binomial distribution (). The COM-Poisson is a special case of ECOMP when . ECOMP distribution has the queuing systems characterization (birth-death process with arrival rate and service rate for ), see also Brown and Xia (2001) for arbitrary birth-death process characterization.
The rest of the article is organized as the follows. In section 2, we propose the COM-type class distributions, and demonstrate some example of COM-type class which includes the COM-negative binomial. Further more, some properties of COM-negative binomial are given: Renyi entropy and Tsallis entropy representation, overdispersion and underdispersion, log-concavity, log-convexity (infinite divisibility), pseudo compound Poisson, stochastic ordering and asymptotic approximation. In section 3, some conditional distribution characterizations and Stein identity characterization are presented by using related lemmas, and we also show that COM-negative hypergeometric can approximate to COM-negative binomial. In section 4, inverse method were introduced to generate COM-negative binomial distributed random variables. Section 5 then estimates the parameters by maximum likelihood method, in which the initial values are provided by recursive formula. In section 6, two simulated data sets and two applications to actuarial claim data sets are given as examples. In section 7, we provide some potential and further research suggestions based on the properties and characterizations of COM-negative binomial distribution.
2.1 Recursive formula and ultrahigh zero-inflated property
The recursive formula (or ratios of consecutive probabilities) is given by
We say that a zero-inflated count data following some discrete distribution is ultrahigh zero-inflated if . For COM-negative binomial case with two parameters, we have ; and for negative binomial case, we get If we choose and in COM-negative binomial case, then this three-parameter case is more flexible to deal with the ratio comparing to the two-parameter case, as when . (For examples, the plots of COM-negative binomial distribution with in Figture 1; in Table 4 of section 6.2). In the insurance company, the more zero insurance claims, the less risk to bankrupt.
The following definition provides a generalization of class distribution.
Let be a discrete r.v., if satisfies the recursive formula
for some constants and , then we call it COM-type class distribution. We denote this class as .
The COM-Poisson distribution satisfies the case , since and .
From (6), it is easy to see that COM-negative binomial distribution belongs to COM-type class distribution with .
where . We denote (9) as .
Since the ratio of consecutive probabilities is , COM-binomial distribution belongs to COM type class distribution.
Remark 1: As we know, the class distribution only contains degenerate distribution, binomial distribution, Poisson distribution and the negative binomial distribution. But there are other distributions belongs to COM type class. For example, can be replaced by in (9), and the p.m.f. is given by
where such that .
Remark 2: Brown and Xia (2001) considered the very large class of stationary distribution of birth-death process with arrival rate and service rate by the recursive formula:
Thus we can construct a birth-death process with arrival rate and service rate ; is a positive constant), which characterizes the COM-type class distribution.
2.2 Related to Rényi entropy and Tsallis entropy
Notice the Rényi entropy(see Rényi (1961)) in the information theory, which generalizes the Shannon entropy. The Renyi entropy of order of a discrete r.v. :
Another generalization of Shannon entropy in physic is the Tsallis entropy. For r.v. , its Tsallis entropy of order is defined by
This entropy was introduced by Tsallis (1988) as a basis for generalizing the Boltzmann-Gibbs statistics.
Also, the normalization constant in (4) has Tsallis entropy representation , then .
2.3 Log-concave, Log-convex, Infinite divisibility
This subsection deals with log-concavity and log-convexity of the COM-negative binomial distribution. A discrete distribution with is said to have log-concave (log-convex) p.m.f. if
The COM-negative binomial distribution is log-concave if and log-convex if .
In fact, using the ratio of consecutive probabilities (6), we have
Then iff (log-concave) and iff (log-convex). ∎
Remark 3: Ibragimov (1956) called a distribution strongly unimodal if it is unimodal and its convolution with any unimodal distribution is unimodal. He showed that the strongly unimodal distributions is equal to the log-concave distributions. So COM-negative binomial distribution has strong unimodality(see Figure 1 for example) when .
Steutel (1970) showed that all log-convex discrete distributions are infinitely divisible, the background and detailed proof can be found in Steutel and van Harn (2003). Then we obtain infinite divisibility of COM-negative binomial distribution when .
The COM-negative binomial distribution (3) is discrete infinitely divisible (discrete compound Poisson distribution) if .
Feller’s characterization of the discrete infinite divisibility showed that a non-negative integer valued r.v. is infinitely divisible if and only if its distribution is a discrete compound Poisson distribution with p.g.f.:
For a theoretical treatment of discrete infinite divisibility (or discrete compound Poisson distribution), we refer readers to section 2 of Steutel and van Harn (2003), section 9.3 of Johnson et al. (2005), Zhang and Li (2016).
Considering some being negative in (10), it turns into a generalization of the discrete compound Poisson distribution:
Definition 2.2 (Discrete pseudo compound Poisson distribution).
If a discrete r.v. with , , has a p.g.f. of the form
where , , , and , then is said to follow a discrete pseudo compound Poisson distribution, abbreviated as DPCP.
Let , for any discrete r.v. , its p.g.f. has no zeros in if and only if is DPCP distributed.
(Lévy-Wiener theorem) Let be a absolutely convergent Fourier series with . The value of lies on a curve , and is an analytic (not necessarily single-valued) function of a complex variable which is regular at every point of . Then has an absolutely convergent Fourier series.
For any discrete r.v. with p.g.f. . If , then is DPCP distributed.
First, we show that has no zeros in , since
And notice that , so are not zeros point. ∎
The COM-negative binomial distribution (3) is discrete pseudo compound Poisson distribution if or .
On the one hand, deduces that COM-negative binomial belongs to discrete compound Poisson by Corollary 2.1, hence COM-negative binomial is discrete pseudo compound Poisson. On the other hand, by using Lemma 2.4, we need to guarantee that for . is a decreasing function with respect to when , reaches its maximum as . So is the other case. ∎
Applying the recurrence relation (Lévy-Adelson-Panjer recursion) of p.m.f. of DPCP distribution, see Remark 1 in Zhang et al. (2014)
and , then the DPCP parametrization of COM-nagative binomial distribution is determined by the following system of equations:
2.4 Overdispersion and underdispersion
In statistics, for a given random sample , overdispersion means that . Conversely, underdispersion means that . Moreover, equal-dispersion means that . G¨®mez-D¨¦niz (2011) summerized the phenomena of insurance count claims data, which were characterized by two features: (i) Overdispersion, i.e., the variance is greater than the mean; (ii) Zero-inflated, i.e. the presence of a high percentage of zero values in the empirical distribution.
The COM-negative binomial distribution belongs to the family of weighted Poisson distribution (see Kokonendji et al. (2008)) with p.m.f.
where is a non-negative weighted function.
Then weighted Poisson representation of COM-negative binomial distribution is
Therefore, COM-negative binomial distribution in (3) can be seen as a weighted Poisson distribution with weighted function
Theorem 3 and its corollary in Kokonendji et al. (2008) provide an “iff” condition to prove overdispersion and underdispersion of the weighted Poisson distribution.
Let be a weighted Poisson random variable with mean , and let be a weighted function not depending on . Then, weighted function is logconvex (logconcave) iff the weighted version of is overdispersed (underdispersed).
Kokonendji et al. (2008) applied it to show that COM-Poisson distribution is overdispersion if and underdispersion if . We employ their methods to get a criterion for overdispersion or underdispersion of COM-negative binomial distribution.
Set . The COM-nagative binomial distribution (3) is overdispersion if and underdispersion if .
Then, the results of overdispersion can be easily obtained by Theorem 2.1.
In these two cases: 1. ; 2. . COM-negative binomial distribution is overdispersion.
Remark 4: The result of case 2 () can be also obtained from Corollary 2.1 and overdispersion of discrete compound Poisson distribution (equivalently, the discrete infinitely divisible).
2.5 Stochastic ordering
Stochastic ordering is the concept of one r.v. neither stochastically greater than, less than nor equal to another r.v. . There are plenty types of stochastic orders, which have various applications in risk theory. Firstly, we present 4 different definitions for discrete r.v.: usual stochastic order, likelihood ratio order, hazard rate order and mean residual life order.
1. is stochastically less than in usual stochastic order (denoted by ) if for all , where is the survival function of with p.m.f. .
2. is stochastically less than in likelihood ratio order(denoted by ) if increases in over the union of the supports of and , where and denotes the p.m.f. of and , respectively.
3. is stochastically less than in hazard rate order(denoted by ) if for all , where the hazard function of a discrete r.v. with p.m.f. is defined as
4. is stochastically less than in mean residual life order(denoted by ) if for all , where the mean residual life function of a discrete r.v. with p.m.f. is defined as .
Gupta et al. (2014) gave the stochastic ordering between COM-Poisson r.v. and Poisson distributed r.v. with same parameter in (1), that is , therefore , and . In the following result we will show that COM-negative binomial distribution also has some stochastic ordering properties.
Let and be two r.v.’s following COM-negative binomial distribution with parameters and , respectively. If , then , hence , and .
Note that , we have . Then
which is increasing in as . ∎
Especially, assume that is a positive integer, the COM-negative binomial should be called the COM-Pascal distribution. Let be COM-negative binomial distributed and be negative binomial distributed with the same parameters , it yields to when .
The next theorem is proved in the view of weighted Poisson distribution (12) from weighted function of COM-negative binomial distribution. Example 1.C.59 of Shaked and Shanthikumar (2007) states the obvious lemma below:
Define as the r.v. with weighted density function , Similarly, for another nonnegative r.v. with density function , define as the r.v. with the weighted density function . If is an increasing function, then .
Let and be two COM-negative binomial distributed with parameters and , respectively. If or , then , and therefore , and
For Poisson distributed , with mean ,, if , then is increasing for all . So . From section 2.4, we know that COM-negative binomial is weight Poisson with weight (13).
On the one hand, when , we notice that weighted density function for COM-negative binomial distribution is increasing with respect to . On the other hand, is an increasing function with respect to as , that is, . ∎
2.6 Approximate to COM-Poisson distribution
The next theorem enable COM-negative binomial distribution to be a suitable generalization since its limit distribution is the COM-Poisson under some conditions. We prove that COM-negative binomial distribution converges to the COM-Poisson distribution when goes to infinity.
Suppose that r.v. has COM-negative binomial distribution with parameters , denote the p.m.f. as , and let . Then
Notice that , substitute to p.m.f (3), then we obtain
holds as and
3.1 Sum of equicorrelated geometrically distributed r.v.
It is well known that the binomial r.v. can be seen as the sum of independent Bernoulli r.v. .
As we know, negative binomial distribution can be treated as the sum of independent geometric r.v.’s :
It is similar to see that the COM-negative binomial distribution can be interpreted as a sum of equicorrelated geometric r.v.’s with joint distribution
The reason is that we assume is equicorrelated, and has feasible positive integer solutions, and each solution has probability . Then, the possible values of random vector such that is COM-negative binomial distributed, namely
Thus we have (15).
3.2 Conditional distribution
In this subsection, two conditional distribution characterizations are obtained for COM-negative binomial distribution. For two independent r.v.’s , what is the form of the conditional distribution of given ? Consider the sum of COM-negative binomial r.v.’s with parameters and , then