论文检索

测量误差下形状约束非参数密度与回归的检验和估计AI 解读

In many applications we can expect that, or are interested to know if, a density function or a regression curve satisfies some specific shape constraints. For example, when the explanatory variable, X, represents the value taken by a treatment or dosage, the conditional mean of the response, Y , is often anticipated to be a monotone function of X. Indeed, if this regression mean is not monotone (in the appropriate direction) then the medical or commercial value of the…

通过检验小区域效应进行模型选择及区域数据应用AI 解读

The models used in small-area inference often involve unobservable random effects. While this can significantly improve the adaptivity and flexibility of a model, it also increases the variability of both point and interval estimators. If we could test for the existence of the random effects, and if the test were to show that they were unlikely to be present, then we would arguably not need to incorporate them into the model, and thus could significantly improve the…

结合函数及导数数据的非参数最小二乘估计AI 解读

Cost function estimation often involves data on a function and a family of its derivatives. Such data can substantially improve convergence rates of nonparametric estimators. We propose series-type estimators which incorporate the various derivative data into a single nonparametric least-squares procedure. Convergence rates are obtained and it is shown that for low-dimensional cases, much of the beneficial impact is realized even if only data on ordinary first-order partials…

一类 Lévy 过程的非参数估计AI 解读

We consider estimation for a class of Lévy processes, modelled as a sum of a drift, a symmetric stable process and a compound Poisson process. We propose a nonparametric approach to estimating unknown parameters of our model, including the drift, the scale and index parameters in the stable law, the mean of the Poisson process and the underlying jump size distribution. We show that regression and nonparametric deconvolution methods, based on the empirical characteristic…

相关噪声中检测稀疏信号的创新变换高批评检验AI 解读

Higher criticism is a method for detecting signals that are both sparse and weak. Although first proposed in cases where the noise variables are independent, higher criticism also has reasonable performance in settings where those variables are correlated. In this paper we show that, by exploiting the nature of the correlation, performance can be improved by using a modified approach which exploits the potential advantages that correlation has to offer. Indeed, it turns out…

利用混合总体证据为超高维聚类选择变量AI 解读

In this paper we develop a nonparametric approach to clustering very high-dimensional data, designed particularly for problems where the mixture nature of a population is expressed through multimodality of its density. Therefore, a technique based implicitly on mode testing can be particularly effective. In principle, several alternative approaches could be used to assess the extent of multimodality, but in the present problem the excess mass method has important advantages.…

为随机函数分布定义概率密度AI 解读

The notion of probability density for a random function is not as straightforward as in finite-dimensional cases. While a probability density function generally does not exist for functional data, we show that it is possible to develop the notion of density when functional data are considered in the space determined by the eigenfunctions of principal component analysis. This leads to a transparent and meaningful surrogate for density defined in terms of the average value of…

超高维数据中基于质心的分类器的最优性质AI 解读

We show that scale-adjusted versions of the centroid-based classifier enjoys optimal properties when used to discriminate between two very high-dimensional populations where the principal differences are in location. The scale adjustment removes the tendency of scale differences to confound differences in means. Certain other distance-based methods, for example, those founded on nearest-neighbor distance, do not have optimal performance in the sense that we propose. Our…

多元或函数型数据线性预测中的成分排序与选择AI 解读

Summary The problem of component choice in regression-based prediction has a long history. The main cases where important choices must be made are functional data analysis, and problems in which the explanatory variables are relatively high dimensional vectors. Indeed, principal component analysis has become the basis for methods for functional linear regression. In this context the number of components can also be interpreted as a smoothing parameter, and so the viewpoint…

利用 Bootstrap 量化经验排名的可信程度AI 解读

The bootstrap is a popular and convenient method for quantifying the authority of an empirical ordering of attributes, for example of a ranking of the performance of institutions or of the influence of genes on a response variable. In the first of these examples, the number, p, of quantities being ordered is sometimes only moderate in size; in the second it can be very large, often much greater than sample size. However, we show that in both types of problem the conventional…

泛函导数的估计AI 解读

Situations of a functional predictor paired with a scalar response are increasingly encountered in data analysis. Predictors are often appropriately modeled as square integrable smooth random functions. Imposing minimal assumptions on the nature of the functional relationship, we aim to estimate the directional derivatives and gradients of the response with respect to the predictor functions. In statistical applications and data analysis, functional derivatives provide a…

高维数据分类的稳健最近邻方法AI 解读

We suggest a robust nearest-neighbor approach to classifying high-dimensional data. The method enhances sensitivity by employing a threshold and truncates to a sequence of zeros and ones in order to reduce the deleterious impact of heavy-tailed data. Empirical rules are suggested for choosing the threshold. They require the bare minimum of data; only one data vector is needed from each population. Theoretical and numerical aspects of performance are explored, paying…

利用倾斜方法评估分类器中各分量的影响AI 解读

Summary Many contemporary classifiers are constructed to provide good performance for very high dimensional data. However, an issue that is at least as important as good classification is determining which of the many potential variables provide key information for good decisions. Responding to this issue can help us to determine which aspects of the datagenerating mechanism (e.g. which genes in a genomic study) are of greatest importance in terms of distinguishing between…

测量误差模型中的非参数预测AI 解读

Predicting the value of a variable Y corresponding to a future value of an explanatory variable X, based on a sample of previously observed independent data pairs (X(1), Y(1)), …, (X(n), Y(n)) distributed like (X, Y), is very important in statistics. In the error-free case, where X is observed accurately, this problem is strongly related to that of standard regression estimation, since prediction of Y can be achieved via estimation of the regression curve E(Y|X). When the…

两层混合模型中非参数推断的反卷积方法AI 解读

Summary We develop a general non-parametric approach to the analysis of clustered data via random effects. Assuming only that the link function is known, the regression functions and the distributions of both cluster means and observation errors are treated non-parametrically. Our argument proceeds by viewing the observation error at the cluster mean level as though it were a measurement error in an errors-in-variables problem, and using a deconvolution argument to access…

多重检验程序对统计量依赖的稳健性AI 解读

An important aspect of multiple hypothesis testing is controlling the significance level, or the level of Type I error. When the test statistics are not independent it can be particularly challenging to deal with this problem, without resorting to very conservative procedures. In this paper we show that, in the context of contemporary multiple testing problems, where the number of tests is often very large, the difficulties caused by dependence are less serious than in…

函数型数据的拟合优度检验AI 解读

Economic data are frequently generated by stochastic processes that can be modelled as occurring in continuous time. That is, the data are treated as realizations of a random function (functional data). Sometimes an economic theory model specifies the process up to a finite-dimensional parameter. This paper develops a test of the null hypothesis that a given functional data set was generated by a specified parametric model of a continuous-time process. The alternative…

最近邻分类中的邻居阶数选择AI 解读

The kth-nearest neighbor rule is arguably the simplest and most intuitively appealing nonparametric classification procedure. However, application of this method is inhibited by lack of knowledge about its properties, in particular, about the manner in which it is influenced by the value of k; and by the absence of techniques for empirical choice of k. In the present paper we detail the way in which the value of k determines the misclassification error. We consider two…

反卷积问题中的分布、矩与分位数估计AI 解读

When using the bootstrap in the presence of measurement error, we must first estimate the target distribution function; we cannot directly resample, since we do not have a sample from the target. These and other considerations motivate the development of estimators of distributions, and of related quantities such as moments and quantiles, in errors-in-variables settings. We show that such estimators have curious and unexpected properties. For example, if the distributions of…

仅有汇总信息时聚类二元与计数数据的非参数推断AI 解读

Summary Data in the form of pairs (X,Y), where the response Y is a count, arise in many applications, including problems involving stratified or two-stage sampling. Such data are often analysed by using random-effects models, where the distribution of Y, conditional on X and on an unobserved random parameter Θ, is taken to be either binomial or Poisson, and the distribution of Θ is connected through a link function to a random effect. The latter is sometimes supposed to be…

用潜在高斯过程建模稀疏广义纵向观测AI 解读

Summary In longitudinal data analysis one frequently encounters non-Gaussian data that are repeatedly collected for a sample of individuals over time. The repeated observations could be binomial, Poisson or of another discrete type or could be continuous. The timings of the repeated measurements are often sparse and irregular. We introduce a latent Gaussian process model for such data, establishing a connection to functional data analysis. The functional methods proposed are…

In a large class of statistical inverse problems it is necessary to suppose that the transformation that is inverted is known. Although, in many applications, it is unrealistic to make this assumption, the problem is often insoluble without it. However, if additional data are available, then it is possible to estimate consistently the unknown error density. Data are seldom available directly on the transformation, but repeated, or replicated, measurements increasingly are…

利用 SIMEX 选择变量含误差问题中的平滑参数AI 解读

SIMEX methods are attractive for solving curve estimation problems in errors-in-variables regression, using parametric or semiparametric techniques. However, nonparametric approaches are generally of quite a different type, being based on, for example, kernels, local-linear modeling, ridging, orthogonal series, or splines. All of these techniques involve the challenging (and not well studied) issue of empirical smoothing parameter choice. We show that SIMEX can be used…

高维小样本分类器相对表现的理论度量AI 解读

Summary We suggest a technique, related to the concept of ‘detection boundary’ that was developed by Ingster and by Donoho and Jin, for comparing the theoretical performance of classifiers constructed from small training samples of very large vectors. The resulting ‘classification boundaries’ are obtained for a variety of distance-based methods, including the support vector machine, distance-weighted discrimination and kth-nearest-neighbour classifiers, for thresholded forms…