Least Squares Estimator (least + square_estimator)

Distribution by Scientific Domains


Selected Abstracts


Real-Time OD Estimation Using Automatic Vehicle Identification and Traffic Count Data

COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, Issue 1 2002
Michael P. Dixon
A key input to many advanced traffic management operations strategies are origin,destination (OD) matricies. In order to examine the possibility of estimating OD matricies in real-time, two constrained OD estimators, based on generalized least squares and Kalman filtering, were developed and tested. A one-at-a-time processing method was introduced to provide an efficient organized framework for incorporating observations from multiple data sources in real-time. The estimators were tested under different conditions based on the type of prior OD information available, the type of assignment available, and the type of link volume model used. The performance of the Kalman filter estimators also was compared to that of the generalized least squares estimator to provide insight regarding their performance characteristics relative to one another for given scenarios. Automatic vehicle identification (AVI) tag counts were used so that observed and estimated OD parameters could be compared. While the approach was motivated using AVI data, the methodology can be generalized to any situation where traffic counts are available and origin volumes can be estimated reliably. The primary means by which AVI data was utilized was through the incorporation of prior observed OD information as measurements, the inclusion of a deterministic link volume component that makes use of OD data extracted from the latest time interval from which all trips have been completed, and through the use of link choice proportions estimated based on link travel time data. It was found that utilizing prior observed OD data along with link counts improves estimator accuracy relative to OD estimation based exclusively on link counts. [source]


Sparse partial least squares regression for simultaneous dimension reduction and variable selection

JOURNAL OF THE ROYAL STATISTICAL SOCIETY: SERIES B (STATISTICAL METHODOLOGY), Issue 1 2010
Hyonho Chun
Summary., Partial least squares regression has been an alternative to ordinary least squares for handling multicollinearity in several areas of scientific research since the 1960s. It has recently gained much attention in the analysis of high dimensional genomic data. We show that known asymptotic consistency of the partial least squares estimator for a univariate response does not hold with the very large p and small n paradigm. We derive a similar result for a multivariate response regression with partial least squares. We then propose a sparse partial least squares formulation which aims simultaneously to achieve good predictive performance and variable selection by producing sparse linear combinations of the original predictors. We provide an efficient implementation of sparse partial least squares regression and compare it with well-known variable selection and dimension reduction approaches via simulation experiments. We illustrate the practical utility of sparse partial least squares regression in a joint analysis of gene expression and genomewide binding data. [source]


First-order rounded integer-valued autoregressive (RINAR(1)) process

JOURNAL OF TIME SERIES ANALYSIS, Issue 4 2009
M. Kachour
Abstract., We introduce a new class of autoregressive models for integer-valued time series using the rounding operator. Compared with classical INAR models based on the thinning operator, the new models have several advantages: simple innovation structure, autoregressive coefficients with arbitrary signs, possible negative values for time series and possible negative values for the autocorrelation function. Focused on the first-order RINAR(1) model, we give conditions for its ergodicity and stationarity. For parameter estimation, a least squares estimator is introduced and we prove its consistency under suitable identifiability condition. Simulation experiments as well as analysis of real data sets are carried out to attest the model performance. [source]


Minimum , -divergence estimation for arch models

JOURNAL OF TIME SERIES ANALYSIS, Issue 1 2006
S. Ajay Chandra
Abstract., This paper considers a minimum , -divergence estimation for a class of ARCH(p) models. For these models with unknown volatility parameters, the exact form of the innovation density is supposed to be unknown in detail but is thought to be close to members of some parametric family. To approximate such a density, we first construct an estimator for the unknown volatility parameters using the conditional least squares estimator given by Tjøstheim [Stochastic processes and their applications (1986) Vol. 21, pp. 251,273]. Then, a nonparametric kernel density estimator is constructed for the innovation density based on the estimated residuals. Using techniques of the minimum Hellinger distance estimation for stochastic models and residual empirical process from an ARCH(p) model given by Beran [Annals of Statistics (1977) Vol. 5, pp. 445,463] and Lee and Taniguchi [Statistica Sinica (2005) Vol. 15, pp. 215,234] respectively, it is shown that the proposed estimator is consistent and asymptotically normal. Moreover, a robustness measure for the score of the estimator is introduced. The asymptotic efficiency and robustness of the estimator are illustrated by simulations. The proposed estimator is also applied to daily stock returns of Dell Corporation. [source]


A Recursive Thick Frontier Approach to Estimating Production Efficiency,

OXFORD BULLETIN OF ECONOMICS & STATISTICS, Issue 2 2006
Rien J. L. M. Wagenvoort
Abstract We introduce a new panel data estimation technique for production and cost functions, the recursive thick frontier approach (RTFA). RTFA has two advantages over existing econometric frontier methods. First, technical inefficiency is allowed to be dependent on the explanatory variables of the frontier model. Secondly, RTFA does not hinge on distributional assumptions on the inefficiency component of the error term. We show by means of simulation experiments that RTFA outperforms the popular stochastic frontier approach and the ,within' ordinary least squares estimator for realistic parameterizations of a productivity model. Although RTFAs formal statistical properties are unknown, we argue, based on these simulation experiments, that RTFA is a useful complement to existing methods. [source]


On inference for a semiparametric partially linear regression model with serially correlated errors

THE CANADIAN JOURNAL OF STATISTICS, Issue 4 2007
Jinhong You
Abstract The authors consider a semiparametric partially linear regression model with serially correlated errors. They propose a new way of estimating the error structure which has the advantage that it does not involve any nonparametric estimation. This allows them to develop an inference procedure consisting of a bandwidth selection method, an efficient semiparametric generalized least squares estimator of the parametric component, a goodness-of-fit test based on the bootstrap, and a technique for selecting significant covariates in the parametric component. They assess their approach through simulation studies and illustrate it with a concrete application. L'inférence dans le cadre d'un modèle de régression semiparamétrique partiellement linéaire à termes d'erreur corrélés en série Les auteurs s'intéressent à un modèle de régression semiparamétrique partiellement linéaire à termes d'erreur corrélés en série. Ils proposent une façon originale d'estimer la structure d'erreur qui a l'avantage de ne faire intervenir aucune estimation non paramétrique. Ceci leur permet de développer une procédure d'inférence comportant un choix de fen,tre, l'emploi de la méthode des moindres carrés généralisés pour l'estimation semiparamétrique efficace de la composante paramétrique, un test d'adéquation fondé sur le rééchantillonnage et une technique de sélection des covariables significatives de la composante paramétrique. Ils évaluent leur approche par voie de simulation et en donnent une illustration concrète. [source]


On the sensitivity of the restricted least squares estimators to covariance misspecification

THE ECONOMETRICS JOURNAL, Issue 3 2007
Alan T.K. Wan
Summary, Traditional econometrics has long stressed the serious consequences of non-spherical disturbances for the estimation and testing procedures under the spherical disturbance setting, that is, the procedures become invalid and can give rise to misleading results. In practice, it is not unusual, however, to find that the parameter estimates do not change much after fitting the more general structure. This suggests that the usual procedures may well be robust to covariance misspecification. Banerjee and Magnus (1999) proposed sensitivity statistics to decide if the Ordinary Least Squares estimators of the coefficients and the disturbance variance are sensitive to deviations from the spherical error assumption. This paper extends their work by investigating the sensitivity of the restricted least squares estimator to covariance misspecification where the restrictions may or may not be correct. Large sample results giving analytical evidence to some of the numerical findings reported in Banerjee and Magnus (1999) are also obtained. [source]


Computer Algebra Derivation of the Bias of Linear Estimators of Autoregressive Models

JOURNAL OF TIME SERIES ANALYSIS, Issue 2 2006
Y. Zhang
Abstract., A symbolic method which can be used to obtain the asymptotic bias and variance coefficients to order O(1/n) for estimators in stationary time series is discussed. Using this method, the large-sample bias of the Burg estimator in the AR(p) for p = 1, 2, 3 is shown to be equal to that of the least squares estimators in both the known and unknown mean cases. Previous researchers have only been able to obtain simulation results for the Burg estimator's bias because this problem is too intractable without using computer algebra. The asymptotic bias coefficient to O(1/n) of Yule,Walker as well as least squares estimates is also derived in AR(3) models. Our asymptotic results show that for the AR(3), just as in the AR(2), the Yule,Walker estimates have a large bias when the parameters are near the nonstationary boundary. The least squares and Burg estimates are much better in this situation. Simulation results confirm our findings. [source]


A comparison of three estimators of the Weibull parameters

QUALITY AND RELIABILITY ENGINEERING INTERNATIONAL, Issue 4 2001
Katina R. Skinner
Abstract Using mean square error as the criterion, we compare two least squares estimates of the Weibull parameters based on non-parametric estimates of the unreliability with the maximum likelihood estimates (MLEs). The two non-parametric estimators are that of Herd,Johnson and one recently proposed by Zimmer. Data was generated using computer simulation with three small sample sizes (5, 10 and 15) with three multiply-censored patterns for each sample size. Our results indicate that the MLE is a better estimator of the Weibull characteristic value, ,, than the least squares estimators considered. No firm conclusions may be made regarding the best estimate of the Weibull shape parameter, although the use of maximum likelihood is not recommended for small sample sizes. Whenever least squares estimation of both Weibull parameters is appropriate, we recommend the use of the Zimmer estimator of reliability. Copyright © 2001 John Wiley & Sons, Ltd. [source]


Bootstrapping Autoregression under Non-stationary Volatility

THE ECONOMETRICS JOURNAL, Issue 1 2008
Ke-Li Xu
Summary This paper studies robust inference in autoregression around a polynomial trend with stable autoregressive roots under non-stationary volatility. The formulation of the volatility process is quite general including many existing deterministic and stochastic non-stationary volatility specifications. The aim of the paper is two-fold. First, it develops a limit theory for least squares estimators and shows how non-stationary volatility affects the consistency, convergence rates and asymptotic distributions of the slope and trend coefficients estimators in different ways. This complements the results recently obtained by Chung and Park (2007, Journal of Econometrics 137, 230,59. Second, it studies the recursive wild bootstrap procedure of Gonçalves and Kilian (2004, Journal of Econometrics 123, 89,120) in the presence of non-stationary volatility, and shows its validity when the estimates are asymptotically mixed Gaussian. Simulations are performed to compare favourably the recursive wild bootstrap with other inference procedures under non-stationary volatility. [source]


On the sensitivity of the restricted least squares estimators to covariance misspecification

THE ECONOMETRICS JOURNAL, Issue 3 2007
Alan T.K. Wan
Summary, Traditional econometrics has long stressed the serious consequences of non-spherical disturbances for the estimation and testing procedures under the spherical disturbance setting, that is, the procedures become invalid and can give rise to misleading results. In practice, it is not unusual, however, to find that the parameter estimates do not change much after fitting the more general structure. This suggests that the usual procedures may well be robust to covariance misspecification. Banerjee and Magnus (1999) proposed sensitivity statistics to decide if the Ordinary Least Squares estimators of the coefficients and the disturbance variance are sensitive to deviations from the spherical error assumption. This paper extends their work by investigating the sensitivity of the restricted least squares estimator to covariance misspecification where the restrictions may or may not be correct. Large sample results giving analytical evidence to some of the numerical findings reported in Banerjee and Magnus (1999) are also obtained. [source]