What if we were Texas sharpshooters? Predictor reporting bias in regression analysis

Biemann, Torsten

DOI: https://doi.org/10.1177/1094428113485135
URL: http://journals.sagepub.com/doi/10.1177/1094428113...
Additional URL: http://orm.sagepub.com/content/16/3/335
Document Type: Article
Year of publication: 2013
The title of a journal, publication series: Organizational Research Methods : ORM
Volume: 16
Issue number: 3
Page range: 335-363
Place of publication: Thousand Oaks, Calif.
Publishing house: Sage Publications
ISSN: 1094-4281
Publication language: English
Institution: Business School > ABWL, Personalmanagement u. Führung (Biemann)
Subject: 330 Economics
Keywords (English): reporting bias , meta-analysis , regression , funnel plots , publication bias
Abstract: The author analyzes reporting biases in regression analyses. The consequences of researchers’ strategy to select significant predictors and omit nonsignificant predictors from regression analyses are examined, focusing on how this strategy—labeled the Texas sharpshooter (TS) approach—creates a predictor reporting bias (PRB) in primary studies and research syntheses. PRB was demonstrated in simulation studies when correlation coefficients from several primary regression studies with an underlying TS approach were aggregated in meta-analyses. Several important findings are noted. First, meta-analytical effect sizes of true effects can be overestimated because smaller, nonsignificant findings are omitted from regression models. Second, suppression effects of correlated predictor variables create biased effect size estimations for variables that are not related to the outcome. Finally, existing small effects are concealed, and between-study heterogeneity can be overestimated. Results show that PRB is contingent on sample size. While PRB is substantial in studies with small sample sizes (N < 100), it is negligible when large sample sizes (N > 500) are analyzed. Preconditions and remedies for reporting biases in regression analyses are discussed.

Dieser Eintrag ist Teil der Universitätsbibliographie.

+ Citation Example and Export

Biemann, Torsten (2013) What if we were Texas sharpshooters? Predictor reporting bias in regression analysis. Organizational Research Methods : ORM Thousand Oaks, Calif. 16 3 335-363 [Article]

+ Search Authors in

+ Page Views

Hits per month over past year

Detailed information

You have found an error? Please let us know about your desired correction here: E-Mail

Actions (login required)

Show item Show item