Semi-parametric inference for the means of heavy-tailed distributions

N/D

Autores

Taddy, Matt
Goldberg, David
Gardner, Matt

Orientador

Co-orientadores

Citações na Scopus

Tipo de documento

Working Paper

Data

2016

Unidades Organizacionais

Resumo

Heavy tailed distributions present a tough setting for inference. They are also common in industrial applications, particularly with Internet transaction datasets, and machine learners often analyze such data without considering the biases and risks associated with the misuse of standard tools. This article outlines a procedure for inference about the (possibly conditional) mean of a heavy tailed distribution that combines nonparametric inference for the bulk of the support with parametric inference – motivated from extreme value theory – for the heavy tail. We are able to derive analytic posterior conditional means and variances for the expected value of a heavy tailed distributivo. We also introduce a simple and novel independence Metropolis Hastings algorithm that samples from the distribution for tail parameters via small adjustments to a parametric bootstrap, and through this algorithm are able to provide comparisons between our framework and frequentist semiparametric inference. We also provide a modeling extension that shrinks tails across distributions to an overall background tail. We illustrate on two examples: treatment effect estimation on a set of 72 A/B experiments, and the fitting of regression trees for prediction of user spending. Both use data from tens of millions of users of eBay.com.

Palavras-chave

Titulo de periódico

URL da fonte

Título de Livro

URL na Scopus

Idioma

Inglês

Notas

Membros da banca

Área do Conhecimento CNPQ

Ciências Exatas e da Terra

Citação

Avaliação

Revisão

Suplementado Por

Referenciado Por