Repository logo
 

Automatic Discovery of the Statistical Types of Variables in a Dataset

Accepted version
Peer-reviewed

Type

Conference Object

Change log

Authors

Valera, Isabel 

Abstract

A common practice in statistics and machine learning is to assume that the statistical data types (e.g., ordinal, categorical or real-valued) of variables, and usually also the likelihood model, is known. However, as the availability of real- world data increases, this assumption becomes too restrictive. Data are often heterogeneous, complex, and improperly or incompletely documented. Surprisingly, despite their practical importance, there is still a lack of tools to automatically discover the statistical types of, as well as appropriate likelihood (noise) models for, the variables in a dataset. In this paper, we fill this gap by proposing a Bayesian method, which accurately discovers the statistical data types in both synthetic and real data.

Description

Keywords

Journal Title

INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 70

Conference Name

ICML 2017

Journal ISSN

2640-3498

Volume Title

70

Publisher

PMLR
Sponsorship
Humboldt Research Fellowship for Postdoctoral Researchers, which funded this research during her stay at the Max Planck Institute for Software Systems. ATI Grant EP/N510129/1 EPSRC Grant EP/N014162/1 Google