Browsing by Author "Ghahramani, Zoubin"
Now showing items 2-21 of 29
-
Bayesian generalised ensemble Markov chain Monte Carlo
Frellsen, Jes; Winther, Ole; Ghahramani, Zoubin; Ferkinghoff-Borg, Jesper (Microtome Publishing, 2016)Bayesian generalised ensemble (BayesGE) is a new method that addresses two major drawbacks of standard Markov chain Monte Carlo algorithms for inference in high-dimensional probability models: inapplicability to estimate ... -
Bayesian inference on random simple graphs with power law degree distributions
Lee, J; Heaukulani, C; Ghahramani, Zoubin; James, LF; Choi, SWe present a model for random simple graphs with power law (i.e., heavy-tailed) degree dis- tributions. To attain this behavior, the edge probabilities in the graph are constructed from Bertoin–Fujita–Roynette–Yor (BFRY) ... -
Bayesian Structured Prediction using Gaussian Processes
Bratières, Sébastien; Quadrianto, Novi; Ghahramani, Zoubin (IEEE, 2014-10-31) -
A Birth-Death Process for Feature Allocation.
Palla, Konstantina; Knowles, David A; Ghahramani, Zoubin (2017)We propose a Bayesian nonparametric prior over feature allocations for sequential data, the birth- death feature allocation process (BDFP). The BDFP models the evolution of the feature allocation of a set of N objects ... -
Deep Bayesian Active Learning with Image Data
Ghahramani, Zoubin; Gal, Y; Islam, REven though active learning forms an important pillar of machine learning, deep learning tools are not prevalent within it. Deep learning poses several difficulties when used in an active learning setting. First, active ... -
Denotational validation of higher-order Bayesian inference
Ścibior, Adam; Kammar, Ohad; Vákár, Matthijs; Staton, Sam; Yang, Hongseok; Cai, Yufei; Ostermann, KlausMoss, SeanHeunen, ChrisGhahramani, Zoubin et al.We present a modular semantic account of Bayesian inference algorithms for probabilistic programming lan- guages, as used in data science and machine learning. Sophisticated inference algorithms are often explained in terms ... -
A General Framework for Constrained Bayesian Optimization using Information-based Search
Hernández-Lobato, José Miguel; Gelbart, Michael A.; Adams, Ryan P.; Hoffman, Matthew W.; Ghahramani, Zoubin (MIT Press, 2016-09-24)We present an information-theoretic framework for solving global black-box optimization problems that also have black-box constraints. Of particular interest to us is to efficiently solve problems with decoupled constraints, ... -
A General Framework for Constrained Bayesian Optimization using Information-based Search
Hernández-Lobato, JM; Gelbart, MA; Adams, RP; Hoffman, MW; Ghahramani, Zoubin (Journal of Machine Learning Research, 2016-09-24)We present an information-theoretic framework for solving global black-box optimization problems that also have black-box constraints. Of particular interest to us is to efficiently solve problems with $\textit{decoupled}$ ... -
Improving PPM with dynamic parameter updates
Steinruecken, Christian; Ghahramani, Zoubin; MacKay, David (IEEE, 2015)This article makes several improvements to the classic PPM algorithm, resulting in a new algorithm with superior compression effectiveness on human text. The key differences of our algorithm to classic PPM are that (A) ... -
Improving PPM with dynamic parameter updates
Steinruecken, Christian; Ghahramani, Zoubin; MacKay, David (2015-03-25) -
Interpolated Policy Gradient: Merging On-Policy and Off-Policy Gradient Estimation for Deep Reinforcement Learning
Gu, Shixiang; Lillicrap, Timothy; Ghahramani, Zoubin; Turner, Richard Eric; Schölkopf, Bernhard; Levine, Sergey -
Latent Gaussian Processes for Distribution Estimation of Multivariate Categorical Data
Gal, Yarin; Chen, Yutian; Ghahramani, Zoubin (Microtome Publishing, 2015)Multivariate categorical data occur in many applications of machine learning. One of the main difficulties with these vectors of categorical variables is sparsity. The number of possible observations grows exponentially ... -
Linear Dimensionality Reduction: Survey, Insights, and Generalizations
Cunningham, John P; Ghahramani, Zoubin (MIT Press, 2015-12-01)Linear dimensionality reduction methods are a cornerstone of analyzing high dimensional data, due to their simple geometric interpretations and typically attractive computational properties. These methods capture many data ... -
Lost Relatives of the Gumbel Trick
Balog, Matej; Tripuraneni, N; Ghahramani, Zoubin; Weller, Adrian VivianThe Gumbel trick is a method to sample from a discrete probability distribution, or to estimate its normalizing partition function. The method re- lies on repeatedly applying a random perturbation to the distribution in a ... -
MCMC for Variationally Sparse Gaussian Processes
Hensman, James; Matthews, Alexander; Filippone, Maurizio; Ghahramani, Zoubin (Neural Information Processing Systems Foundation, 2015-12-07)Gaussian process (GP) models form a core part of probabilistic machine learning. Considerable research effort has been made into attacking three issues with GP models: how to compute efficiently when the number of data is ... -
The Mondrian Kernel
Balog, Matej; Lakshminarayanan, B; Ghahramani, Zoubin; Roy, DM; Teh, YW (Association for Uncertainty in Artificial Intelligence Press, 2016-06-29)We introduce the Mondrian kernel, a fast $\textit{random feature}$ approximation to the Laplace kernel. It is suitable for both batch and online learning, and admits a fast kernel-width-selection procedure as the random ... -
Neural Adaptive Sequential Monte Carlo
Gu, Shixiang; Ghahramani, Zoubin; Turner, Richard E. (Curran Associates, 2015)Sequential Monte Carlo (SMC), or particle filtering, is a popular class of methods for sampling from an intractable target distribution using a sequence of simpler intermediate distributions. Like other importance ... -
Neural adaptive sequential Monte Carlo
Gu, S; Ghahramani, Zoubin; Turner, Richard Eric (2015-01-01) -
On Sparse variational methods and the Kullback-Leibler divergence between stochastic processes
Matthews, Alexander; Hensman, James; Turner, Richard Eric; Ghahramani, Zoubin -
One-Shot Learning in Discriminative Neural Networks
Burgess, Jordan; Lloyd, James Robert; Ghahramani, Zoubin