dorsal/arxiv
View SchemaBayesian Field Theory: Nonparametric Approaches to Density Estimation, Regression, Classification, and Inverse Quantum Problems
| Authors | J. C. Lemm |
|---|---|
| Categories | |
| ArXiv ID | physics/9912005 |
| URL | https://arxiv.org/abs/physics/9912005 |
Abstract
Bayesian field theory denotes a nonparametric Bayesian approach for learning functions from observational data. Based on the principles of Bayesian statistics, a particular Bayesian field theory is defined by combining two models: a likelihood model, providing a probabilistic description of the measurement process, and a prior model, providing the information necessary to generalize from training to non-training data. The particular likelihood models discussed in the paper are those of general density estimation, Gaussian regression, clustering, classification, and models specific for inverse quantum problems. Besides problem typical hard constraints, like normalization and positivity for probabilities, prior models have to implement all the specific, and often vague, "a priori" knowledge available for a specific task. Nonparametric prior models discussed in the paper are Gaussian processes, mixtures of Gaussian processes, and non-quadratic potentials. Prior models are made flexible by including hyperparameters. In particular, the adaption of mean functions and covariance operators of Gaussian process components is discussed in detail. Even if constructed using Gaussian process building blocks, Bayesian field theories are typically non-Gaussian and have thus to be solved numerically. According to increasing computational resources the class of non-Gaussian Bayesian field theories of practical interest which are numerically feasible is steadily growing. Models which turn out to be computationally too demanding can serve as starting point to construct easier to solve parametric approaches, using for example variational techniques.
{
"annotation_id": "97063a41-5d3c-457f-b276-b7a12d292605",
"date_created": "2026-03-02T18:01:24.234000Z",
"date_modified": "2026-03-02T18:01:24.234000Z",
"file_hash": "cb471159f0999fef1d2da8fa4572cf800ced9d4c93d170238fc6050edfa6441c",
"private": false,
"record": {
"abstract": "Bayesian field theory denotes a nonparametric Bayesian approach for learning\nfunctions from observational data. Based on the principles of Bayesian\nstatistics, a particular Bayesian field theory is defined by combining two\nmodels: a likelihood model, providing a probabilistic description of the\nmeasurement process, and a prior model, providing the information necessary to\ngeneralize from training to non-training data. The particular likelihood models\ndiscussed in the paper are those of general density estimation, Gaussian\nregression, clustering, classification, and models specific for inverse quantum\nproblems. Besides problem typical hard constraints, like normalization and\npositivity for probabilities, prior models have to implement all the specific,\nand often vague, \"a priori\" knowledge available for a specific task.\nNonparametric prior models discussed in the paper are Gaussian processes,\nmixtures of Gaussian processes, and non-quadratic potentials. Prior models are\nmade flexible by including hyperparameters. In particular, the adaption of mean\nfunctions and covariance operators of Gaussian process components is discussed\nin detail. Even if constructed using Gaussian process building blocks, Bayesian\nfield theories are typically non-Gaussian and have thus to be solved\nnumerically. According to increasing computational resources the class of\nnon-Gaussian Bayesian field theories of practical interest which are\nnumerically feasible is steadily growing. Models which turn out to be\ncomputationally too demanding can serve as starting point to construct easier\nto solve parametric approaches, using for example variational techniques.",
"arxiv_id": "physics/9912005",
"authors": [
"J. C. Lemm"
],
"categories": [
"physics.data-an",
"adap-org",
"cond-mat.dis-nn",
"nlin.AO"
],
"title": "Bayesian Field Theory: Nonparametric Approaches to Density Estimation, Regression, Classification, and Inverse Quantum Problems",
"url": "https://arxiv.org/abs/physics/9912005"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "c6aab30e-4b15-4760-9cf9-a64f312395b5",
"id": "arXiv Dataset IDs",
"type": "Model",
"variant": "snapshot-2026-03-01",
"version": "0.1.0"
},
"user_id": 1000002
}