Algorithmic Learning in a Random World

Conformal prediction is a valuable new method of machine learning. Conformal predictors are among the most accurate methods of machine learning, and unlike other state-of-the-art methods, they provide information about their own accuracy and reliability. This new monograph integrates mathematical theory and revealing experimental work. It demonstrates mathematically the validity of the reliability claimed by conformal predictors when they are applied to independent and identically distributed data, and it confirms experimentally that the accuracy is sufficient for many practical problems. Later chapters generalize these results to models called repetitive structures, which originate in the algorithmic theory of randomness and statistical physics. The approach is flexible enough to incorporate most existing methods of machine learning, including newer methods such as boosting and support vector machines and older methods such as nearest neighbors and the bootstrap. Topics and Features: \* Describes how conformal predictors yield accurate and reliable predictions, complemented with quantitative measures of their accuracy and reliability \* Handles both classification and regression problems \* Explains how to apply the new algorithms to real-world data sets \* Demonstrates the infeasibility of some standard prediction tasks \* Explains connections with Kolmogorov’s algorithmic randomness, recent work in machine learning, and older work in statistics \* Develops new methods of probability forecasting and shows how to use them for prediction in causal networks Researchers in computer science, statistics, and artificial intelligence will find the book an authoritative and rigorous treatment of some of the most promising new developments in machine learning. Practitioners and students in all areas of research that use quantitative prediction or machine learning will learn about important new methods.

algorithmic Learning In A Random World Describes Recent Theoretical And Experimental Developments In Building Computable Approximations To Kolmogorov's Algorithmic Notion Of Randomness. Based On These Approximations, A New Set Of Machine Learning Algorithms Have Been Developed That Can Be Used To Make Predictions And To Estimate Their Confidence And Credibility In High-dimensional Spaces Under The Usual Assumption That The Data Are Independent And Identically Distributed (assumption Of Randomness). Another Aim Of This Unique Monograph Is To Outline Some Limits Of Predictions: The Approach Based On Algorithmic Theory Of Randomness Allows For The Proof Of Impossibility Of Prediction In Certain Situations. The Book Describes How Several Important Machine Learning Problems, Such As Density Estimation In High-dimensional Spaces, Cannot Be Solved If The Only Assumption Is Randomness.

Introduction....Pages 1-15 Conformal prediction....Pages 17-51 Classification with conformal predictors....Pages 53-96 Modifications of conformal predictors....Pages 97-130 Probabilistic prediction I: impossibility results....Pages 131-142 Probabilistic prediction II: Venn predictors....Pages 143-168 Beyond exchangeability....Pages 169-187 On-line compression modeling I: conformal prediction....Pages 189-221 On-line compression modeling II: Venn prediction....Pages 223-240 Perspectives and contrasts....Pages 241-273 "Researchers in computer science, statistics, and artificial intelligence will find the book an authoritative and rigorous treatment of some of the most promising new developments in machine learning. Practitioners and students in all areas of research that use quantitative prediction or machine learning will learn about important new methods."--Résumé de l'éditeur "Researchers in computer science, statistics, and artificial intelligence will find the book an authoritative and rigorous treatment of some of the most promising new developments in machine learning. Practitioners and students in all areas of research that use quantitative prediction or machine learning will learn about important new methods."--Jacket This scientific monograph develops significant new algorithmic foundations in machine learning theory. Researchers and postgraduates in CS, statistics, and A.I. should find the book an authoritative and formal presentation of some of the most promising theoretical developments in machine learning