skip to main content
article
Free access

Analysis of Perceptron-Based Active Learning

Published: 01 June 2009 Publication History

Abstract

We start by showing that in an active learning setting, the Perceptron algorithm needs Ω(1/ε2) labels to learn linear separators within generalization error ε. We then present a simple active learning algorithm for this problem, which combines a modification of the Perceptron update with an adaptive filtering rule for deciding which points to query. For data distributed uniformly over the unit sphere, we show that our algorithm reaches generalization error ε after asking for just Õ(d log 1/ε) labels. This exponential improvement over the usual sample complexity of supervised learning had previously been demonstrated only for the computationally more complex query-by-committee algorithm.

Cited By

View all
  • (2021)Statistical Query Algorithms for Mean Vector Estimation and Stochastic Convex OptimizationMathematics of Operations Research10.1287/moor.2020.111146:3(912-945)Online publication date: 1-Aug-2021
  • (2020)Efficient active learning of sparse halfspaces with arbitrary bounded noiseProceedings of the 34th International Conference on Neural Information Processing Systems10.5555/3495724.3496327(7184-7197)Online publication date: 6-Dec-2020
  • (2019)Partition selection with sparse autoencoders for content based image classificationNeural Computing and Applications10.1007/s00521-017-3099-031:3(675-690)Online publication date: 1-Mar-2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

The Journal of Machine Learning Research  Volume 10, Issue
12/1/2009
2936 pages
ISSN:1532-4435
EISSN:1533-7928
Issue’s Table of Contents

Publisher

JMLR.org

Publication History

Published: 01 June 2009
Published in JMLR Volume 10

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)54
  • Downloads (Last 6 weeks)8
Reflects downloads up to 22 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2021)Statistical Query Algorithms for Mean Vector Estimation and Stochastic Convex OptimizationMathematics of Operations Research10.1287/moor.2020.111146:3(912-945)Online publication date: 1-Aug-2021
  • (2020)Efficient active learning of sparse halfspaces with arbitrary bounded noiseProceedings of the 34th International Conference on Neural Information Processing Systems10.5555/3495724.3496327(7184-7197)Online publication date: 6-Dec-2020
  • (2019)Partition selection with sparse autoencoders for content based image classificationNeural Computing and Applications10.1007/s00521-017-3099-031:3(675-690)Online publication date: 1-Mar-2019
  • (2018)Entity Matching with Active Monotone ClassificationProceedings of the 37th ACM SIGMOD-SIGACT-SIGAI Symposium on Principles of Database Systems10.1145/3196959.3196984(49-62)Online publication date: 27-May-2018
  • (2018)Active expansion sampling for learning feasible domains in an unbounded input spaceStructural and Multidisciplinary Optimization10.1007/s00158-017-1894-y57:3(925-945)Online publication date: 1-Mar-2018
  • (2017)Diameter-based active learningProceedings of the 34th International Conference on Machine Learning - Volume 7010.5555/3305890.3306037(3444-3452)Online publication date: 6-Aug-2017
  • (2017)Near-optimal active learning of halfspaces via query synthesis in the noisy settingProceedings of the Thirty-First AAAI Conference on Artificial Intelligence10.5555/3298483.3298501(1798-1804)Online publication date: 4-Feb-2017
  • (2017)Statistical query algorithms for mean vector estimation and stochastic convex optimizationProceedings of the Twenty-Eighth Annual ACM-SIAM Symposium on Discrete Algorithms10.5555/3039686.3039768(1265-1277)Online publication date: 16-Jan-2017
  • (2017)Online Multi-label Passive Aggressive Active Learning Algorithm Based on Binary RelevanceNeural Information Processing10.1007/978-3-319-70139-4_26(256-266)Online publication date: 14-Nov-2017
  • (2016)Online Asymmetric Active Learning with Imbalanced DataProceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining10.1145/2939672.2939854(2055-2064)Online publication date: 13-Aug-2016
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media