Abstract
Machine learning is the essence of machine intelligence. When we have systems that learn, we will have true artificial intelligence. Many machine-learning strategies exist, this paper reviews the state of the art in machine learning and provides a glimpse of the pioneers of present machine-learning systems and strategies. Learning in noisy domains, the evolutionary learning, learning by analogy and explanation-based learning are just some of the methods covered. Emphasis is placed on the algorithms employed by many of the systems, and the merits and disadvantages of various approaches. Finally an examination of VanLehn's theory of impasse-driven learning is made.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Anderson, J. R. (1976) Language, Memory and Thought. Laurence Erlbaum Associates, Hillsdale, N.J.
Anderson, J. R. (1983) The Architecture of Cognition. Harvard University, Cambridge, Mass.
Anzai, Y. & Simon, H. A. (1979) The theory of learning by doing. Psychology Review, 86, 124–140.
Brieman, L., Friedman, J. H., Olshen, R. A. & Stone, C. J. (1984) Classification and Regression Trees. Belmont, California: Wadsworth International Group.
Brownowski, J. (1973) The Ascent of Man. British Broadcasting Corporation.
Cestnik, B., Kononenko, I. & Bratko. (1987) ASSISTANT 86: A knowledge elicitation tool for sophisticated users. In Progress in Machine Learning (eds I.Bratko & N.Lavrac). Sigma Press, Wilmslow.
Clark, P. & Niblett, T. (1987) Induction in noisy domains. In Progress in Machine Learning. (eds I.Bratko & N.Lavrac) Sigma Press, Wilmslow.
Desimone, R. (1987) Learning Control Knowledge Within an Explanation-Based Learning Framework. In Progress in Machine Learning (eds. I.Bratko & N.Lavrac). Sigma Press, Wilmslow.
Forgy, C. L. & McDermott, J. (1977) OPS, a domain-independent production system language. Proceedings of the Fifth International Joint Computer Cinference, MIT AI Laboratory, Cambridge MA.
Forsyth, R. (1981) BEAGLE: a Darwinian approach to putter recognition Kybernetics, 10, 159–166.
Forsyth, R. & Rada, R. (1986) Machine Learning: Application in Expert System and Information retrieval. London, Wiley.
Gams, M. & Lavrac, N. (1987) Review of five empirical learning Systems within a proposed schemata. In Progress in Machine Learning. (eds. I.Bratko & N.Lavrac). Sigma Press, Wilmslow.
Hunt, E. (1966) Experiments in Induction. Academic Press, New York.
Keane, M. T. (1988) Analogical Problem Solving. Ellis Horwood, Chichester.
Kononenko, I., Bratko, I. & Roskar, E. (1984) Experiments in automatic learning of medical diagnostic rules. Technical Report, Jozef Stefan Institute, Ljubljana, Yugoslavia.
Laird, J. E., Newell, A. & Rosenbloom, P. S. (1986) SOAR: An architecture for general intelligence, Artificial Intelligence, Vol 1 p.1–64.
Langley, P. (1987) A general theory for discrimination learning. In Production System Models of Learning and Development (eds D.Klahr, P.Langley & R.Neches). MIT, Cambridge, Mass.
Lenat, D. B. (1976) AM: An artificial intelligence approach to discovery in mathematics as heuristic search. In Knowledge-based Systems in Artificial Intelligence (eds R.Davis & D. B.Lenat, 1980). McGraw-Hill, New York.
Lenat, D. B. (1983) The role of Heuristics in learning by discovery: case study 2: The EURISKO program; Heuristics used to develop new heuristics. In Machine Learning an Artificial Intelligene Approach (eds R.Michalski, J.Carbonell & T.Mitchell). Morgan Kaufmann, California.
McDonald, C. G. (1987) Children's Errors in Subtraction: A rational reconstruction. Unpublished departmental research reportno. 8. Oxford Polytechnic, U.K.
Michalski, R. S. & Larson, J. B. (1978) Selection of most representative training examples and incremental generation of VL1 hypotheses: the underlying methodology and description of programs ESEL and AQ11, Report 867, University of Illinois.
Michalski, R. S. & Negri, P. G. (1977) An experiment on inductive learning in chess end games. In Machine Intelligence. (eds E. W.Elcock & D.Michie) Wiley, U.K.
Michalski, R. S., Mozetic, I., Hong, J. & Lavrac, N. (1986) The multi-purpose incremental learning system AQ15 and its testing application to three medical domains. Proceedings of AAAI-86, Philadelphia.
Mitchell, T. M., Keller, R. M. & Kedar-Cabelli, S. T. (1986) Explanation-Based Generalisations: A Unifying View, Machine Learning, 1, 47–80.
Mostow, D. J. (1981) Mechanical transformation of task heurstics into operational procedures. Report number CS-81–113, Computer Science Department, Carnegie-Mellon University, cited In T. Dietterich, Learning and inductive inference, In The Handbook of Artificial Intelligence, Vol 3, (eds P.Cohen & E.Feigenbaum, 1982). Stanford: Pitman.
Murray, R. N. & Gbedemah, G. L. (1983) Foundations of Education in the Caribbean. Hodder & Stoughton, London.
Nealon, J. L. (1985) Description, critical review and proposed development of the ID3 algorithm. Unpublished departmental reportNo. 14, Oxford Polytechnic, UK.
Neches, R., Langley, P., Klahr, D. (1987) Learning, development and production systems. In Production System Models of Learning and Development (eds D. P.Langley & R.Neches). MIT, Cambridge, Mass.
Newell, A. (1973) Production systems: Models of control structures. In Visual Information Processing, (ed. Chase, W. C.), Academic Press, New York, pp. 360–414.
Newell, A. & Simon, H. A. (1972) Human Problem Solving. Prentice-Hall, Englewood Cliffs.
Schank, R. (1982) Dynamic Memory: A theory of learning in computers and people. Cambridge University Press, Cambridge.
VanLehn, K. (1987a) Towards a Theory of Impasse-driven Learning. Technical report PCG-1, Carnegie-Mellon University, Pittsburg.
VanLehn, K. (1987b) Flexible execution of cognitive procedures. Technical report PCG-5, Carnegie-Mellon University, Pittsburg.
Winston, P. H. (1980) Learning and Reasoning by analogy. CACM Vol. 23, No. 12.
Winston, P. H. (1984) Artificial Intelligence, MIT, Addison-Wesley, Reading, Mass.
Young, R. (1979) Production Systems for modelling Human Cognition. In Expert Systems in the Microelectronic Age (ed. D. Michie), pp. 35–45, Edinburgh University Press.
Young, R. & O'Shea, T. Children's Errors in Subtraction, Cognitive Science, 1981, 153–177.
Further Reading
Brown, J. S. & VanLehn, K. (1980) Repair Theory: A generative theory of bugs in procedural skills. Cognitive Science, 4, 379–426.
Clancey, W. J. (1983) The epistemology of a rule-based expert system: A framework for explanation. Artificial Intelligence, 20, 215–251.
Dietterich, T. G. & Michalski, R. S. (1981) Inductive learing of structural descriptions: Evaluation criteria and comparative review of selected methods. Artificial Intelligence, 16, 257–294.
Fahlman, S. (1979) NETL: A system for representing and using Real World Knowledge. MIT, Cambridge, Mass.
Kintsch, W. & Greeno, J. G. (1985) Understanding and Solving Word Arithmetic Problems, Psychological Review, 92, No. 1, 109–129.
Klahr, D., Langley, P. & Neches, R. (1987) Production System Models of Learning and Development. MIT, Cambridge, Mass.
McClelland, J. L., Rumelhart, D. and the PDP Research Group (1986) Parallel Distributed Processing. MIT, Cambridge, Mass.
McDermott, J. & Forgy, C. (1978) Production System Conflict Resolution Strategies. In Pattern Directed Inference Systems. (eds D. A.Waterman & F.Hayes-Roth), Academic Press, New York.
McDonald, C. G. (1988) Production Systems as cognitive models of Human Problem Solving, M.Phil. Thesis, Oxford Polytechnic, UK.
Newell, A., Shaw, J. C. & Simon, H. A. (1963) Empirical explorations of the Logic Theory Machine: A case study in heuristics. In Computers and Thought, (eds E.Feigenbaum & J.Feldman), McGraw-Hill, New York.
Newell, A., Shaw, J. C. & Simon, H. A. (1960) Report on a general problem solving program for a computer. In Information Processing: Proceedings of the International Conference on Information Processing, UNESCO, Paris, 256–264.
Quinlan, J. R. (1979) Discovering rules by induction from large collections of examples. In Expert Systems in the Microelectronic Age (ed. D.Michie), Edinburgh University Press, Edinburgh.
VanLehn, K. (1981) On the Representation of Procedures in Repair Theory. In The Development of Mathematical Thinking. (ed H. P.Ginsburg), Erlbaum, Hillsdale, NJ.
Ward, P. & Mellor, S. (1988) Structured Development for Real-Time Systems. Vol. 1. Yourdon Press, Englewood Cliffs, New Jersey.
Winston, P. H. (1975) Learning structural descriptions from examples. In The Psychology of Computer Vision. (ed. P. H.Winston), McGraw-Hill, New York.
Woods, P. & Hartley, J. R. (1971) Some learning models for arithmetic tasks and their use in computer based learning. British Journal of Educational Psychology, 41, 39–48.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
McDonald, C. Machine learning: a survey of current techniques. Artif Intell Rev 3, 243–280 (1989). https://doi.org/10.1007/BF00141197
Issue Date:
DOI: https://doi.org/10.1007/BF00141197