Selecting examples for partial memory learning

Marcus A. Maloof and Ryszard S. Michalski

This paper describes a method for selecting training examples for a partial memory learning system. The method selects extreme examples that lie at the boundaries of concept descriptions and uses these examples with new training examples to induce new concept descriptions. Forgetting mechanisms also may be active to remove examples from partial memory that are irrelevant or outdated for the learning task. Using an implementation of the method, we conducted a lesion study and a direct comparison to examine the effects of partial memory learning on predictive accuracy and on the number of training examples maintained during learning. These experiments involved the STAGGER Concepts, a synthetic problem, and two real-world problems: a blasting cap detection problem and a computer intrusion detection problem. Experimental results suggest that the partial memory learner notably reduced memory requirements at the slight expense of predictive accuracy, and tracked concept drift as well as other learners designed for this task.

Paper available in PostScript (gzipped) and PDF.

Maloof, M.A., & Michalski, R.S. (2000). Selecting examples for partial memory learning. Machine Learning  41:27–52.

@article{maloof.ml.00,
  author = "Maloof, M.A. and Michalski, R.S",
  title = "Selecting examples for partial memory learning",
  journal = "Machine Learning",
  year = 2000,
  volume = 41,
  pages = "27--52"
}