Incremental rule learning with partial instance memory for changing concepts

Marcus A. Maloof

Learning concepts that change over time is important for a variety of applications in which an intelligent system must acquire and use a behavioral profile. Computer intrusion detection, calendar scheduling, and intelligent user interfaces are three examples. An interesting class of methods for learning such concepts consists of algorithms that maintain a portion of previously encountered examples. Since concepts change over time and these methods store selected examples, mechanisms must exist to identify and remove irrelevant examples of old concepts. In this paper, we describe an incremental rule learner with partial instance memory, called AQ11-PM+WAH, that uses Widmer and Kubat's heuristic to adjust dynamically the window over which it retains and forgets examples. We evaluated this learner using the STAGGER Concepts and made direct comparisons to AQ-PM and to AQ11-PM, similar learners with partial instance memory. Results suggest that the forgetting heuristic is not restricted to FLORA2, the learner for which it was originally designed. Overall, results from this study and others suggest learners with partial instance memory converge more quickly to changing target concepts than algorithms that learn solely from new examples.

This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Paper available in PostScript (gzipped) and PDF.

Slides from the talk available in PostScript (gzipped) and PDF.

Maloof, M.A. (2003). Incremental rule learning with partial instance memory for changing concepts. Proceedings of the International Joint Conference on Neural Networks, 2764&ndash2769. Los Alamitos, CA: IEEE Press.

@inproceedings{maloof.ijcnn.03,
  author = "Maloof, M.A.",
  title = "Incremental rule learning with partial instance memory
    for changing concepts",
  booktitle = "{Proceedings of the International Joint Conference
    on Neural Networks (IJCNN '03)}",
  year = 2003,
  pages = "2764--2769",
  publisher = "IEEE Press",
  address = "Los Alamitos, CA",
  annote = {
  }}