Summary Learning Sets of Rules

Learning Sets of Rules

[Read Ch. 10]
[Recommended exercises 10.1, 10.2, 10.5, 10.7, 10.8]
 Sequential covering algorithms
 FOIL
 Induction as inverse of deduction
 Inductive Logic Programming




229 lecture slides for textbook Machine Learning, T. Mitchell, McGraw Hill, 1997

, Learning Disjunctive Sets of Rules

Method 1: Learn decision tree, convert to rules
Method 2: Sequential covering algorithm:
1. Learn one rule with high accuracy, any coverage
2. Remove positive examples covered by this rule
3. Repeat




230 lecture slides for textbook Machine Learning, T. Mitchell, McGraw Hill, 1997

, Sequential Covering Algorithm

Sequential-
covering(Target attribute; Attributes; Examples; Thres
 Learned rules fg
 Rule learn-one-
rule(Target attribute; Attributes; Examples)
 while performance(Rule; Examples)
> Threshold, do
{ Learned rules Learned rules + Rule
{ Examples Examples ? fexamples
correctly classi ed by Ruleg
{ Rule learn-one-
rule(Target attribute; Attributes; Examples)
 Learned rules sort Learned rules accord to
performance over Examples
 return Learned rules


231 lecture slides for textbook Machine Learning, T. Mitchell, McGraw Hill, 1997