W. Cohen. Journal of Artificial Intelligence Research, (1995)
Abstract
In a companion paper it was shown that the class of constant-depth determinate k-ary recursive clauses is efficiently learnable. In this paper we present negative results showing that any natural generalization of this class is hard to learn in Valiant's model of pac-learnability. In particular, we show that the following program classes are cryptographically hard to learn: programs with an unbounded number of constant-depth linear recursive clauses; programs with one constant-depth determinate clause containing an unbounded number of recursive calls; and programs with one linear recursive clause of constant locality. These results immediately imply the non-learnability of any more general class of programs. We also show that learning a constant-depth determinate program with either two linear recursive clauses or one linear recursive clause and one non-recursive clause is as hard as learning boolean DNF. Together with positive results from the companion paper, these negative results establish a boundary of efficient learnability for recursive function-free clauses.
%0 Journal Article
%1 Cohen95neg
%A Cohen, William W.
%D 1995
%J Journal of Artificial Intelligence Research
%K ilp induction inductive_programming learnability pac-learning program_synthesis
%P 541--573
%T Pac-Learning Recursive Logic Programs: Negative Results
%U http://www.jair.org/vol/vol2.html
%X In a companion paper it was shown that the class of constant-depth determinate k-ary recursive clauses is efficiently learnable. In this paper we present negative results showing that any natural generalization of this class is hard to learn in Valiant's model of pac-learnability. In particular, we show that the following program classes are cryptographically hard to learn: programs with an unbounded number of constant-depth linear recursive clauses; programs with one constant-depth determinate clause containing an unbounded number of recursive calls; and programs with one linear recursive clause of constant locality. These results immediately imply the non-learnability of any more general class of programs. We also show that learning a constant-depth determinate program with either two linear recursive clauses or one linear recursive clause and one non-recursive clause is as hard as learning boolean DNF. Together with positive results from the companion paper, these negative results establish a boundary of efficient learnability for recursive function-free clauses.
@article{Cohen95neg,
abstract = {In a companion paper it was shown that the class of constant-depth determinate k-ary recursive clauses is efficiently learnable. In this paper we present negative results showing that any natural generalization of this class is hard to learn in Valiant's model of pac-learnability. In particular, we show that the following program classes are cryptographically hard to learn: programs with an unbounded number of constant-depth linear recursive clauses; programs with one constant-depth determinate clause containing an unbounded number of recursive calls; and programs with one linear recursive clause of constant locality. These results immediately imply the non-learnability of any more general class of programs. We also show that learning a constant-depth determinate program with either two linear recursive clauses or one linear recursive clause and one non-recursive clause is as hard as learning boolean DNF. Together with positive results from the companion paper, these negative results establish a boundary of efficient learnability for recursive function-free clauses.},
added-at = {2008-12-16T18:18:14.000+0100},
author = {Cohen, William W.},
biburl = {https://www.bibsonomy.org/bibtex/25fead9f790555f93a953445dca444236/emanuel},
interhash = {f874830f7278b2a467ec28e600d2eb85},
intrahash = {5fead9f790555f93a953445dca444236},
journal = {Journal of Artificial Intelligence Research},
keywords = {ilp induction inductive_programming learnability pac-learning program_synthesis},
pages = {541--573},
timestamp = {2008-12-16T18:18:14.000+0100},
title = {Pac-Learning Recursive Logic Programs: Negative Results},
url = {http://www.jair.org/vol/vol2.html},
year = 1995
}