Title :
Learning sparse Boolean polynomials
Author :
Negahban, S. ; Shah, Devavrat
Author_Institution :
Lab. for Inf. & Decision Syst., Massachusetts Inst. of Technol., Cambridge, MA, USA
Abstract :
We are given a Boolean function f : {-1,1}n → R that can be written as a sparse linear combination of s polynomials. The Junta problem cf. [1] is an instance of such a setting. Our goal is to learn the function f by accessing its values at randomly sampled m elements from {-1, l}n. In this paper, we draw connections between the sparse polynomial learning problem and compressed sensing. As a result we provide a convex program that learns an s-sparse polynomial with high probability using m = O(s2n) observations. We contrast this result with the worst case sample-complexity which requires O(n2n) random samples to learn the entire function f. Our results naturally extend to the setting where the data is noisy or f is well approximated by an s-sparse polynomial. Our results also show that the solution adapts to the number of observations and finds a natural approximation given the available information.
Keywords :
Boolean functions; compressed sensing; computational complexity; convex programming; learning (artificial intelligence); polynomials; probability; sampling methods; Boolean function; Junta problem; compressed sensing; convex program; function learning; natural approximation; probability; random samples; s-sparse polynomial; sparse Boolean polynomials; sparse linear combination; sparse polynomial learning problem; worst case sample-complexity; Approximation algorithms; Boolean functions; Compressed sensing; Noise measurement; Polynomials; Vectors;
Conference_Titel :
Communication, Control, and Computing (Allerton), 2012 50th Annual Allerton Conference on
Conference_Location :
Monticello, IL
Print_ISBN :
978-1-4673-4537-8
DOI :
10.1109/Allerton.2012.6483472