Testing of Horn Samplers

Document Type

Conference Article

Publication Title

Proceedings of Machine Learning Research

Abstract

Sampling over combinatorial spaces is a fundamental problem in artificial intelligence with a wide variety of applications. Since state-of-the-art techniques heavily rely on heuristics whose rigorous analysis remain beyond the reach of current theoretical tools, the past few years have witnessed interest in the design of techniques to test the quality of samplers. The current state-of-the-art techniques, Barbarik and Barbarik2, focus on the cases where combinatorial spaces are encoded as Conjunctive Normal Form (CNF) formulas. While CNF is a general-purpose form, often techniques rely on exploiting specific representations to achieve speedup. Of particular interest are Horn clauses, which form the basis of the logic programming tools in AI. In this context, a natural question is whether it is possible to design a tester that can determine the correctness of a given Horn sampler. The primary contribution of this paper is an affirmative answer to the above question. We design the first tester, Flash, which tests the correctness of a given Horn sampler: given a specific distribution I and parameters η, ε, and δ, the tester Flash correctly (with probability at least 1 - δ) distinguishes whether the underlying distribution of the Horn-sampler is “ε-close” to I or “η-far” from I by sampling only Oe(tilt3/(η - ε)4) samples from the Horn-sampler, where the tilt is the ratio of the maximum and the minimum (non-zero) probability masses of I. We also provide a prototype implementation of Flash and test three state-of-the-art samplers on a set of benchmarks.

First Page

1301

Last Page

1330

Publication Date

1-1-2023

This document is currently not available here.

Share

COinS