<p>Learning minimal interpretable models (e.g., decision trees, decision sets, and binary decision diagrams) is computationally challenging, yet increasingly important in high-stakes settings. We use decision trees as a canonical case study, but the proposed structural parameter is solver-agnostic. Recent parameterized-complexity results show fixed-parameter tractability when parameterized by model size <i>s</i> and a data-dependent conflict parameter <InlineEquation ID="IEq3"> <EquationSource Format="TEX">\(\delta \)</EquationSource> <EquationSource Format="MATHML"><math> <mi>δ</mi> </math></EquationSource> </InlineEquation>, the maximum Hamming disagreement between oppositely labeled examples. We show that <InlineEquation ID="IEq4"> <EquationSource Format="TEX">\(\delta \)</EquationSource> <EquationSource Format="MATHML"><math> <mi>δ</mi> </math></EquationSource> </InlineEquation> is highly noise-sensitive: under small relevant support and independent irrelevant features, <InlineEquation ID="IEq5"> <EquationSource Format="TEX">\(\delta \)</EquationSource> <EquationSource Format="MATHML"><math> <mi>δ</mi> </math></EquationSource> </InlineEquation> typically scales with ambient dimension, making <InlineEquation ID="IEq6"> <EquationSource Format="TEX">\(\delta \)</EquationSource> <EquationSource Format="MATHML"><math> <mi>δ</mi> </math></EquationSource> </InlineEquation>-based branching uninformative. We introduce a distribution-aware alternative, the <i>effective conflict width</i> <InlineEquation ID="IEq7"> <EquationSource Format="TEX">\(\kappa _\tau \)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>κ</mi> <mi>τ</mi> </msub> </math></EquationSource> </InlineEquation>, obtained by restricting conflicts to features whose relevance exceeds a threshold. We instantiate this idea as structure-guided branching (SGB), which branches on relevance-filtered conflict features and safely falls back to full <InlineEquation ID="IEq8"> <EquationSource Format="TEX">\(\delta \)</EquationSource> <EquationSource Format="MATHML"><math> <mi>δ</mi> </math></EquationSource> </InlineEquation>-branching. Using conflict-driven branching simulations to isolate search-tree effects, we find that <InlineEquation ID="IEq9"> <EquationSource Format="TEX">\(\kappa _\tau \)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>κ</mi> <mi>τ</mi> </msub> </math></EquationSource> </InlineEquation> can remain stable as dimension grows and yields substantial reductions in explored search nodes on synthetic data and multiple real datasets. These results suggest structural parameters can improve the noise robustness of exact interpretable learning and can serve as solver-agnostic pruning signals.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Removing \(\delta \)-dependence in minimal interpretable model learning: distribution conditions and structural parameters

  • Zhigao Huang,
  • Shiyan Zheng,
  • Quanfa Li

摘要

Learning minimal interpretable models (e.g., decision trees, decision sets, and binary decision diagrams) is computationally challenging, yet increasingly important in high-stakes settings. We use decision trees as a canonical case study, but the proposed structural parameter is solver-agnostic. Recent parameterized-complexity results show fixed-parameter tractability when parameterized by model size s and a data-dependent conflict parameter \(\delta \) δ , the maximum Hamming disagreement between oppositely labeled examples. We show that \(\delta \) δ is highly noise-sensitive: under small relevant support and independent irrelevant features, \(\delta \) δ typically scales with ambient dimension, making \(\delta \) δ -based branching uninformative. We introduce a distribution-aware alternative, the effective conflict width \(\kappa _\tau \) κ τ , obtained by restricting conflicts to features whose relevance exceeds a threshold. We instantiate this idea as structure-guided branching (SGB), which branches on relevance-filtered conflict features and safely falls back to full \(\delta \) δ -branching. Using conflict-driven branching simulations to isolate search-tree effects, we find that \(\kappa _\tau \) κ τ can remain stable as dimension grows and yields substantial reductions in explored search nodes on synthetic data and multiple real datasets. These results suggest structural parameters can improve the noise robustness of exact interpretable learning and can serve as solver-agnostic pruning signals.