Integration of Models and Data for Inference about Humans and Machines
To bridge the verification and explainability gap of datadriven approaches: We will investigate statistical, mathematical and computational tools that capture realistic prior knowledge about the underlying physical and social process in intelligent behavior to alleviate the burden of training data in learning, underwrite guarantees about system performance, or constrain inference in real time.
Research Highlights
1. Bayesian Methods for Inverse Scattering Problems
Computer experiments, the studies of real systems using mathematical models such as partial differential equations, have received increasing attention in science and engineering for the analysis of complex problems. Typically, computer experiments require a great deal of time and computing. Therefore, based on a finite sample of computer experiments, it is crucial to build a surrogate for the actual mathematical models and use the surrogate for prediction, inference, and optimization. The Gaussian process (GP) model, also called kriging, is a widely used surrogate model due to its flexibility, interpolating property, and the capability of uncertainty quantification through the predictive distribution.
Despite extensive studies on GP modeling, the developments for functional inputs are scarce. Motivated by an inverse scattering problem, where the computer simulations involve functional inputs and therefore the analysis and inference rely on a surrogate model that can take into account functional inputs. Figure 1 illustrates the idea of inverse scattering. Let the functional input g represent the material properties of an inhomogeneous isotropic scattering region of interest shown in the middle of Figure 1. For a given functional input, the farfield pattern, us, is obtained by solving partial differential equations which is computationally intensive. Given a new farfield pattern, the goal of inverse scattering is to recover the functional input using a surrogate model. Therefore, a crucial step to address this problem is to develop a surrogate model applicable to functional inputs.
Problems with functional inputs are frequently found in engineering applications of nondestructive testing where measurements on the surface or exterior of an object is used to infer the interior structure. To address these problems, we introduce a new class of kernel functions for GPs with functional inputs. Based on the proposed GP models, the asymptotic convergence rates of the resulting mean squared prediction errors (MSPE) are rigorously derived. Inspired by the connection between the design of the input functions and the resulting convergence rates of MSPE, new classes of spacefilling design ideas are developed in this research. Furthermore, based on the proposed GP surrogate, we will explore a Bayesian inverse framework and a calibration procedure to efficiently identify the functional input given an observed farfield pattern.
2. Statistical Properties of Decision Trees and Random Forests
In answering a major open question, our findings show that decision trees constructed with Classification and Regression Trees (CART) are consistent for regression and classification tasks, even when the number of predictor variables grows subexponentially with the sample size, under natural 0norm and 1norm sparsity constraints. The theory applies to a wide range of models, including generalized additive models with component functions that are continuous, of bounded variation, or, more generally, Borel measurable. Consistency holds for arbitrary joint distributions of the predictor variables, thereby accommodating continuous, discrete, and/or dependent data. Furthermore, it is also showed that these qualitative properties of individual trees are inherited by Breiman’s random forests.
Theory for variants of popular variable importance/ranking measures is also developed in this research. Decision trees and their ensembles are endowed with a rich set of diagnostic tools for ranking and screening variables in a predictive model. Despite the widespread use of tree based variable importance measures, pinning down their theoretical properties has been challenging and therefore largely unexplored. To address this gap between theory and practice, we derived finite sample performance guarantees for variable selection in nonparametric models using a singlelevel CART decision tree (a decision stump). Under standard operating assumptions in variable screening literature, the marginal signal strength of each variable and ambient dimensionality can be considerably weaker and higher, respectively, than stateoftheart nonparametric variable selection methods (such as Nonparametric Independence Screening (NIS)). Furthermore, unlike previous marginal screening methods that attempt to directly estimate each marginal projection via a truncated basis expansion, the fitted model used here is a simple, parsimonious decision stump, thereby eliminating the need for tuning the number of basis terms.
3. Building Datadriven Models of Human Communication and Using Them to Assess and Improve Humancomputer Interaction
Matthew Stone in collaboration with PhD students Brian McMahan and Baber Khalid has improved the methodology for building datadriven models of human communication and to use them to assess and improve humancomputer interaction. McMahan and Stone (2020) report a new, latentvariable approach to quantify corpusbased evidence of the diverse kinds of reasoning speakers employ. These models can be used to recognize not only what speakers are thinking of but what communicative strategy they are following; Khalid, Alikhani and Stone (2020) show how they can be leveraged in a reinforcement learning approach to dialogue planning. This enables interactive systems to give targeted, effective feedback, using contextsensitive clarification strategies that focus on key missing information, elicit correct answers that the system understands, and contribute to increasing dialogue success. Our ongoing work (currently under review) looks at integrating these empirical methods with best practices for humancentered design and software engineering to create new dialogue functionality. The project has shared the outcomes of this work including code, data and visualizations.
McMahan and Stone https://aclanthology.org/2020.sigdial1.22/
Khalid, Alikhani and Stone https://aclanthology.org/2020.colingmain.391/
Papers

TITLE, by AUTHORS, in MEDIUM, PUBLISHER, 2020, [pdf] [bib]
@article{BIBNAME,
author={},
title={},
journal={},
year={2020},
}  Inference with Mondrian random forests, by M. D. Cattaneo, J. M. Klusowski, and W. Underwood, Submitted, 2023.
 Error reduction from stacked regressions, by X. Chen, J. M. Klusowski, and Y. S. Tan, Submitted, 2023.
 Robust Transfer Learning with Unreliable Source Data, by J. Fan, C. Gao, and J. M. Klusowski, Submitted, 2023.
 On the implicit bias of Adam, by M. D. Cattaneo, J. M. Klusowski, and B. Shigida, 2023.
 Sharp convergence rates for matching pursuit, by J. M. Klusowski and J. W. Siegel, Revise and resubmit at IEEE Transactions on Information Theory, 2023.
 Convergence rates of oblique regression trees for flexible function libraries, by M. D. Cattaneo, R. Chandak, and J. M. Klusowski, Major revision at Annals of Statistics, Revision submitted, 2023.
 On the pointwise behavior of recursive partitioning and its implications for heterogeneous causal effect estimation, by M. D. Cattaneo, J. M. Klusowski, and P. M. Tian, Submitted, 2022.
 Large scale prediction with decision trees, by J. M. Klusowski and P. M. Tian, Journal of the American Statistical Association, 2022.
 Sparse learning with CART for noiseless regression models, by J. M. Klusowski, To appear in IEEE Transactions on Information Theory, 2022.
 Characterizing the SLOPE Tradeoff: A Variational Perspective and the Donoho–Tanner Limit, by Z. Bu, J. M. Klusowski, C. Rush, W. J. Su, Annals of Statistics, 2022.
 Inverse Scattering Theory and Transmission Eigen values, by F. Cakoni, D. Colton and H. Haddar, Second Edition, CBMSNSF Regional Conference Series in Applied Mathematics, 98, SIAM Publications, 2023.
 On the Regularity of NonScattering Anisotropic Inhomogeneities, by F. Cakoni, M. Vogelius and J. Xiao, Archive for Rational Mechanics and Analysis. 247 no 3, paper 31, 2023.
 A spectral target signature for thin surfaces, Inverse Problems and Imaging, by F. Cakoni, H. Lee and P. Monk, 16 14731500, 2022.
 Far field broadband approximate cloaking for the Helmholtz equation with a DrudeLorenz refractive index, by F. Cakoni, N. Hovsepyan and M. Vogelius, Journal de Mathematiques Pures et Applique, (accepted)
 Fast imaging of local perturbations in an unknown biperiodic layered medium, by F. Cakoni, H. Haddar and TP Nguyen, J. Computational Physics, submitted
 Efficient Calibration for Imperfect Epidemic Models with Applications to the Analysis of COVID19, by C.L. Sung and Ying Hung, the Journal of Royal Statistical Society: Series C, 2023, to appear.
 FunctionalInput Gaussian Processes with Applications to Inverse Scattering Problems, by W. Wang, C.L. Sung, Ying Hung, I. Harris, and F. Cakoni, Statistica Sinica, 2023, to appear.
 Socially Responsible Facial Recognition of Animals, by Fred S. Roberts, AI and Ethics, 2023, (https://doi.org/10.1007/s4368102300344y)[url]
 FunctionalInput Gaussian Processes with Applications to Inverse Scattering Problem, by W. Wang, C.L. Sung, Ying Hung, I. Harris, and F. Cakoni, submitted, 2022.
 Model Identification and Control of a Lowcost Mobile Robot with Omnidirectional Wheels using Differentiable Physics by Edgar Granados, Abdeslam Boularias, Kostas Bekris and Mridul Aanjaneya, to appear in ICRA 2022, 2022.
 Sparse learning with CART for noiseless regression models, by J. M. Klusowski, to appear in IEEE Transactions on Information Theory, 2022.
 Large scale prediction with decision trees, by J. M. Klusowski, Reject and resubmit to Journal of the American Statistical Association, 2022.
 Optimal Simulator Selection, by Y. Hung, L.H. Lin, and C. F. J. Wu (2022), the Journal of American Statistical Association, to appear.
 A perturbation problem for transmission eigenvalues, by D. Ambrose, F. Cakoni and S. Moskow (2022), Research in the Mathematical Sciences (in press).
 Singularities almost always scatter: Regularity results for nonscattering inhomogeneities, by F. Cakoni and M. Vogelius (2022), Communication on Pure and Applied Mathematics, (in press).
 Nonparametric variable screening with optimal decision stumps, by J. M. Klusowski and P. M. Tian, AISTATS, 2021.
 Good classifiers are abundant in the interpolating regime, by R. Theisen, J. M. Klusowski, M. W. Mahoney, AISTATS, 2021.
 Sharp analysis of a simple model for random forests, J. M. Klusowski, AISTATS, 2021.
 Characterizing the SLOPE Tradeoff: A Variational Perspective and the Donoho–Tanner Limit, by Z. Bu, J. M. Klusowski, C. Rush, W. J. Su, Revise and resubmit to Annals of Statistics, 2021.
 Bayesian Indicator Selection Approach for the Gaussian Process Models in Computer Experiments, by F. Zhang, R.B. Chen, Ying Hung, and X. Deng (2021), submitted.
 Efficient Calibration for Imperfect Epidemic Models with Applications to the Analysis of COVID19, by C.L. Sung and Ying Hung (2021), revision submitted to the Journal of Royal Statistical Society, Series C.
 Varying Coefficient Frailty Models with Applications in Single Molecular Experiments, by Ying Hung, L.H. Lin, and C. F. J. Wu (2021), Biometrics, 78, 474486.
 A spectral approach to nondestructive testing via electromagentic waves, by F. Cakoni, S. Cogar and P. Monk (2021), IEEE, Transactions on Antennas and Propagation 69, no 12, 86898697.
 Transmission Eigenvalues, by F. Cakoni, D. Colton and H. Haddar (2021), AMS Notices, October Issue, 68 no 9, 14991510.
 A note on transmission eigenvalues in electromagnetic scattering theory, by F. Cakoni, S. Meng and J. Xiao (2021), Inverse Problems and Imaging 15 no. 5, 999–1014.
 Analysis of the linear sampling method for imaging penetrable obstacles in the time domain, by F. Cakoni, P. Monk and V. Selgas (2021), Analysis & PDEs, 4 no. 3, 667–688.
 The interior transmission eigenvalue problem for elastic waves in media with obstacles, by F. Cakoni, PZ Kow and JN Wang ((2021), Inverse Problems and Imaging, 15 no. 3, 445474.
 On corner scattering for operators of divergence form and applications to inverse scattering, by F. Cakoni, J. Xiao (2021), Comm. PDEs, 46, no. 3, 413441.
 On the discreteness of transmission eigenvalues for the Maxwell equation, by F. Cakoni, H.M. Nguyen (2021), SIAM J. Math Analysis, 53, no. 1, 888913.
 Target signatures for thin surfaces, by F. Cakoni, P. Monk and Y. Zhang (2021), Inverse Problems 38 025011.
 A Generalized Gaussian Process Model for Computer Experiments with Binary Time Series, by C.L. Sung, Y. Hung, W. Rittase, C. Zhu, and C. F. J. Wu (2020), the Journal of American Statistical Association, 115, 945956.
 Calibration for Computer Experiments with Binary Responses, by C.L. Sung, Y. Hung, W. Rittase, C. Zhu, and C. F. J. Wu (2020), the Journal of American Statistical Association, 115, 16641674.
 Subspace Differential Privacy, by Jie Gao, Ruobin Gong, FangYi Yu, Proceedings of the 36th AAAI Conference on Artificial Intelligence (AAAI22), February 22March 1st, 2022.
 Logtime Prediction Markets for Interval Securities, by Miroslav Dudík, Xintong Wang, David M. Pennock, David M. Rothschild, AAMAS 2021: 465473
 Towards a Theory of Confidence in MarketBased Predictions, by Rupert Freeman, David M. Pennock, Daniel M. Reeves, David M. Rothschild, Bo Waggoner, ISIPTA 2021: 365368
 Designing a Combinatorial Financial Options Market, by Xintong Wang, David M. Pennock, Nikhil R. Devanur, David M. Rothschild, Biaoshuai Tao, Michael P. Wellman, EC 2021: 864883
 Beating Greedy For Approximating Reserve Prices in MultiUnit VCG Auctions, by Mahsa Derakhshan, David M. Pennock, Aleksandrs Slivkins, SODA 2021: 10991118

Varying coefficient Frailty Models with applications in single molecular experiments, by Ying Hung, L.H. Lin, and C.F.J. Wu, under review in Biometrics, 2020, [bib]
@article{hung2020varying,
author={Ying Hung and L.H. Lin and C.F.J. Wu},
title={Varying coefficient Frailty Models with applications in single molecular experiments},
year={2019},
} 
Optimal Crossover Designs for Quantitative Variables, by Ying Hung and L. Wang, under review, 2019, [bib]
@article{hung2019optimal,
author={Ying Hung and L. Wang},
title={Optimal Crossover Designs for Quantitative Variables},
year={2019},
} 
Gaussian Process prediction using experimental designbased Subagging, by L. He and Ying Hung, under review, 2019, [bib]
@article{he2019gaussian,
author={L. He and Ying Hung},
title={Gaussian Process prediction using experimental designbased Subagging},
year={2019},
} 
A sequential splitandconquer approach for the analysis of big dependent data in computer experiments, by Chengrui Li, Ying Hung, and Minge Xie, in The Canadian Journal of Statistics, Wiley Online Library, 2020, [pdf] [bib]
@article{li2020sequential,
title={A sequential splitandconquer approach for the analysis of big dependent data in computer experiments},
author={Chengrui Li and Ying Hung and Minge Xie},
journal={Canadian Journal of Statistics},
publisher={Wiley Online Library},
year={2020}
} 
Discourse Coherence, Reference Grounding and Goal Oriented Dialogue, by Baber Khalid, Malihe Alikhani, Michael Fellner, Brian McMahan, and Matthew Stone, in The 24th Workshop on the Semantics and Pragmatics of Dialogue (Semdial), 2020, [pdf] [bib]
@article{khalid2020discourse,
title={Discourse Coherence, Reference Grounding and Goal Oriented Dialogue},
author={Baber Khalid and Malihe Alikhani and Michael Fellner and Brian McMahan and Matthew Stone},
journal={The 24th Workshop on the Semantics and Pragmatics of Dialogue},
year={2020}
} 
Analyzing Speaker Strategy in Referential Communication, by Brian McMahan and Matthew Stone, in Proceedings of the 21th Annual Meeting of the Special Interest Group on Discourse and Dialogue, 2020, [pdf] [git] [vid] [bib]
@inproceedings{mcmahan2020analyzing,
title={Analyzing Speaker Strategy in Referential Communication},
author={Brian McMahan and Matthew Stone},
booktitle = {Proceedings of the 21th Annual Meeting of the Special Interest Group on Discourse and Dialogue},
month = jul,
year = {2020},
address = {1st virtual meeting},
publisher = {Association for Computational Linguistics},
url = {https://www.aclweb.org/anthology/2020.sigdial1.22},
pages = {175–185}
} 
That and There: Judging the Intent of Pointing Actions with Robotic Arms, by Malihe Alikhani, Baber Khalid, Rahul Shome, Chaitanya Mitash, Kostas Bekris and Matthew Stone, in Proceedings of AAAI, 2020, [pdf] [git] [bib]
@inproceedings{alikhani2020pointing,
title={That and There: Judging the Intent of Pointing Actions with Robotic Arms.},
author={Malihe Alikhani and Baber Khalid and Rahul Shome and Chaitanya Mitash and Kostas Bekris and Matthew Stone},
booktitle={Proceedings of AAAI},
pages={10343–10351},
year={2020}
} 
Crossmodal Coherence Modeling for Caption Generation, by Malihe Alikhani, Piyush Sharma, Shengjie Li, Radu Soricut and Matthew Stone, in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020, [pdf] [git] [bib]
@inproceedings{alikhani2020clue,
title = {Crossmodal Coherence Modeling for Caption Generation},
author={Malihe Alikhani and Piyush Sharma and Shengjie Li and Radu Soricut and Matthew Stone},
booktitle = {Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics},
month = jul,
year = {2020},
address = {Online},
publisher = {Association for Computational Linguistics},
url = {https://www.aclweb.org/anthology/2020.aclmain.583},
pages = {6525–6535}
} 
Sparse learning with CART, by Jason M. Klusowski, NeurIPS, 2020, [pdf] [bib]
@article{klusowski2020sparse,
author={Jason M Klusowski},
title={Sparse learning with CART},
journal={NeurIPS},
year={2020},
} 
Good linear classifiers are abundant in the interpolating regime, by Ryan Theisen and Jason M. Klusowski and Michael W. Mahoney, arXiv preprint, 2020, [pdf] [bib]
@article{theisen2020good,
title={Good linear classifiers are abundant in the interpolating regime},
author={Ryan Theisen and Jason M Klusowski and Michael W Mahoney},
journal={AISTATS},
year={2021}
} 
Limiting Boundary Correctors for Periodic Microstructures and Inverse Homogenization Series, by Fioralba Cakoni, Shari Moskow, and Tayler Pangburn, in Inverse Problems, IOP Publishing, 2020, [pdf] [bib]
@article{cakoni2020periodic,
author={Fioralba Cakoni and Shari Moskow and Tayler Pangburn},
title={Limiting Boundary Correctors for Periodic Microstructures and Inverse Homogenization Series},
journal={Inverse Problems},
month={jun},
year={2020},
publisher={{IOP} Publishing},
volume={36},
number={6},
pages={065009}
}
Presentations
 Recent advances in decision tree and random forest theory, session organizer and speaker – by Jason Klusowski at 2023 Joint Statistical Meetings (JSM), August 10, 2023.
 Invited Session Speaker – by Jason Klusowski at 2023 Joint Statistics and Data Science Meeting (CJSM), July 1113, 2023.
 Invited Seminar Speaker – by Jason Klusowski at Instacart, Economics Group, June 5, 2023.
 Invited Seminar Speaker – by Jason Klusowski at Princeton University, Department of Economics, April 11, 2023.
 Invited Webinar Presentation – by Jason Klusowski at American Statistical Association, Section on Statistical Learning and Data Science, March 30, 2023.
 Invited Seminar Speaker – by Jason Klusowski at Cornell University, Department of Statistics and Data Science, March 22, 2023.
 Invited Seminar Speaker – by Jason Klusowski at SUNY Binghamton, Department of Mathematics and Statistics, March 21, 2023.
 Invited Seminar Speaker – by Jason Klusowski at University of Sydney Business School, Business Analytics, February 23, 2023.
 Invited Seminar Speaker – by Jason Klusowski at George Mason University, Department of Statistics, November 18, 2022.
 Plenary Speaker at the Workshop on Mathematical Trends in Medical Imaging – by Fioralba Cakoni at University of Chicago, Chicago, USA, August 710, 2023.
 Minicourse, Math@NTUA Summer School – by Fioralba Cakoni at Athens, Greece, June 2630, 2023.
 Plenary Rich and Nonlinear Tomography – a Multidisciplinary Approach – by Fioralba Cakoni at Isaac Newton Institute, Cambridge, UK, June 1923, 2023.
 Plenary Speaker at Mathematical and Applications of Multiple Waves Scattering – by Fioralba Cakoni at Isaac Newton Institute, Cambridge, UK, May 2226, 2023.
 Plenary Speaker at Spectral Geometry and Applications – by Fioralba Cakoni at CRM, Quebec City, Canada, May 812, 2023.
 Plenary Speaker at RIMS Workshop on Inverse Problems, Medical Imaging and Related Topics – by Fioralba Cakoni at Kyoto Japan, January 1013, 2023.
 Plenary Speaker at Inverse Problems in Analysis and Geometry – by Fioralba Cakoni at Helsinki, Finland, August 15, 2022.
 IMPA Summer School on Mathematical Methods in Data Analysis – by Fioralba Cakoni at Tirana, Albania July 1829, 2022.
 speaker and coorganizer at Integral Equations and Applications – by Fioralba Cakoni at Summer Graduate School, MSRI Berkeley, USA, June 0617, 2022 (6lecture course).
 Colloquium at Center for Applicable Mathematics – by Fioralba Cakoni at School of Mathematics of the Tata Institute of Fundamental Research, via Zoom Mumbai, India, January 18, 2022.
 International Zoom Inverse Problems Seminar – by Fioralba Cakoni at UC Irvine, California, USA , October 7, 2021.
 Colloquium – by Fioralba Cakoni at the University of Arizona, Tucson, Arizona, September 3, 2021.
 Special Semester Tomography Across the Scales Prequel Workshop – by Fioralba Cakoni at RICAM, Linz, Austria, October 1115, 2021.
 Plenary Speaker at the 6th Annual Meeting of SIAM Central States Section – by Fioralba Cakoni at The University of Kansas, USA, October 23, 2021.
 Rees Distinguished Lectures twolecture series – by Fioralba Cakoni at the University of Delaware, USA, April 2930, 2021.
 Imagine & Inverse Problems: One World Seminar – by Fioralba Cakoni at SIAG IS via Zoom, April 14. 2021.
 Workshop on Tomographic Reconstructions and their Startling Applications – by Fioralba Cakoni at Schrodinger International Institute for Mathematics and Physics, Vienna, Austria via Zoom, March 15 – 25, 2021.
 Distinguished Lecture at Michigan Technological Institute – by Fioralba Cakoni via Zoom, March 5, 2021.
 Colloquium at Center for Applicable Mathematics, School of Mathematics of the Tata Institute of Fundamental Research – by Fioralba Cakoni via Zoom, Mumbai, India, January 18, 2022.
 International Zoom Inverse Problems Seminar – by Fioralba Cakoni via Zoom, UC Irvine, California, USA, October 7, 2021.
 Colloquium at the University of Arizona – by Fioralba Cakoni via Zoom, Tucson, Arizona, September 3, 2021.
 Colloquium at Michigan University – by Fioralba Cakoni via Zoom, East Lansing, Michigan, March 22, 2021.
 Colloquium at the University of Padova – by Fioralba Cakoni via Zoom, Italy, March 3, 2021.
 A TwoStage Framework for Constraint Optimization in Computer Experiments with Applications in Materials Science – paper presentation by Jiazhao Zhang and Ying Hung at Joint Statistical Meetings, August 6, 2020 [url]
 Optimization of ReaxFF Parameters – seminar talk by Yao Song, Ying Hung, and Tirthankar Dasgupta at Joint Statistical Meetings, August 5, 2020 [url]
 – seminar talk by at , DATE [SLIDES]
 Good Linear Classifiers Are Abundant in the Interpolating Regime – paper presentation by Jason Klusowski at Joint Statistical Meetings, August 5, 2020 [url]
 Spectral problems in Inverse Scattering for Inhomogeneous media – colloquium by Fioralba Cakoni at University of Maryland, October 31, 2019
 Transmission Eigenvalues and inverse scattering – colloquium by Fioralba Cakoni at New York University, Abu Dhabi, UAE, February 9, 2020
 Transmission Eigenvalues and invisibility in Euclidean and Hyperbolic geometry – seminar talk by Fioralba Cakoni at International Zoom Inverse Problems Seminar, May 7, 2020
 Computational Methods for New Directions in Inverse Problems – workshop talk by Fioralba Cakoni at the Institute for Applied Mathematics and Computational Science, Texas A&M University, February 35, 2020 [url]