I am a doctoral student at UPenn interested in machine learning. I develop simple algorithms with theoretical guarantees that improve the reliability of artificial intelligence systems. Currently, I am exploring applications to natural language processing, image processing, AI-for-math, and econometrics. I am grateful to be advised by Prof Edgar Dobriban and Prof Hamed Hassani. Previously, I received my bachelor's degree in mathematics from Princeton with highest honors.
In the short term, I am focused on statistical approaches to AI reliability. In the medium term, I would like to explore the mathematical foundations of AI and economics. In the long term, I hope to build AI-powered systems that enable large-scale collaboration, and that help people express their analytical and artistic creativity en masse. I also hope to develop a statistical theory of venture investing.
My email address is sunayj [at] sas.upenn.edu and my desk is in Amy Gutmann Hall. Please reach out via email or social media, I would love to learn from you. (I find collaboration much more fun than working in isolation.) My curriculum vitae can be found here.
I am also fascinated by and excited to learn more about single-cell gene sequencing methods like spatial transcriptomics; structural biology methods like cryo-EM; medical imaging methods like MRI; manifold learning; non-probabilistic and geometric foundations of ML and representation learning; approximation theory for ML; leveraging data symmetry and representation theory in the design of learning algorithms (i.e., neural architectures); treating neurological diseases by analyzing EEG signals and other diagnostics; auditing the medical reasoning of clinical LLMs via statistics; AI for conservation biology; multimodal AI and virtual reality for preserving historical cultures, artefacts, and spaces; auditing AI benchmarks via statistics; optimal control for robotics, macroeconometrics, steering generative AI (LLMs, diffusion models, flow matching models); mathematical statistical mechanics and its relation to probabilistic combinatorics, random matrix theory, and ML theory; the philosophy, foundations, and history of statistics; the precise relation between hierarchical and neural representations of data; analogies between optimization algorithms and stochastic and ordinary differential equations; mathematical and statistical finance and interpretable models of general multi-agent systems like mean-field games, especially in modeling financial crises; delineating the advantages of homogeneous vs heterogeneous agent swarms; network models in statistics; how AI agents handle uncertainty and ambiguity when deployed in complex settings; how to prevent p-hacking and other statistical crimes from being committed by data science AI agents; metacognitive algorithms for improving LLM performance; design choices when learning world models; anonymization and deanonymization of personal data on social media platforms; robustness, distribution shift, and out-of-distribution generalization in statistics and ML; algorithmic primitives for LLM jailbreaking and defenses; understanding why black-box Bayesian optimization works in practice, especially for drug discovery; analogies between statistics and analytic number theory; envisioning a future of "infinite-horizon" clinical trials; natural experiments on networks; leveraging synthetic data in statistics; creating simulacra of human behavior both individual and collaborative by leveraging novel qualitative psychometric factors; the interface of statistics and entrepreneurship, especially in the context of AI evaluation and monitoring; inventing more interactive and continuous modes of human-AI creative collaboration; co-creating personalized and aesthetic educational content using AI; cheaper music education with the help of AI and robotics; rethinking educational evaluation in the age of AI; improving home and public safety via passive AI-powered monitoring systems; extreme event prediction and mitigation; simple and generalizable hacks for boosting our collective physical health, mental health, and creativity; generative user interfaces; and designing scalable and inclusive academic workflows for our collective AI-empowered future.
Latest change: The Definition of Numerical Analysis
Preprints and papers.
Things I wrote, some incomplete.
(More annotations are coming soon. For a few files, I include an Overleaf link; but most are PDFs, because I don't see myself frequently editing them.)
A collection of simple lemmas that are frequently used in proofs in Fourier analysis, when developed using Riemann integration.
A summary of what we covered in Fourier analysis.
A summary of what we covered in measure theory and real analysis.
An incomplete collection of notes from the differential geometry course at Princeton.
These were our differential geometry homework problems. (Some, we never got around to solving.)
An incomplete summary of what we covered in our course on representation theory.
A summary of what we covered in probability theory.
A summary of what we covered in stochastic calculus.
My junior paper at Princeton: the derivation of a differential inequality that sheds light on the critical behavior of the Random Cluster Model (RCM) from statistical physics. The RCM is a dependent generalization of Bernoulli percolation, which has direct connections to the Ising and Potts models of ferromagnetism. The key input is a new concentration inequality for "decision trees" from the theoretical computer science community. I plan to elaborate on the broader role of differential inequalities in the study of phase transitions, as at first glance this might not be clear to the reader. I also plan to rewrite Section 4.1, whose exposition at present is a bit rushed.
One of the most striking results in percolation theory in two dimensions is conformal invariance, which states that when one takes an appropriate scaling limit of Bernoulli percolation on the integer lattice, crossing probabilities are invariant under conformal maps. This junior seminar paper explores implications of conformal invariance. In particular, I derive the crossing probability of an annulus up to constants.
The study of disordered models in statistical mechanics is infamously challenging. The ultimate goal is to understand realistic models of magnets with impurities, like the Edwards--Anderson model; but at present, this is hopelessly out of reach. Here, we instead start with one of the simplest disordered models, the Random Field Ising Model (RFIM), and in this note I present an exposition of the proof that the RFIM does not exhibit a phase transition. The key idea is to treat the free energy as a function of the gaussian external field random variables, and then to leverage gaussian integration by parts and gaussian concentration. Once these are applied, bounding the free energy reduces to combinatorics. I plan on rewriting parts of this.
Incomplete notes on the math of cryo-electron microscopy.
Consider a partially-deterministic control problem where an agent navigates two-dimensional space, switching between multiple kinds of dynamics ("modes"). In this incomplete note, we analyze the convergence of value iterations for computing the value function, both in general, as well as under a monotonicity assumption on the mode transitions.
A summary of what I learned about elliptic curves and their applications to cryptography through Princeton's Directed Reading Program. Many of the cryptographic protocols listed in the report can be performed using an arbitrary abelian group. However, the group of rational points on an elliptic curve has a number of nice properties that can be leveraged.
The incomplete personal notes that were used to prepare the report above. The material on elliptic functions served as motivation for me to learn complex analysis.
Incomplete notes from a talk on the hidden symmetries of algebraic varieties that went straight over my head.
Incomplete notes from a talk on interpolation and its relation to metric geometry.
Incomplete notes from a talk on the relationship between Diophantine equations and optimally navigating the special unitary group, with applications to the design of gates for quantum computing. (I am still trying to find my notes from this talk.)
A gentle overview of the topics covered in the statistical methodology course at Penn, spanning linear models and their geometry, generalized linear models, statistical inference, resampling methods, model misspecification, robust statistics, the basics of multiple hypothesis testing, and quite a few interesting tidbits from the history of statistics (whose early days seem particularly messy and controversial compared to other parts of the mathematical sciences).
A summary of what we covered in mathematical statistics.
Handwritten notes from the mathematical statistics course at Penn.
Notes on high-dimensional statistics, including the basics of random matrix theory and universality.
A leisurely overview of topics in equilibrium statistical mechanics, with an emphasis on spin glasses, and with an explanation of how such concepts relate to modern problems in high-dimensional statistics and optimization.
An exposition of results concerning the estimation of the inverse-temperature and external field in Ising models. Maximum likelihood estimation is intractable in this setting due to the usual difficulties (?) posed by the partition function. Luckily, the maximum pseudolikelihood estimator is consistent and achieves low asymptotic variance. Taking a step back, I find this problem a bit unnatural from an applied perspective.
A blog post Dwip and I wrote about variational autoencoders, an early form of generative AI.
An incomplete overview of diffusion models, and the related theory of stochastic localization. Since writing these notes, I've greatly clarified my understanding of stochastic localization with the help of Shervin Khalafi, and plan on updating the file accordingly.
The subset of my senior thesis that does not appear in existing papers. My broader thesis was on the alignment of correlated random graphs. Graph alignment algorithms can be used to positive ends (aligning protein--protein interaction networks), as well as to less positive ends (deanonymizing social networks).
Many mathematicians have begun to think seriously about AI safety, recognizing both the sea change taking place in their native fields, as well as the practical urgency of alignment. In this file, I record some of my preliminary thoughts.
A personal perspective on how the academic publishing system in applied mathematics should evolve in this disorienting new era of superhuman AI.
As a beginning graduate student, one aspect of academic culture that I found particularly disorienting was the tendency for all researchers to sell their latest paper as "the next big thing". (The advance of AI has only served to exacerbate this problem, in my experience.) In reality, most of a researcher's scholarly output serves merely to fulfill one of many obligations (either to a grant that funds their lab, or to students who must be trained by working on simple research problems), and such work has no ambition of changing the world. Of course, this doesn't stop researchers from overselling their papers, due to various perverse incentives that exist. In this incomplete note, I brainstorm schemes to address this problem, taking inspiration from Prof Su's "rank your own paper" mechanism for improved peer review in ML conferences. I first imagine an ideal world where tenured researchers are honest and attempt themselves to construct (absolute, not relative) scores for each of their own papers. I then acknowledge that such a system is extremely unlikely to take hold in academia, even among researchers with job security; and as a result, propose a scheme to estimate the unobservable quality of a given lab's papers based on observable factors, like the venue it is submitted to, whether or not it is featured on the lab website, the amount of social media promotion that was attempted, and so on. The goal is not at all to denigrate particular papers, but simply to help new researchers obtain a "calibrated" view of the research literature.
Recently, a freshman at Princeton wrote to me, asking what I do and how I got here. I'm not sure if he was impressed by or dismayed at my path through life thus far, but I gave him my advice, with the wisdom afforded by two long years outside of the orange bubble. I think some points apply pretty broadly.
Things written by others about math; which I've read, am reading, or will read.
"At times I practically lived in the computer room almost 24 hours a day. I remember very clearly the room — named after Princeton statistician Sam Wilks. There was an oil painting of Wilks, the minicomputer, Wilks' personal books, the old-fashioned teletype terminals, the fancier pin writer terminals, the tape drives, the clackclack, buzz-buzz sounds everything made. I remember all the strange things that came with staying up late at night working on the computer in this place. Sometimes the computer users held "afternoon tea" at 3 am in the Math lounge!"
"He liked philosophy, and he and my mother named me Alethea, the Greek word for truth. For years I believed he was tipping his cap to the idea of absolutes and would cheerfully say as much at parties. Then one day my mother overheard me and said: 'No. We got your name from a TV show'—it was a guest actress in 'Judd, for the Defense.' I laughed, humbled, and as I did, I could have sworn that somewhere, far from the world’s equations and signs, far beyond the manufactured clouds and flaming toasters, way out yonder where light has no speed, my father was laughing, too."
Things that may be helpful at all levels.
I personally find that music, art, and exercise are three activities that help me be more creative in life in general, and at research in particular. Below are some resources that I've found useful.
I love educational materials that combine science and art (especially animation). I think it'd be great if more scientists and artists teamed-up towards this purpose. Check out some examples below.
My attempts at art, and things I find pretty. (Update: no longer being updated, see my Facebook for the latest.)