About Me

I am a Machine Learning Scientist at Harmonic Discovery. I completed my PhD at UC Berkeley under Michael Mahoney, where I worked on fundamental research in machine learning. Before Berkeley, I was a student at Arizona State University, where I studied mathematics and economics, and completed a master’s thesis under Sebastien Motsch in the mathematics department. I was also the machine learning lead in the Luminosity Lab. Outside of university, I spent two summers as a research intern at Salesforce Research, and have also worked for Amazon.com in the past. See my CV for more.

Research

During my PhD, I was primarily interested in theoretical aspects of deep learning, mainly focused on the question of generalization. Namely, I’m interested in when and how we can fit extremely complicated and expressive models to data, and expect these models to perform well on new, unseen data.

More recently, I have become interested in applications of machine learning to the field of drug discovery.

Below is a list of papers I’ve co-authored.

• Theisen, R., PhD Thesis advised by Michael W. Mahoney. Beyond Worst-Case Generalization in Modern Machine Learning, 2023. [View]

• Theisen, R., Kim, H., Yang, Y, Hodgkinson, L., Mahoney, M.W. When are ensembles really effective? Conference on Neural Information Processing Systems, 2023. [ArXiv]

• Yang, Y., Theisen, R., Hodgkinson, L., Gonzalez J.E., Ramchandran, K., Martin, C.H., Mahoney, M.W. Test Accuracy vs. Generalization Gap: Model Selection in NLP without Accessing Training or Testing Data. ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2023. [ACM, ArXiv]

• Yang, Y., Hodgkinson, L., Theisen, R., Zou, J., Gonzalez J. E., Ramchandran, K., Mahoney, M.W. Taxonomizing Local Versus Global Structure in Neural Network Loss Landscapes. Conference on Neural Information Processing Systems, 2021. [NeurIPS, ArXiv]

• Theisen, R., Wang, H., Varshney L. R., Xiong, C., Socher, R. Evaluating State-of-the-Art Classification Models Against Bayes Optimality. Conference on Neural Information Processing Systems, 2021. [NeurIPS, ArXiv]

• Theisen, R., Klusowski, J. M., Mahoney, M. W. Good Classifiers are Abundant in the Interpolating Regime. International Conference on Artificial Intelligence and Statistics, 2021. [PMLR, ArXiv]

• Cao, F., Motsch, S., Reamy, A., Theisen, R. Asymptotic Flocking for the Three-Zone Model. Mathematical Biosciences and Engineering, 2020. [AIMS]

• Theisen, R., Klusowski, J. M., Wang, H., Keskar, N., Xiong, C., Socher, R. Global Capacity Measures for Deep ReLU Networks via Path Sampling. Technical Report, 2019. [ArXiv]

• Weber, D., Theisen, R., Motsch, S. Deterministic Versus Stochastic Consensus Dynamics on Graphs. Journal of Statistical Physics, 2019. [JSP, ArXiv]

• Theisen, R., Masters Thesis advised by Sebastien Motsch. Convergence Results for Two Models of Interaction, 2018. [Download]

Photography

I love to travel and spend as much time outdoors as possible. I always take my camera with me wherever I go - feel free to check out some of my photos.

Contact

Email: ryanctheisen [at] gmail.com