My research interests are in nonlinear optimization for machine learning. Below are some of the projects that I have been involved with my collaborators in industry and academia.
- McTorch. Currently working on the Python toolbox McTorch, a manifold optimization library for deep learning.
- Manopt. I am also involved in the development and promotion of the Matlab toolbox Manopt for optimization on manifolds.
- Pymanopt. Recently joined the Pymanopt team as a maintainer.
- Kaizala and Office Lens [Microsoft]. Working with multiple teams to integrate data-driven intelligent features into the Kaizala enterprise and Office Lens apps. The use cases that we tackle revolve around improving user experience on the apps by leveraging latest machine learning tools. An overview and a short video on the current focus of our team.
- Multilingual embedding [Microsoft]. The aim is to generate vector embeddings for words in the target language that are learned from a small set of dictionary mappings between the source and target languages. The use cases include being able to leverage tools developed in the English language to solve similar problems in a different language with little training data.
- Product recommendation [Microsoft]. Working on developing algorithms for an external Microsoft customer to enable ML driven product recommendations.
- Competitive pricing of products [Amazon.com]. Worked on the estimation of the competitive prices of 3p unique products, i.e., Amazon is not a retail player for these products. The large-scale nature of the project demanded to work on simple algorithmic implementations that are scalable and simple to maintain. The proposed models were productionized and used to generate price estimates worldwide for all of the Amazon marketplaces and consumed by multiple customers. (Patent filed.)
- Style recommendation for fashion [Amazon.com]. Worked on cold-start product recommendation by exploiting user and product attributes. Our algorithm s have been pushed online to internal customers. The online results have shown significant lift of performance over other baselines. The proposed algorithms are in production.
- Tensor decomposition [Amazon.com]. We exploit the problem structure to propose natural gradient learning algorithms for tensor decomposition. The proposed algorithm is in production to detect anomalies in seller and reviewer activities.
- Demand forecasting [Amazon.com]. As supervisor of an internship project, we proposed low-rank tensor factorization prototype models for demand forecasting problems.
- Optimization on Riemannian manifolds. Understanding the (Riemannian) geometry of structured constraints is of particular interest in machine learning. Conceptually, it allows translating a constrained optimization problem into an unconstrained optimization problem on a nonlinear search space (manifold). Building upon this point of view, one research interest is to exploit manifold geometry in nonlinear optimization.
We have been actively involved in both matrix and tensor applications. Recently, we have been looking into domain adaptation and generating multilingual embedding problems and their applications.
- Decenetralized and stochastic optimization algorithms. We explore recent advances in stochastic gradient algorithms on manifolds.
- Deep learning. We study geometric algorithms for modern deep networks that are robust to invariances of the parameters. On a conceptual level, our interest is to understand the link between learning a “complex architecture with simple algorithms” and learning a “simple architecture with sophisticated algorithms”.