publications

2022

1. An Empirical study to understand the Compositional Prowess of Neural Dialog Models

   Vinayshekhar Kumar, Vaibhav Kumar, Mukul Bhutani, and Alexander Rudnicky

   In Proceedings of the Third Workshop on Insights from Negative Results in NLP, May 2022

   Abs

   In this work, we examine the problems associated with neural dialog models under the common theme of compositionality. Specifically, we investigate three manifestations of compositionality: (1) Productivity, (2) Substitutivity, and (3) Systematicity. These manifestations shed light on the generalization, syntactic robustness, and semantic capabilities of neural dialog models. We design probing experiments by perturbing the training data to study the above phenomenon. We make informative observations based on automated metrics and hope that this work increases research interest in understanding the capacity of these models.

2019

1. Sinkhorn-Flow: Predicting Probability Mass Flow in Dynamical Systems Using Optimal Transport

   Mukul Bhutani, and J. Zico Kolter

   Optimal Transport Workshop, NeurIPS, May 2019
2. WriterForcing: Generating more interesting story endings

   Prakhar Gupta, Vinayshekhar Bannihatti Kumar, Mukul Bhutani, and Alan W Black

   In Proceedings of the Second Workshop on Storytelling, Aug 2019

   Abs

   We study the problem of generating interesting endings for stories. Neural generative models have shown promising results for various text generation problems. Sequence to Sequence (Seq2Seq) models are typically trained to generate a single output sequence for a given input sequence. However, in the context of a story, multiple endings are possible. Seq2Seq models tend to ignore the context and generate generic and dull responses. Very few works have studied generating diverse and interesting story endings for the same story context. In this paper, we propose models which generate more diverse and interesting outputs by 1) training models to focus attention on important keyphrases of the story, and 2) promoting generating nongeneric words. We show that the combination of the two leads to more interesting endings.

2018

1. Low-rank geometric mean metric learning

   Mukul Bhutani, Pratik Jawanpuria, Hiroyuki Kasai, and Bamdev Mishra

   Geometry in Machine Learning (GiMLi) workshop,ICML, Aug 2018

2017

1. MRNet-Product2Vec: A Multi-task Recurrent Neural Network for Product Embeddings

   Arijit Biswas, Mukul Bhutani, and Subhajit Sanyal

   In ECML PKDD, Aug 2017

   Abs

   E-commerce websites such as Amazon, Alibaba, Flipkart, and Walmart sell billions of products. Machine learning (ML) algorithms involving products are often used to improve the customer experience and increase revenue, e.g., product similarity, recommendation, and price estimation. The products are required to be represented as features before training an ML algorithm. In this paper, we propose an approach called MRNet-Product2Vec for creating generic embeddings of products within an e-commerce ecosystem. We learn a dense and low-dimensional embedding where a diverse set of signals related to a product are explicitly injected into its representation. We train a Discriminative Multi-task Bidirectional Recurrent Neural Network (RNN), where the input is a product title fed through a Bidirectional RNN and at the output, product labels corresponding to fifteen different tasks are predicted. The task set includes several intrinsic characteristics about a product such as price, weight, size, color, popularity, and material. We evaluate the proposed embedding quantitatively and qualitatively. We demonstrate that they are almost as good as sparse and extremely high-dimensional TF-IDF representation in spite of having less than 3% of the TF-IDF dimension. We also use a multimodal autoencoder for comparing products from different language-regions and show preliminary yet promising qualitative results.

2. 

   A two-dimensional decomposition approach for matrix completion through gossip

   Mukul Bhutani, and Bamdev Mishra

   arXiv e-prints, Aug 2017