Hi, this is Mitul Tiwari, a computer scientist and a software engineer based in Silicon Valley. Currently, I am part of Search, Network, and Analytics Group at LinkedIn as a Staff Engineer (Research and Software Development). Previously, I worked at Kosmix as a Member of Technical Staff from October 2007 to January 2011. I completed my PhD in Computer Science from University of Texas at Austin in 2007. Earlier I received my under graduation as a Bachelor of Technology in Computer Science and Engineering from Indian Institute of Technology, Bombay in Summer 2001. I joined UTCS in Fall 2001, and earned my Master of Science in Computer Science in 2003.
At LinkedIn, I am working on data driven products such as "People You May Know" (PYMK). PYMK is a large-scale social recommendation system that analyzes billions of edges to predict social connections. Using Hadoop, PIG, Clojure, Machine Learning algorithms.
At Kosmix, I worked on document/tweet/query categorization, concept mining, query parsing, query expansion, and relevance of search results to improve the quality of pages generated for any given topic. I also worked on building high performance, scalable systems for data fetching, data storage, and distributed processing.
At UT Austin, I worked on algorithms for emerging network applications. In particular, my research focused on designing self-tuning algorithms for distributed resource allocation, especially for caching, monitoring, and scheduling problems. My advisor at UT Austin was Greg Plaxton. I also interacted with Harrick Vin and Mike Dahlin.
My interests include hacking, data mining, machine learning, search, distributed systems, and network algorithms.
Recent Blog Posts
- Related Searches at LinkedIn. July, 2012.
- Social Networking in Developing Regions. March, 2012.
- Notes from Conference on Recommender Systems 2011. December, 2011.
- Supervised Random Walk for link prediction. May, 2011.
- Summary of Haystack system paper from Facebook. April, 2011.
- Effectiveness of data. April, 2010.
- Organizing the web around concepts. In Altsearchengines.com, September 2009.
- Deep Web: The Hidden Treasure. In Altsearchengines.com, August 2009.
- Large-Scale Social Recommender Systems at LinkedIn. Keynote talk in Applied Machine Learning and Data Science track at QCON, San Francisco, November 2013.
- Large-Scale Social Recommendation Systems: Challenges and Opportunities, Keynote talk at 4th International Conference on Social Recommender Systems at WWW, May 2013.
- Organizational Overlap on Social Networks and its Applications, at WWW, May 2013.
- Metaphor: a system for related search recommendations, At CIKM, October 2012.
- Related Searches at LinkedIn. Invited talk in the 35th Annual SIGIR Conference, August 2012.
- Social Network Analysis at LinkedIn . At University of Texas, Austin, Sept 2011.
- Building Data Driven Products using Hadoop at LinkedIn. In Big Data and Cloud Computing meetup, Aug 2011.
- Modeling Impression Discounting in Large-scale Recommender Systems Pei Li, Laks V.S. Lakshmanan, Mitul Tiwari, Sam Shah. To appear in 20th ACM Conference on Knowledge Discovery and Data Mining, August 2014.
- Structural Diversity in Social Recommender Systems, Xinyi Huang, Mitul Tiwari and Sam Shah. In Proceedings of the 5th ACM RecSys Workshop on Recommender Systems and the Social Web, October 2013.
- Entity Extraction, Linking, Classification, and Tagging for Social Media: A Wikipedia-Based Approach. Abhishek Gattani, Digvijay S. Lamba, Nikesh Garera, Mitul Tiwari, Xiaoyong Chai, Sanjib Das, Sri Subramaniam, Anand Rajaraman, Venky Harinarayan, AnHai Doan. In Proceedings of the 39th International Conference on Very Large Data Bases (VLDB), August 2013.
- Organizational Overlap on Social Networks and its Applications, Cho-Jui Hsieh, Mitul Tiwari, Deepak Agarwal, Xinyi (Lisa) Huang, and Sam Shah. In Proceedings of the 22nd International World Wide Web Conference (WWW), May 2013.
- Metaphor: a system for related search recommendations, Azarias Reda, Yubin Park, Mitul Tiwari, Christian Posse, and Sam Shah. In Proceedings of the 21st International Conference on Information and Knowledge Management (CIKM), October 2012.
- Related Searches at Linkedin, Azarias Reda, Yubin Park, Mitul Tiwari, Christian Posse, and Sam Shah. In the 35th Annual SIGIR Conference (Industrial Track), August 2012.
- Social Networking in Developing Regions, Azarias Reda, Sam Shah, Mitul Tiwari, Anita Lillie, and Brian Noble. In Proceedings of the International conference on Information and Communication Technologies and Development (ICTD), March 2012.
- Online Compression Caching, C. Greg Plaxton, Yu Sun, Mitul Tiwari, and Harrick Vin. In Proceedings of the 11th Scandinavian Workshop on Algorithm Theory (SWAT), July 2008.
- Online Aggregation over Trees, C. Greg Plaxton, Mitul Tiwari, and Praveen Yalagandula. In Proceedings of the 21st International Parallel and Distributed Processing Symposium (IPDPS), March 2007.
- Reconfigurable Resource Scheduling with Variable Delay Bounds, C. Greg Plaxton, Yu Sun, Mitul Tiwari, and Harrick Vin. In Proceedings of the 21st International Parallel and Distributed Processing Symposium (IPDPS), March 2007.
- Online Hierarchical Cooperative Caching, Xiaozhou Li, C. Greg Plaxton, Mitul Tiwari, and Arun Venkataramani. Theory of Computing Systems, 39:851-874, 2006. Note: This paper extends the lower bound results in our SPAA paper for any randomized online algorithm.
- Reconfigurable Resource Scheduling, C. Greg Plaxton, Yu Sun, Mitul Tiwari, and Harrick Vin. In Proceedings of the 18th Symposium on Parallelism in Algorithms and Architectures (SPAA), July 2006.
- Online Hierarchical Cooperative Caching, Xiaozhou Li, C. Greg Plaxton, Mitul Tiwari, and Arun Venkataramani. In Proceedings of the 16th Symposium on Parallelism in Algorithms and Architectures (SPAA), June 2004.
- Using Memex to archive and mine community Web browsing experience, Soumen Chakrabarti, Sandeep Srivastava, Mallela Subramanyam, Mitul Tiwari. In Proceedings of the 9th International World Wide Web Conference (WWW), May 2000.
- Memex: A Browsing Assistant for Collaborative Archiving and Mining of Surf Trails, Soumen Chakrabarti, Sandeep Shrivastava, Mallela Subramanyam, Mitul Tiwari. In Proceedings of the Very Large Data Base Conference (VLDB), September 2000.
- Algorithms for Distributed Caching and Aggregation. September 2007.
Recent Professional Activites
- Co-chair for the 8th Workshop on Social Network Mining and Analysis (held with KDD), SNAKDD 2014.
- Program Committee member for RecSys 2014, RecSys 2013, SIGIR Industrial track 2013.
- Reviewed papers for KDD, RecSys, SIGIR, SPAA, SODA, ...