Hi, this is Mitul Tiwari, a computer scientist and a software engineer based in Silicon Valley. Currently, I am part of Search, Network, and Analytics Group at LinkedIn as a Staff Engineer (Research and Software Development). Previously, I worked at Kosmix as a Member of Technical Staff from October 2007 to January 2011. I completed my PhD in Computer Science from University of Texas at Austin in 2007. Earlier I received my under graduation as a Bachelor of Technology in Computer Science and Engineering from Indian Institute of Technology, Bombay in Summer 2001. I joined UTCS in Fall 2001, and earned my Master of Science in Computer Science in 2003.
At LinkedIn, I am working on data driven products such as "People You May Know" (PYMK). PYMK is a large-scale social recommendation system that analyzes billions of edges to predict social connections. Using Hadoop, PIG, Clojure, Machine Learning algorithms.
At Kosmix, I worked on document/tweet/query categorization, concept mining, query parsing, query expansion, and relevance of search results to improve the quality of pages generated for any given topic. I also worked on building high performance, scalable systems for data fetching, data storage, and distributed processing.
At UT Austin, I worked on algorithms for emerging network applications. In particular, my research focused on designing self-tuning algorithms for distributed resource allocation, especially for caching, monitoring, and scheduling problems. My advisor at UT Austin was Greg Plaxton. I also interacted with Harrick Vin and Mike Dahlin.
In the past I have worked with Soumen Chakrabarty and Inderjit Dhillon on web mining, clustering, and other data mining problems.
My interests include hacking, data mining, machine learning, search, distributed systems, and network algorithms.
Recent Hacks
- TagShare, with Kartik Agaram. Twitter meets Delicous: tag, search, and inline content of your incoming tweets.
- Hackerstream, with Kartik Agaram. Hacker News in real-time.
- Top shared items on Facebook (sign in on Facebook to get personalized view)
Recent Blog Posts
- Related Searches at LinkedIn. July, 2012.
- Social Networking in Developing Regions. March, 2012.
- Notes from Conference on Recommender Systems 2011. December, 2011.
- Supervised Random Walk for link prediction. May, 2011.
- Summary of Haystack system paper from Facebook. April, 2011.
- Effectiveness of data. April, 2010.
- Organizing the web around concepts. In Altsearchengines.com, September 2009.
- Deep Web: The Hidden Treasure. In Altsearchengines.com, August 2009.
Recent Presentations
- Metaphor: a system for related search recommendations, At CIKM, October 31, 2012.
- Related Searches at LinkedIn. Invited talk in the 35th Annual SIGIR Conference, August 15, 2012.
- Social Network Analysis at LinkedIn . At University of Texas, Austin, Sept 20, 2011.
- Building Data Driven Products using Hadoop at LinkedIn. In Big Data and Cloud Computing meetup, Aug 11, 2011.
Publications
- Organizational Overlap on Social Networks and its Applications, Cho-Jui Hsieh, Mitul Tiwari, Sam Shah, and Deepak Agarwal. In Proceedings of the 22nd International World Wide Web Conference (WWW), May 2013.
- Metaphor: a system for related search recommendations, Azarias Reda, Yubin Park, Mitul Tiwari, Christian Posse, and Sam Shah. In Proceedings of the 21st International Conference on Information and Knowledge Management (CIKM), October 2012.
- Related Searches at Linkedin, Azarias Reda, Yubin Park, Mitul Tiwari, Christian Posse, and Sam Shah. In the 35th Annual SIGIR Conference (Industrial Track), August 2012.
- Social Networking in Developing Regions, Azarias Reda, Sam Shah, Mitul Tiwari, Anita Lillie, and Brian Noble. In Proceedings of the International conference on Information and Communication Technologies and Development (ICTD), March 2012.
- Online Compression Caching, C. Greg Plaxton, Yu Sun, Mitul Tiwari, and Harrick Vin. In Proceedings of the 11th Scandinavian Workshop on Algorithm Theory (SWAT), July 2008.
- Online Aggregation over Trees, C. Greg Plaxton, Mitul Tiwari, and Praveen Yalagandula. In Proceedings of the 21st International Parallel and Distributed Processing Symposium (IPDPS), March 2007.
- Reconfigurable Resource Scheduling with Variable Delay Bounds, C. Greg Plaxton, Yu Sun, Mitul Tiwari, and Harrick Vin. In Proceedings of the 21st International Parallel and Distributed Processing Symposium (IPDPS), March 2007.
- Reconfigurable Resource Scheduling, C. Greg Plaxton, Yu Sun, Mitul Tiwari, and Harrick Vin. In Proceedings of the 18th Symposium on Parallelism in Algorithms and Architectures (SPAA), July 2006.
- Online Hierarchical Cooperative Caching, Xiaozhou Li, C. Greg Plaxton, Mitul Tiwari, and Arun Venkataramani. In Proceedings of the 16th Symposium on Parallelism in Algorithms and Architectures (SPAA), June 2004.
- Using Memex to archive and mine community Web browsing experience, Soumen Chakrabarti, Sandeep Srivastava, Mallela Subramanyam, Mitul Tiwari. In Proceedings of the 9th International World Wide Web Conference (WWW), May 2000.
- Memex: A Browsing Assistant for Collaborative Archiving and Mining of Surf Trails, Soumen Chakrabarti, Sandeep Shrivastava, Mallela Subramanyam, Mitul Tiwari. In Proceedings of the Very Large Data Base Conference (VLDB), September 2000.
- Online Hierarchical Cooperative Caching, Xiaozhou Li, C. Greg Plaxton, Mitul Tiwari, and Arun Venkataramani. Theory of Computing Systems, 39:851-874, 2006. Note: This paper extends the lower bound results in our SPAA paper for any randomized online algorithm.
- Algorithms for Distributed Caching and Aggregation. September 2007.