Recent years have witnessed the explosion of digitized images and videos. With the increasing popularity of digital cameras and video recorders, it has become much easier for people to acquire a large number of digital images and videos. Websites, such as Youtube and Flickr, allow users to upload their pictures and videos to share with others all around the world. Flickr hosted more than 4 billions photos in 2009 and receives, on average, over 60 million images per month. YouTube supports about 14.6 billion video views per month and over 150 million video clips that are searchable over Internet. The large size of online image/video databases, such as Flickr and YouTube, calls for efficient and robust algorithms for image/video retrieval. The object of this research project is to address the fundamental limitations of the Bag-of-Words  (BoW) model by developing efficient methods for visual vocabulary construction and keypiont quantization that effectively explore the available side information about images. This project will also develop robust retrieval models that are resilient to the errors caused by keypoint quantization. The proposed components will be integrated into a fully functional system, and will be evaluated by experiments on large image databases with over 10 million images..

Students

1. Zheyun Feng

Publications

1. Z. Feng, R. Jin, and A. Jain, Large-scale Image Annotation by Efficient and Robust Kernel Metric Learning, Proceedings of International Conference on Computer Vision (ICCV), 2013
2. Y. Lin, R. Jin, D. Cai, S. Yan, and X. Li, Compressed Hashing, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013
3. L. Wu, R. Jin, and A. K. Jain, Tag Completion for Image Retrieval, IEEE Trans. Pattern Anal. Mach. Intell. 35(3): 716-727, 2013
4. S. H. C. Hoi, R. Jin, H. Xia, and P.C. Wu, Boosting Multi-Kernel Locality-Sensitive Hashing for Scalable Image Retrieval, ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2012
5. Y. Lin, R. Jin, D. Cai, and X. He, Random Projection with Filtering for Nearly Duplicate Search, AAAI Conference on Artificial Intelligence (AAAI), 2012