Abstract
In this paper, we present SkyFinder, an interactive search system of over a half million sky images downloaded from the Internet. Using a set of automatically extracted, semantic sky attributes (category, layout, richness, horizon, etc.), the user can find a desired sky image, such as "a landscape with rich clouds at sunset" or "a whole blue sky with white clouds". The system is fully automatic and scalable. It computes all sky attributes offline, then provides an interactive online search engine. Moreover, we build a sky graph based on the sky attributes, so that the user can smoothly explore and find a path within the space of skies. We also show how our system can be used for controllable sky replacement.
Supplemental Material
- Bitouk, D., Kumar, N., Dhillon, S., Belhumeur, P., and Nayar, S. K. 2008. Face swapping: automatically replacing faces in photographs. ACM Trans. Graph. 27, 3, 1--8. Google ScholarDigital Library
- Boykov, Y., and Jolly, M. P. 2001. Interactive graph cuts for optimal boundary & region segmentation of objects in n-d images. ICCVI, 105--112.Google Scholar
- Dance, C., Willamowski, J., Fan, L., Bray, C., and Csurka, G. 2004. Visual categorization with bags of keypoint. In ECCV Workshop on Statistical Learning in Computer Vision.Google Scholar
- Datta, R., Joshi, D., Li, J., and Wang, J. Z. 2008. Image retrieval: Ideas, influences, and trends of the new age. ACM Computing Surveys 40, 2. Google ScholarDigital Library
- Duda, R., H. P. S. D. 2001. Pattern Classification (2nd). Wiley Press. Google ScholarDigital Library
- Hays, J., and Efros, A. A. 2007. Scene completion using millions of photographs. ACM Trans. Graph. 26, 3, 4. Google ScholarDigital Library
- Hoiem, D., Efros, A. A., and Hebert, M. 2005. Automatic photo pop-up. ACM Trans. Graph. 24, 3, 577--584. Google ScholarDigital Library
- Jacobs, C. E., Finkelstein, A., and Salesin, D. H. 1995. Fast multiresolution image querying. In SIGGRAPH, 277--286. Google ScholarDigital Library
- Johnson, M., Brostow, G., Shotton, J., Arandjelovic, O., Kwatra, V., and Cipolla, R. 2006. Semantic photo synthesis. Computer Graphics Forum.Google Scholar
- Kumar, N., Belhumeur, P., and Nayar, S. 2008. Facetracer: A search engine for large collections of images with faces. IV: 340--353. Google ScholarDigital Library
- Lalonde, J.-F., and Efros, A. A. 2007. Using color compatibility for assessing image realism. In ICCV.Google Scholar
- Lalonde, J.-F., Hoiem, D., Efros, A. A., Rother, C., Winn, J., and Criminisi, A. 2008. Photo clip art. ACM Trans. Graph. 26, 3, 3. Google ScholarDigital Library
- Lalonde, J.-F., Srinivasa, Narasimhan, G., and Efros, A. A. 2008. What does the sky tell us about the camera? In ECCV. Google ScholarDigital Library
- Li, Y., Sun, J., Tang, C., and Shum, H. 2004. Lazy snapping. Proceedings of ACM SIGGRAPH, 303--308. Google ScholarDigital Library
- Lowe, D. G. 2004. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60, 2, 91--110. Google ScholarDigital Library
- Matusik, W., Zwicker, M., and Durand, F. 2005. Texture design using a simplicial complex of morphable textures. ACM Trans. Graph. 24, 3, 787--794. Google ScholarDigital Library
- Moosmann, F., Triggs, B., and Jurie., F. 2006. Fast discriminative visual codebooks using randomized clustering forests. In NIPS.Google Scholar
- Reinhard, E., Ashikhmin, M., Gooch, B., and Shirley, P. 2005. Color transfer between images. IEEE Computer Graphics and Applications 21, 5, 34--41. Google ScholarDigital Library
- Rubner, Y., Tomasi, C., and Guibas, L. 1998. A metric for distributions with applications to image databases. ICCV, 59--66. Google ScholarDigital Library
- Snavely, N., Seitz, S. M., and Szeliski, R. 2006. Photo tourism: exploring photo collections in 3d. ACM Trans. Graph. 25, 3, 835--846. Google ScholarDigital Library
- Snavely, N., Garg, R., Seitz, S. M., and Szeliski, R. 2008. Finding paths through the world's photos. ACM Trans. Graph. 27, 5, 1--11. Google ScholarDigital Library
- Stumpfel, J., Jones, A., Wenger, A., Tchou, C., Hawkins, T., and Debevec, P. 2004. Direct hdr capture of the sun and sky. In AFRIGRAPH. Google ScholarDigital Library
- Vapnik, V. 1995. The Nature of Statistical Learning Theory. Springer-Verlag. Google ScholarDigital Library
Index Terms
- SkyFinder: attribute-based sky image search
Recommendations
SkyFinder: attribute-based sky image search
SIGGRAPH '09: ACM SIGGRAPH 2009 papersIn this paper, we present SkyFinder, an interactive search system of over a half million sky images downloaded from the Internet. Using a set of automatically extracted, semantic sky attributes (category, layout, richness, horizon, etc.), the user can ...
Evaluation of three ionospheric delay computation methods for ground-based GNSS receivers
GNSS observables for ionospheric estimation are commonly based on carrier-to-code leveling (CCL) and precise point positioning (PPP) methods. The CCL method is a geometry-free method which uses carrier phase to level pseudorange observation for ...
Analysis of satellite-induced factors affecting the accuracy of the BDS satellite differential code bias
Differential code bias (DCB) is one of the main error sources of the positioning, navigation and timing services and slant total electron content extraction. The DCB can usually be estimated together with ionospheric model coefficients from the data of ...
Comments