skip to main content
research-article

SkyFinder: attribute-based sky image search

Published:27 July 2009Publication History
Skip Abstract Section

Abstract

In this paper, we present SkyFinder, an interactive search system of over a half million sky images downloaded from the Internet. Using a set of automatically extracted, semantic sky attributes (category, layout, richness, horizon, etc.), the user can find a desired sky image, such as "a landscape with rich clouds at sunset" or "a whole blue sky with white clouds". The system is fully automatic and scalable. It computes all sky attributes offline, then provides an interactive online search engine. Moreover, we build a sky graph based on the sky attributes, so that the user can smoothly explore and find a path within the space of skies. We also show how our system can be used for controllable sky replacement.

Skip Supplemental Material Section

Supplemental Material

tps096_09.mp4

mp4

44.3 MB

References

  1. Bitouk, D., Kumar, N., Dhillon, S., Belhumeur, P., and Nayar, S. K. 2008. Face swapping: automatically replacing faces in photographs. ACM Trans. Graph. 27, 3, 1--8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Boykov, Y., and Jolly, M. P. 2001. Interactive graph cuts for optimal boundary & region segmentation of objects in n-d images. ICCVI, 105--112.Google ScholarGoogle Scholar
  3. Dance, C., Willamowski, J., Fan, L., Bray, C., and Csurka, G. 2004. Visual categorization with bags of keypoint. In ECCV Workshop on Statistical Learning in Computer Vision.Google ScholarGoogle Scholar
  4. Datta, R., Joshi, D., Li, J., and Wang, J. Z. 2008. Image retrieval: Ideas, influences, and trends of the new age. ACM Computing Surveys 40, 2. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Duda, R., H. P. S. D. 2001. Pattern Classification (2nd). Wiley Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Hays, J., and Efros, A. A. 2007. Scene completion using millions of photographs. ACM Trans. Graph. 26, 3, 4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Hoiem, D., Efros, A. A., and Hebert, M. 2005. Automatic photo pop-up. ACM Trans. Graph. 24, 3, 577--584. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Jacobs, C. E., Finkelstein, A., and Salesin, D. H. 1995. Fast multiresolution image querying. In SIGGRAPH, 277--286. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Johnson, M., Brostow, G., Shotton, J., Arandjelovic, O., Kwatra, V., and Cipolla, R. 2006. Semantic photo synthesis. Computer Graphics Forum.Google ScholarGoogle Scholar
  10. Kumar, N., Belhumeur, P., and Nayar, S. 2008. Facetracer: A search engine for large collections of images with faces. IV: 340--353. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Lalonde, J.-F., and Efros, A. A. 2007. Using color compatibility for assessing image realism. In ICCV.Google ScholarGoogle Scholar
  12. Lalonde, J.-F., Hoiem, D., Efros, A. A., Rother, C., Winn, J., and Criminisi, A. 2008. Photo clip art. ACM Trans. Graph. 26, 3, 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Lalonde, J.-F., Srinivasa, Narasimhan, G., and Efros, A. A. 2008. What does the sky tell us about the camera? In ECCV. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Li, Y., Sun, J., Tang, C., and Shum, H. 2004. Lazy snapping. Proceedings of ACM SIGGRAPH, 303--308. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Lowe, D. G. 2004. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60, 2, 91--110. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Matusik, W., Zwicker, M., and Durand, F. 2005. Texture design using a simplicial complex of morphable textures. ACM Trans. Graph. 24, 3, 787--794. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Moosmann, F., Triggs, B., and Jurie., F. 2006. Fast discriminative visual codebooks using randomized clustering forests. In NIPS.Google ScholarGoogle Scholar
  18. Reinhard, E., Ashikhmin, M., Gooch, B., and Shirley, P. 2005. Color transfer between images. IEEE Computer Graphics and Applications 21, 5, 34--41. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Rubner, Y., Tomasi, C., and Guibas, L. 1998. A metric for distributions with applications to image databases. ICCV, 59--66. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Snavely, N., Seitz, S. M., and Szeliski, R. 2006. Photo tourism: exploring photo collections in 3d. ACM Trans. Graph. 25, 3, 835--846. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Snavely, N., Garg, R., Seitz, S. M., and Szeliski, R. 2008. Finding paths through the world's photos. ACM Trans. Graph. 27, 5, 1--11. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Stumpfel, J., Jones, A., Wenger, A., Tchou, C., Hawkins, T., and Debevec, P. 2004. Direct hdr capture of the sun and sky. In AFRIGRAPH. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Vapnik, V. 1995. The Nature of Statistical Learning Theory. Springer-Verlag. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. SkyFinder: attribute-based sky image search

              Recommendations

              Comments

              Login options

              Check if you have access through your login credentials or your institution to get full access on this article.

              Sign in

              Full Access

              • Published in

                cover image ACM Transactions on Graphics
                ACM Transactions on Graphics  Volume 28, Issue 3
                August 2009
                750 pages
                ISSN:0730-0301
                EISSN:1557-7368
                DOI:10.1145/1531326
                Issue’s Table of Contents

                Copyright © 2009 ACM

                Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

                Publisher

                Association for Computing Machinery

                New York, NY, United States

                Publication History

                • Published: 27 July 2009
                Published in tog Volume 28, Issue 3

                Permissions

                Request permissions about this article.

                Request Permissions

                Check for updates

                Qualifiers

                • research-article

              PDF Format

              View or Download as a PDF file.

              PDF

              eReader

              View online with eReader.

              eReader