ABSTRACT
This paper presents a lightweight tele-immersive video chat system named CuteChat. Based on our recently developed video object cutout technology, the CuteChat system is designed and optimized to provide a radically new video chat experience by merging each participant in the same shared space, allowing them to interact more naturally in an integrated manner. With the goal to make the system easily accessible by massive consumers, we address the challenges in the whole pipeline of video processing, coding, communication, composition, and playback. Extensive experiments have shown that the proposed CuteChat system runs reliably and comfortably in real time on one's laptop or desktop PC, and it needs only a commodity webcam for video acquisition and just public Internet for tele-immersive video conferencing. With such a really minimal deployment requirement, we present a variety of interesting applications and user experiences created by the CuteChat system.
- A. Criminisi, G. Cross, A. Blake, and V. Kolmogorov. Bilayer segmentation of live video. In Proc. of CVPR, 2006. Google ScholarDigital Library
- V. Kolmogorov, A. Criminisi, A. Blake, G. Cross, and C. Rother. Bi-layer segmentation of binocular stereo video. In Proc. of CVPR, 2005. Google ScholarDigital Library
- C. W. Lin, Y. J. Chang, C. M. Wang, Y. C. Chen, and M. T. Sun. A standard-compliant virtual meeting system with active video object tracking. EURASIP Journal on ASP, 2002. Google ScholarDigital Library
- D. E. Ott and K. Mayer-Patel. Coordinated multi-streaming for 3D tele-immersion. In Proc. of ACM Multimedia, 2004. Google ScholarDigital Library
- R. Sheppard et al. New digital options in geographically distributed dance collaborations with teeve: Tele-immersive environments for everybody. In ACM Multimedia, 2007. Google ScholarDigital Library
- J. Sun, W. Zhang, X. Tang, and H.-Y. Shum. Background cut. In Proc. of ECCV, 2006. Google ScholarDigital Library
- L. Wang, C. Zhang, R. Yang, and C. Zhang. Tofcut: towards robust real-time foreground extraction using a time-of-flight camera. In Proc. of 3DPVT, 2010.Google Scholar
- W. Wu, R. Rivas, A. Arefin, S. Shi, R. Sheppard, B. Bui, and K. Nahrstedt. MobileTI: A portable tele-immersive system. In Proc. of ACM Multimedia, 2009. Google ScholarDigital Library
- Z. Yang, Y. Cui, B. Yu, J. Liang, K. Nshrstedt, S. H. Jung, and R. Bajscy. TEEVE: The next generation architecture for tele-immersive environments. In Proc. of 7th ISM, 2005. Google ScholarDigital Library
Index Terms
- CuteChat: a lightweight tele-immersive video chat system
Recommendations
Moving from talking heads to newlyweds: exploring video chat use during major life events
DIS '14: Proceedings of the 2014 conference on Designing interactive systemsVideo chat programs for home and personal use (e.g., Skype) are becoming increasingly popular for doing more than simply conversing with a remote friend or family member. This creates a need to understand the broader use of video chat that moves "beyond ...
Intimacy in long-distance relationships over video chat
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsMany couples live a portion of their lives in a long-distance relationship (LDR). This includes a large number of dating college students as well as couples who are geographically-separated because of situational demands such as work. We conducted ...
How and why teenagers use video chat
CSCW '13: Proceedings of the 2013 conference on Computer supported cooperative workTeenagers are increasingly using video chat systems to communicate with others, however, little research has been conducted to explore how and why they use the technology. To better understand this design space, we present the results of a study of ...
Comments