Shengmei Liu
ABSTRACT
Understanding the effects of latency on interaction is important for building software, such as computer games, that perform well over a range of system configurations. Unfortunately, user studies evaluating latency must each write their own code to add latency to user input and, even worse, must limit themselves to open source applications. To address these shortcomings, this paper presents EvLag, a tool for adding latency to user input devices in Linux. EvLag provides a custom amount of latency for each device regardless of the application being run, enabling user studies for systems and software that cannot be modified (e.g., commercial games). Evaluation shows EvLag has low overhead and accurately adds the expected amount of latency to user input. In addition, EvLag can log user input events for post study analysis with several utilities provided to facilitate output event parsing.
Supplemental Material
Available for Download
zip
p281-liu.zip (2.4 KB)
Supplemental material.
- R. Amin, F. Jackson, J. Gilbert, J. Martin, and T. Shaw. [n.d.]. Assessing the Impact of Latency and Jitter on the Perceived Quality of Call of Duty Modern Warfare 2. In Proceedings of HCI -- Users and Contexts of Use. Berlin, Heidelberg.Google Scholar
- G. Armitage. 2003. An Experimental Estimation of Latency Sensitivity in Multi-player Quake 3. In Proceedings of IEEE ICON. Sydney, Australia.Google ScholarCross Ref
- Y. Bernier. 2001. Latency Compensating Methods in Client/Server In-game Protocol Design and Optimization. In the GDC. San Francisco, CA, USA.Google Scholar
- M. Carbone and L. Rizzo. 2010. Dummynet Revisited. ACM SIGCOMM Computer Communications Review 40, 2 (April 2010).Google ScholarDigital Library
- G. Casiez, S. Conversy, M. Falce, S. Huot, and N. Roussel. 2015. "Looking through the Eye of the Mouse: A Simple Method for Measuring End-to-end Latency using an Optical Mouse". In Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology (UIST).Google Scholar
- K. Chen, Y. Chang, H. Hsu, D. Chen, C. Huang, and C. Hsu. 2014. On the Quality of Service of Cloud Gaming Systems. IEEE Trans. on Multimedia 26, 2 (Feb. 2014).Google Scholar
- Mark Claypool, Andy Cockburn, and Carl Gutwin. 2019. Game Input with Delay - Moving Target Selection Parameters. In Proceedings of ACM Multimedia Systems Conference (MMSys). Amherst, MA, USA.Google ScholarDigital Library
- M. Claypool, R. Eg, and K. Raaen. 2017. Modeling User Performance for Moving Target Selection with a Delayed Mouse. In Proceedings of the 23rd International Conference on MultiMedia Modeling (MMM). Reykjavik, Iceland.Google Scholar
- M. Claypool and D. Finkel. 2014. The Effects of Latency on Player Performance in Cloud-based Games. In Proceedings of the 13th ACM Network and System Support for Games (NetGames). Nagoya, Japan.Google Scholar
- M. Dick, O. Wellnitz, and L. Wolf. 2005. Analysis of Factors Affecting Players’ Performance and Perception in Multiplayer Games. In Proceedings of ACM NetGames. Hawthorn, NY, USA.Google Scholar
- T. Fritsch, H. Ritter, and J. Schiller. 2005. The Effect of Latency and Network Limitations on MMORPGs: a Field Study of Everquest 2. In Proceedings of ACM NetGames. Hawthorne, NY, USA.Google Scholar
- O. Hossfeld, H. Fiedler, E. Pujol, and D. Guse. 2016. Insensitivity to Network Delay: Minecraft Gaming Experience of Casual Gamers. In Proceedings of the International Teletraffic Congress (ITC). IEEE, Würzburg, Germany, 31--33.Google Scholar
- Z. Ivkovic, I. Stavness, C. Gutwin, and s. Sutcliffe. 2015. Quantifying and Mitigating the Negative Effects of Local Latencies on Aiming in 3D Shooter Games. In Proceedings of the ACM CHI. Seoul, Korea.Google ScholarDigital Library
- I. Lee, S. Kim, and B. Lee. 2019. Geometrically Compensating Effect of End-to-End Latency in Moving-Target Selection Games. In Proceedings of the ACM CHI.Google Scholar
- S. Liu, A. Kuwahara, J. Sherman, J. Scovell, and M. Claypool. 2021. Lower is Better? The Effects of Local Latencies on Competitive First Person Shooter Game Players. In Proceedings of ACM CHI. Virtual Conference.Google Scholar
- M. Long and C. Gutwin. 2018. Characterizing and Modeling the Effects of Local Latency on Game Performance and Experience. In Proceedings of the ACM CHI Play. Melbourne, VC, Australia.Google Scholar
- M. Long and C. Gutwin. 2019. Effects of Local Latency on Game Pointing Devices and Game Pointing Tasks. In Proceedings of the ACM CHI. Glasgow, Scotland.Google Scholar
- R. Netravali, A. Sivaraman, S. Das, A. Goyal, K. Winstein, J. Mickens, and H. Balakrishnan. 2015. Mahimahi: Accurate Record-and-replay for HTTP. In USENIX Annual Technical Conference (ATC). Santa Clara, CA, USA.Google Scholar
- V. Pavlik. 1999 - 2001. Linux Input Drivers v1.0. Online: https://www.kernel.org/doc/Documentation/input/input.txt.Google Scholar
- A. Pavlovych and C. Gutwin. 2012. Assessing Target Acquisition and Tracking Performance for Complex Moving Targets in the Presence of Latency and Jitter. In Proceedings of Graphics Interface. Toronto, ON, Canada.Google Scholar
- A. Pavlovych and W. Stuerzlinger. 2011. Target Following Performance in the Presence of Latency, Jitter, and Signal Dropouts. In Proceedings of Graphics Interface. St. John’s, NL, Canada.Google Scholar
- P. Quax, P. Monsieurs, W. Lamotte, D. De Vleeschauwer, and N. Degrande. 2004. Objective and Subjective Evaluation of the Influence of Small Amounts of Delay and Jitter on a Recent First Person Shooter Game. In Proceedings of ACM NetGames. Portland, OG, USA.Google Scholar
- K. Raaen and I. Kjellmo. 2015. Measuring Latency in Virtual Reality Systems. In Proceedings of International Conference on Entertainment Computing (ICEC).Google Scholar
- K. Raaen and A. Petlund. 2015. How Much Delay Is There Really in Current Games? Proceedings of ACM Multimedia Systems (March 2015).Google ScholarDigital Library
- B. Ruiz. 2020. The Most Accurate Way to Schedule a Function in a Web Browser. Online: https://tinyurl.com/53xyex6s. (Accessed June 5, 2021).Google Scholar
- S. Sabet, S. Schmidt, S. Zadtootaghaj, B. Naderi, C. Griwodz, and S. Moller. 2020. A Latency Compensation Technique Based on Game Characteristics to Mitigate the Influence of Delay on Cloud Gaming Quality Of Experience. In Proceedings of ACM Multimedia Systems Conference (MMSys). Istanbul, Turkey.Google Scholar
- A. Schmid and R. Wimmer. 2021. Yet Another Latency Measuring Device. In Proceedings of the ACM Esports and High Performance HCI Workshop (EHPHCI). Virtual Conference.Google Scholar
- N. Sheldon, E. Girard, S. Borg, M. Claypool, and E. Agu. 2003. The Effect of Latency on User Performance in Warcraft III. In Proceedings of ACM Network and System Support for Games Workshop (NetGames). Redwood City, CA, USA.Google Scholar
- D. Stuckel and C. Gutwin. 2008. The Effects of Local Lag on Tightly-Coupled Interaction in Distributed Groupware. In Proceedings of theACM Conference on Computer Supported Cooperative Work. San Diego, CA, USA.Google Scholar
- J. Sun and M. Claypool. 2019. Evaluating Streaming and Latency Compensation in a Cloud-based Game. In In Proceedings of the 15th IARIA Advanced International Conference on Telecommunications (AICT). Nice, France.Google Scholar
- Chen Tao. [n.d.]. Clumsy. Online: https://jagt.github.io/clumsy/.Google Scholar
- The Linux Foundation. [n.d.]. netem. Online: https://wiki.linuxfoundation.org/networking/netem.Google Scholar
- R. Wimmer, A. Schmid, and F. Bockes. 2019. On the Latency of USB-Connected Input Devices. In Proceedings of the ACM CHI.Google Scholar
Index Terms
- EvLag: A Tool for Monitoring and Lagging Linux Input Devices
Recommendations
On the Latency of USB-Connected Input Devices
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing SystemsWe propose a method for accurately and precisely measuring the intrinsic latency of input devices and document measurements for 36 keyboards, mice and gamepads connected via USB. Our research shows that devices differ not only in average latency, but ...
Software-reduced touchscreen latency
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and ServicesDevices with touchscreens have an inherent latency. When a user's finger drags an object across the screen the object follows with a latency of around 100ms for current devices. Previous work showed that latencies down to 25ms reduce users' performance ...
Looking through the Eye of the Mouse: A Simple Method for Measuring End-to-end Latency using an Optical Mouse
UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & TechnologyWe present a simple method for measuring end-to-end latency in graphical user interfaces. The method works with most optical mice and allows accurate and real time latency measures up to 5 times per second. In addition, the technique allows easy ...
Comments