Xiao Sun
ABSTRACT
This paper proposes SymDetector, a smartphone based application to unobtrusively detect the sound-related respiratory symptoms occurred in a user's daily life, including sneeze, cough, sniffle and throat clearing. SymDetector uses the built-in microphone on the smartphone to continuously monitor a user's acoustic data and uses multi-level processes to detect and classify the respiratory symptoms. Several practical issues are considered in developing SymDetector, such as users' privacy concerns about their acoustic data, resource constraints of the smartphone and different contexts of the smartphone. We have implemented SymDetector on Galaxy S3 and evaluated its performance in real experiments involving 16 users and 204 days. The experimental results show that SymDetector can detect these four types of respiratory symptoms with high accuracy under various conditions.
- Birring, S., Fleming, T., Matos, S., Raj, A., Evans, D., and Pavord, I. The leicester cough monitor: preliminary validation of an automated cough detection system in chronic cough. European Respiratory Journal 31, 5 (2008), 1013--1018.Google Scholar
Cross Ref
- Bottou, L., Cortes, C., Denker, J. S., Drucker, H., Guyon, I., Jackel, L. D., LeCun, Y., Muller, U. A., Sackinger, E., Simard, P., et al. Comparison of classifier methods: a case study in handwritten digit recognition. In International Conference on Pattern Recognition, IEEE Computer Society Press (1994), 77--77.Google ScholarCross Ref
- Brajdic, A., and Harle, R. Walk detection and step counting on unconstrained smartphones. In ACM UbiComp (2013). Google ScholarDigital Library
- Chang, C.-C., and Lin, C.-J. Libsvm: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology (TIST) 2, 3 (2011), 27. Google ScholarDigital Library
- Chechik, G., Ie, E., Rehn, M., Bengio, S., and Lyon, D. Large-scale content-based audio retrieval from text queries. In ACM Int'l Conf. on Multimedia information retrieval (2008). Google ScholarDigital Library
- Chunara, R., Aman, S., Smolinski, M., and Brownstein, J. S. Flu near you: an online self-reported influenza surveillance system in the USA. Online Journal of Public Health Informatics 5, 1 (2013).Google ScholarCross Ref
- Daisey, J. M., Angell, W. J., and Apte, M. G. Indoor air quality, ventilation and health symptoms in schools: an analysis of existing information. Indoor air 13, 1 (2003), 53--64.Google Scholar
- Dhanalakshmi, P., Palanivel, S., and Ramalingam, V. Classification of audio signals using aann and gmm. Applied Soft Computing 11, 1 (2011), 716--723. Google ScholarDigital Library
- Friedman, J. Another approach to polychotomous classifcation. Dept. Statist., Stanford Univ., Stanford, CA, USA, Tech. Rep (1996).Google Scholar
- Hao, T., Xing, G., and Zhou, G. isleep: unobtrusive sleep quality monitoring using smartphones. In ACM SenSys (2013). Google ScholarDigital Library
- Hsu, C.-W., and Lin, C.-J. A comparison of methods for multiclass support vector machines. Neural Networks, IEEE Transactions on 13, 2 (2002), 415--425. Google ScholarDigital Library
- Keally, M., Zhou, G., Xing, G., Wu, J., and Pyles, A. Pbn: towards practical activity recognition using smartphone-based body sensor networks. In ACM SenSys (2011). Google ScholarDigital Library
- Kraman, S. S., Wodicka, G. R., Pressler, G. A., and Pasterkamp, H. Comparison of lung sound transducers using a bioacoustic transducer testing system. Journal of Applied Physiology 101, 2 (2006), 469--476.Google ScholarCross Ref
- Kubat, M., Matwin, S., et al. Addressing the curse of imbalanced training sets: one-sided selection. In ICML, vol. 97, Nashville, USA (1997), 179--186.Google Scholar
- Larson, E. C., Lee, T., Liu, S., Rosenfeld, M., and Patel, S. N. Accurate and privacy preserving cough sensing using a low-cost microphone. In ACM UbiComp (2011). Google ScholarDigital Library
- Li, D., Sethi, I. K., Dimitrova, N., and McGee, T. Classification of general audio data for content-based retrieval. Pattern recognition letters 22, 5 (2001), 533--544. Google ScholarDigital Library
- Li, Q., and Cao, G. Privacy-preserving participatory sensing. IEEE Communication Magazine, to appear.Google Scholar
- Li, Q., and Cao, G. Providing privacy-aware incentives for mobile sensing. In IEEE Percom (2013).Google Scholar
- Liao, W.-H., Wen, J.-Y., and Kuo, J.-H. Streaming audio classification in smart home environments. In Pattern Recognition (ACPR), 2011 First Asian Conference on, IEEE (2011), 593--597.Google ScholarCross Ref
- Liu, Z., Wang, Y., and Chen, T. Audio feature extraction and analysis for scene segmentation and classification. Journal of VLSI 20, 1--2 (1998), 61--79. Google ScholarDigital Library
- Lu, H., Frauendorfer, D., Rabbi, M., Mast, M. S., Chittaranjan, G. T., Campbell, A. T., Gatica-Perez, D., and Choudhury, T. Stresssense: Detecting stress in unconstrained acoustic environments using smartphones. In ACM UbiComp (2012). Google ScholarDigital Library
- Lu, H., Pan, W., Lane, N. D., Choudhury, T., and Campbell, A. T. Soundsense: scalable sound sensing for people-centric applications on mobile phones. In ACM MobiSys (2009). Google ScholarDigital Library
- Matos, S., Birring, S. S., Pavord, I. D., and Evans, D. H. Detection of cough signals in continuous audio recordings using hidden markov models. Biomedical Engineering, IEEE Transactions on 53, 6 (2006), 1078--1083.Google Scholar
- Matos, S., Birring, S. S., Pavord, I. D., and Evans, D. H. An automated system for 24-h monitoring of cough frequency: the leicester cough monitor. Biomedical Engineering, IEEE Transactions on 54, 8 (2007), 1472--1479.Google Scholar
- McGuinness, K., Kelsall, A., Lowe, J., Woodcock, A., and Smith, J. Automated cough detection: a novel approach. Am J Respir Crit Care Med 175 (2007), A381.Google Scholar
- Nirjon, S., Dickerson, R. F., Li, Q., Asare, P., Stankovic, J. A., Hong, D., Zhang, B., Jiang, X., Shen, G., and Zhao, F. Musicalheart: A hearty way of listening to music. In Proceedings of the 10th ACM Conference on Embedded Network Sensor Systems, ACM (2012), 43--56. Google ScholarDigital Library
- Rahman, T., Adams, A. T., Zhang, M., Cherry, E., Zhou, B., Peng, H., and Choudhury, T. Bodybeat: A mobile system for sensing non-speech body sounds. In Proceedings of the 12th annual international conference on Mobile systems, applications, and services, ACM (2014), 2--13. Google ScholarDigital Library
- Reichert, S., Gass, R., Brandt, C., and Andrès, E. Analysis of respiratory sounds: state of the art. Clinical medicine. Circulatory, respiratory and pulmonary medicine 2 (2008), 45.Google Scholar
- Saunders, J. Real-time discrimination of broadcast speech/music. In IEEE Int'l Conf. on Acoustics, Speech and Signal Processing (ICASSP) (1996). Google ScholarDigital Library
- Smith, J., and Woodcock, A. New developments in the objective assessment of cough. Lung 186, 1 (2008), 48--54.Google ScholarCross Ref
- Sun, X., Lu, Z., Zhang, X., Salathé, M., and Cao, G. Targeted vaccination based on a wireless sensor system. In IEEE Percom (2015).Google ScholarCross Ref
- Temko, A., Macho, D., and Nadeu, C. Fuzzy integral based information fusion for classification of highly confusable non-speech sounds. Pattern Recognition 41, 5 (2008), 1814--1823. Google ScholarDigital Library
- Temko, A., and Nadeu, C. Classification of acoustic events using svm-based clustering schemes. Pattern Recognition 39, 4 (2006), 682--694. Google ScholarDigital Library
- Whittaker, A., Lucas, M., Carter, R., and Anderson, K. Limitations in the use of median frequency for lung sound analysis. Proceedings of the Institution of Mechanical Engineers, Part H: Journal of Engineering in Medicine 214, 3 (2000), 265--275.Google Scholar
- Yatani, K., and Truong, K. N. Bodyscope: a wearable acoustic sensor for activity recognition. In ACM Ubicomp (2012). Google ScholarDigital Library
Index Terms
- SymDetector: detecting sound-related respiratory symptoms using smartphones
Recommendations
Indoor-outdoor activity recognition by a smartphone
UbiComp '12: Proceedings of the 2012 ACM Conference on Ubiquitous ComputingIt is increasingly important to recognize daily activity pattern in order to detect early sign of dementia in the aging society. This paper shows indoor-outdoor activity recognition using only a smartphone. We developed an indoor living activity ...
A wearable smartphone-based platform for real-time cardiovascular disease detection via electrocardiogram processing
Special section on new and emerging technologies in bioinformatics and bioengineeringCardiovascular disease (CVD) is the single leading cause of global mortality and is projected to remain so. Cardiac arrhythmia is a very common type of CVD and may indicate an increased risk of stroke or sudden cardiac death. The ECG is the most widely ...
SymListener: Detecting Respiratory Symptoms via Acoustic Sensing in Driving Environments
Sound-related respiratory symptoms are commonly observed in our daily lives. They are closely related to illnesses, infections, or allergies but ignored by the majority. Existing detection methods either depend on specific devices, which are inconvenient ...
Comments