Skip to main content
Log in

An Integrated Approach to Select Key Quality Indicators in Transit Services

  • Original Research
  • Published:
Social Indicators Research Aims and scope Submit manuscript

Abstract

Recent interests in transit services have captured attention of experts on the monitoring of public transport quality. Previous research focused on relevant models and methods to monitor the quality of transit services and showed where and when different service quality levels occur. However, there was little attention to detect objectively a pool of key quality indicators (KQI) to be monitored, from a large set. This paper covers this gap by the proposal of an integrated approach, which identifies a long list of KQI, defines their properties, involves experts to elicit judgments for each KQI, evaluates the long list, and points out the most promising set. This integrated approach is demonstrated with an application based on an international survey and a Monte Carlo simulation method. Moreover, a restricted and relevant set of 9 overlapping KQI is derived by linking these results with those obtained from two different approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. For instance, the regularity can be measured in terms of the percentage of buses which maintain evenness headways at bus stops—transit—perspective orientation—or in terms of the percentage of passengers who wait at bus stops less than a fraction of scheduled headways—passenger-perspective orientation (e.g., Barabino et al. 2017).

  2. CEN/TC 320 (2002) issued the European Norm EN 13816:2002 for the definition, targeting and measurement of transit service quality. See the “Appendix” for details.

  3. These indicators are usually evaluated by PTCs for the purposes of standardization, benchmarking and quality certification.

  4. Eboli and Mazzulla (2015) began the analysis by choosing among 33 sub-indicators and restrict the investigation to a railway transit system.

  5. For the sake of synthesis, in what follows, service aspects, indicators and sub-indicators will all be referred to as indicators or KQI.

  6. EN 13816:2002 is a ground-breaking standard designed to enhance the promotion of a more customer-oriented quality approach within the public transportation sector. It is intended to be adopted by PTCs in the presentation and monitoring of their services, but it is recommended for use by authorities and transit agencies for the procurement of public passenger transport services in the preparation of invitations to tender.

    EN 15140:2006 is intended to help construct the measurement system and to help understand and reduce the causes of biases that any system of measurement may introduce. Moreover, a set of reference levels needed to measure the degree of fulfilment of the EN 13816:2002 indicators has been introduced, so to help in the adoption of standardized measurement methods and operational procedures for the service quality determination.

  7. Although this method may be questionable (Dyer 1990), many scholars defend it and document about the advantages deriving from its use (e.g., Saaty 1990; Harker and Vargas 1990; Forman and Gass 2001; Ramanathan 2001; Millet and Wedley 2002; Macharis et al. 2004; Oguztimur 2011). Moreover, AHP is widely adopted in many fields of engineering, which contribute to reinforce its use among bus operators (e.g., de Steiguer et al. 2003).

  8. For instance, the waiting time is not explicitly mentioned in CEN/TC 320 (2002), but it can be derived easily from measurements of regularity and/or punctuality (e.g., Barabino et al. 2017).

  9. http://cwur.org/2016.php.

  10. http://www.shanghairanking.com/.

  11. https://www.timeshighereducation.com/.

  12. http://www.uitp.org/. UITP is a no profit international organization including 1,400 members from 96 countries worldwide.

  13. https://it.linkedin.com/.

  14. www.skrapp.io.

  15. www.growthbot.org.

  16. For sake of completeness, the distribution of weights attributed to the quality and methodological components by academic and practitioners w.r.t. their geographical localization is reported in Table 10 in the “Appendix”.

  17. For sake of completeness, the distribution of weights attributed to the attributes of quality and methodological components by academic and practitioners w.r.t. their geographical localization is reported in Tables 11 and 12 in the “Appendix”.

  18. See Table 9 in the “Appendix” for details.

  19. www.scimagojr.com.

References

  • AFNOR Certification. NF 281. (2005a). Services de transport urbain de voyageurs. Règlement de certification générique. Saint-Denis la Plaine Cedex, France. Technical report.

  • AFNOR Certification. NF 286. (2005b). Services de transport urbain de voyageurs. Règlement de certification spécifiques. Saint-Denis la Plaine Cedex, France. Technical report.

  • Ayadi, A., & Hammami, S. (2015). Analysis of the technological features of regional public transport companies: The Tunisian case. Public Transport,7(3), 429–455.

    Article  Google Scholar 

  • Aydin, N., Celik, E., & Gumus, A. T. (2015). A hierarchical customer satisfaction framework for evaluating rail transit systems of Istanbul. Transportation Research Part A,77, 61–81.

    Article  Google Scholar 

  • Badami, M. G., & Haider, M. (2007). An analysis of public bus transit performance in Indian cities. Transportation Research Part A,41, 961–981.

    Google Scholar 

  • Balcome, R., Mckett, R., Pulley, N., Preston, J., Shires, J., Titheridge, H., et al. (2004). The demand for public transport: A practical guide. TRL report, TRL 593, TRL Limited.

  • Barabino, B. (2018). Automatic recognition of “low-quality” vehicles and bus stops in bus services. Public Transport,10(2), 257–289.

    Article  Google Scholar 

  • Barabino, B., Conversano, C., Cabras, N. A., & Fantola, M. (2019). Selecting key quality indicators in public transport systems using a robust method. In F. A. Ortega (Ed.), WIT transactions on the built environment (Vol. 182, pp. 73–84). Southampton: WIT Press.

    Google Scholar 

  • Barabino, B., & Deiana, E. (2013). On the attributes and influencing factors of end-users quality perceptions in urban transport: An exploratory analysis. Procedia: Social and Behavioral Sciences,87, 18–30.

    Google Scholar 

  • Barabino, B., Deiana, E., & Mozzoni, S. (2013). The quality of public transport service: The 13816 standard and a methodological approach to an Italian case. Ingegneria Ferroviaria,68(5), 475–499.

    Google Scholar 

  • Barabino, B., Deiana, E., & Mozzoni, S. (2015a). A framework to measure transit service quality areas to be managed. International Journal of Productivity and Quality Management,16(4), 390–415.

    Article  Google Scholar 

  • Barabino, B., Deiana, E., & Tilocca, P. (2011). Urban transport management and customer perceived quality: A case study in the metropolitan area of Cagliari, Italy. Theoretical and Empirical Researches in Urban Management,6(1), 19.

    Google Scholar 

  • Barabino, B., Deiana, E., & Tilocca, P. (2012). Measuring service quality in urban bus transport: A modified SERVQUAL approach. International Journal of Quality and Service Sciences,4(3), 238–252.

    Article  Google Scholar 

  • Barabino, B., & Di Francesco, M. (2016). Characterizing, measuring, and managing transit service quality. Journal of Advanced Transportation,50(5), 818–840.

    Article  Google Scholar 

  • Barabino, B., Di Francesco, M., & Mozzoni, S. (2015b). Rethinking bus punctuality by integrating automatic vehicle location data and passenger patterns. Transportation Research Part A,75, 84–95.

    Google Scholar 

  • Barabino, B., Lai, C., Casari, C., Demontis, R., & Mozzoni, S. (2017). Rethinking transit time reliability by integrating automated vehicle location data, passenger patterns, and web tools. IEEE Transactions on Intelligent Transportation Systems,18(4), 756–766.

    Article  Google Scholar 

  • Barry, J. (2005). Transport for London. Prepared for master in “European management training in transport and sustainable mobility”. Dublin.

  • Beirão, G., & Cabral, J. S. (2007). Understanding attitudes towards public transport and private car: A qualitative study. Transport Policy,14(6), 478–489.

    Article  Google Scholar 

  • Berry, L. L., Zeithaml, V. A., & Parasuraman, A. (1990). Five imperatives for improving service quality. Sloan Management Review Summer,31(4), 29–38.

    Google Scholar 

  • Cantwell, M., Caulfield, B., & O’Mahony, M. (2009). Examining the factors that impact public transport commuting satisfaction. Journal of Public Transportation,12(2), 1–21.

    Article  Google Scholar 

  • Castillo, H., & Pitfield, D. (2010). ELASTIC: A methodological framework for identifying and selecting sustainable transport indicators. Transportation Research Part D,15(4), 179–188.

    Article  Google Scholar 

  • CEN/TC 320. (2002). Transportation—Logistics and services. European Standard EN 13816: Public passenger transport—Service quality definition, targeting and measurement. European Committee for Standardization, Brussels. Technical report.

  • CEN/TC 320. (2006). Transportation—Logistics and services, European Standard EN 15140: Public passenger transport—Basic requirements and recommendation for systems that measure delivered service quality, European Committee for Standardization, Brussels. Technical report.

  • Chen, X., Yu, L., Zhang, Y., & Gou, J. (2009). Analysing urban bus service reliability at the stop, route, and network levels. Transportation Research Part A,43(8), 722–734.

    Google Scholar 

  • Dawes, J. (2008). Do data characteristics change according to the number of scale points used? International Journal of Market Research,50(1), 61–77.

    Article  Google Scholar 

  • de Oña, J., & de Oña, R. (2014). Quality of service in public transport based on customer satisfaction surveys: A review and assessment of methodological approaches. Transportation Science,49(3), 605–622.

    Article  Google Scholar 

  • de Oña, J., de Oña, R., Eboli, L., & Mazzulla, G. (2016). Index numbers for monitoring transit service quality. Transportation Research Part A: Policy and Practice,84, 18–30.

    Google Scholar 

  • de Steiguer, J. E., Duberstein, J., & Lopes, V. (2003). The analytic hierarchy process as a means for integrated watershed management. In K. G. Renard (Ed.), First interagency conference on research on the watersheds (pp. 736–740). Benson: U.S. Department of Agriculture, Agricultural Research Service.

    Google Scholar 

  • dell’Olio, L., Ibeas, A., & Cecin, P. (2011). The quality of service desired by public transport users. Transport Policy,18(1), 217–227.

    Article  Google Scholar 

  • Dever, J. A., Rafferty, A., & Valliant, R. (2008). Internet surveys: Can statistical adjustments eliminate coverage bias? Survey Research Methods,2(2), 47–62.

    Google Scholar 

  • Dhakal, S., & Imura, H. (2003). Policy-based indicator systems: Emerging debates and lessons. Local Environment,8(1), 113–119.

    Article  Google Scholar 

  • Doran, G. T. (1981). There’s a SMART way to write managements’ goals and objectives. Management Review,70, 35–36.

    Google Scholar 

  • Dyer, J. S. (1990). Remarks on the analytic hierarchy process. Management Science,36(3), 249–258.

    Article  Google Scholar 

  • Eboli, L., Forciniti, C., & Mazzulla, G. (2018). Spatial variation of the perceived transit service quality at rail stations. Transportation Research Part A, Policy and Practice,114, 67–83.

    Article  Google Scholar 

  • Eboli, L., & Mazzulla, G. (2007). Service quality attributes affecting customer satisfaction for bus transit. Journal of Public Transportation,10(3), 21–34.

    Article  Google Scholar 

  • Eboli, L., & Mazzulla, G. (2009). A new customer satisfaction index for evaluating transit service quality. Journal of Public Transportation,12(3), 21–37.

    Article  Google Scholar 

  • Eboli, L., & Mazzulla, G. (2010). How to capture the passengers point of view on a transit service through rating and choice options. Transport Reviews,30(4), 435–450.

    Article  Google Scholar 

  • Eboli, L., & Mazzulla, G. (2011). A methodology for evaluating transit service quality based on subjective and objective measures from the passenger’s point of view. Transport Policy,18, 172–181.

    Article  Google Scholar 

  • Eboli, L., & Mazzulla, G. (2012). Performance indicators for an objective measure of public transport service quality. European Transport,51, 1–21.

    Google Scholar 

  • Eboli, L., & Mazzulla, G. (2015). Relationships between rail passengers’ satisfaction and service quality: A framework for identifying key service factors. Public Transport,7(2), 185–201.

    Article  Google Scholar 

  • Forman, E. H., & Gass, S. I. (2001). The analytical hierarchy process-an exposition. Operations Research,49(4), 469–487.

    Article  Google Scholar 

  • Friman, M., Advardsson, B., & Gärling, T. (2001). Frequency of negative critical incidents and satisfaction with public transport services. Journal of Retailing and Consumer Services,8, 95–104.

    Article  Google Scholar 

  • Furth, P. G., Hemily, B., Muller, T. H. J., & Strathman, J. (2006). Using archived AVL-APC data to improve transit performance and management. TRB, Washington, DC, technical report TRCP 113.

  • Guirao, B., García-Pastor, A., & López-Lambas, M. E. (2016). The importance of service quality attributes in public transportation: Narrowing the gap between scientific research and practitioners’ needs. Transport Policy,49, 68–77.

    Article  Google Scholar 

  • Harker, P. T., & Vargas, L. G. (1990). Reply to “remarks on the analytic hierarchy process” by JS Dyer. Management Science,36(3), 269–273.

    Article  Google Scholar 

  • Hassan, M. N., Hawas, J. E., & Ahmed, K. (2013). A multi-dimensional framework for evaluating the transit service performance. Transportation Research Part A,50, 47–61.

    Google Scholar 

  • Heilig, L., & Voß, S. (2015). A scientometric analysis of public transport research. Journal of Public Transportation,18(2), 111–141.

    Article  Google Scholar 

  • Hensher, D. A. (2007). Bus transport: Economics, policy, and planning. New York: JAI Press.

    Google Scholar 

  • Hensher, D. A. (2014). The relationship between bus contract costs, user perceived service quality and performance assessment. International Journal of Sustainable Transportation,8(1), 5–27.

    Article  Google Scholar 

  • Hensher, D. A. (2015). Using contracted assets to undertake non-contracted services as a way to improve cost efficiency under negotiated or tendered bus contracts. Journal of Strategic Contracting and Negotiation,1(2), 111–128.

    Article  Google Scholar 

  • Hensher, D. A., & Houghton, J. (2004). Performance-based quality contracts for the bus sector: delivering social and commercial value for money. Transportation Research Part B,38, 123–146.

    Article  Google Scholar 

  • Hensher, D. A., & Stanley, J. (2003). Performance-based quality contracts in bus service provision. Transportation Research Part A,37, 519–538.

    Google Scholar 

  • Hirschhorn, F., Veeneman, W., & van de Velde, D. (2018). Inventory and rating of performance indicators and organisational features in metropolitan public transport: A worldwide Delphi survey. Research in Transportation Economics,69, 144–156.

    Article  Google Scholar 

  • Kittelson & Associates. (2003). Transit cooperative research program & transit development corporation. A guidebook for developing a transit performance-measurement system (Vol. 88). Washington: Transportation Research Board.

    Google Scholar 

  • Kittelson & Associates Inc, KFH Group Inc, Parsons Brinckerhoff Quade & Douglass Inc, & Zaworski, K. H. (2003). Transit capacity and quality of service manual (2nd ed.). Washington, DC: TRB.

    Google Scholar 

  • Liekendael, J. C., Furth, P. G., & Muller, T. H. J. (2006). Service quality certification in Brussels, Belgium. A quality process with teeth. Transportation Research Record,1955, 88–95.

    Article  Google Scholar 

  • Lin, J., Wang, M. L., & Barnum, P. D. (2008). A quality control framework for bus schedule reliability. Transportation Research Part E,44(6), 1086–1098.

    Article  Google Scholar 

  • Macharis, C., Springael, J., De Brucker, K., & Verbeke, A. (2004). PROMETHEE and AHP: The design of operational synergies in multicriteria analysis: Strengthening PROMETHEE with ideas of AHP. European Journal of Operational Research,153(2), 307–317.

    Article  Google Scholar 

  • Mahmoud, M. M., Hine, J., & Kashyap, A. (2011). Bus transit service quality monitoring in UK: A methodological framework. In Proceedings of the ITRN 2011. www.itrn.ie/uploads/sesD2_ID75.pdf. Retrieved September 28, 2016.

  • Millet, I., & Wedley, W. C. (2002). Modelling risk and uncertainty with the analytic hierarchy process. Journal of Multi-Criteria Decision Analysis,11, 97–107.

    Article  Google Scholar 

  • Moffat, A. (2014). The evolution of bus contracts in London. Transport for London. http://embarqbrasil.org/sites/default/files/9.%20Alex%20Moffat%20-%20London.pdf. Retrieved September 10, 2016.

  • MORPACE International Inc, Cambridge Systematics Inc. (1999). A handbook for measuring customer satisfaction and service quality. TRB, TCRP report 47, National Research Council, Washington DC.

  • Nathanail, E. (2008). Measuring the quality of service for passengers on the Hellenic railways. Transportation Research Part A,42, 48–66.

    Google Scholar 

  • Oguztimur, S. (2011). Why fuzzy analytic hierarchy process approach for transport problems? 51st congress of the European Regional Science Association, 30 August–3 September 2011, Barcelona, Spain.

  • Parasuraman, A., Berry, L. L., & Zeithaml, V. A. (1991). Refinement and reassessment of the SERVQUAL scale. Journal of Retailing,67(4), 420–450.

    Google Scholar 

  • Prioni, P., & Hensher, D. A. (2000). Measuring service quality in scheduled bus services. Journal of Public Transportation,3(2), 51–74.

    Article  Google Scholar 

  • Ramanathan, R. (2001). A note on the use of the analytic hierarchy process for environmental impact assessment. Journal of Environmental Management,63, 27–35.

    Article  Google Scholar 

  • Saaty, T. L. (1980). The analytic hierarchy process. New York: McGraw-Hill.

    Google Scholar 

  • Saaty, R. W. (1987). The analytic hierarchy process—What it is and how it is used. Mathematical Modelling,9(3–5), 161–176.

    Article  Google Scholar 

  • Saaty, T. L. (1990). An exposition of the AHP in reply to the paper “remarks on the analytic hierarchy process”. Management Science,36(3), 259–268.

    Article  Google Scholar 

  • Sheth, C., Triantis, K., & Teodorovic, D. (2007). Performance evaluation of bus routes: A provider and passenger perspective. Transportation Research Part E,43, 453–478.

    Article  Google Scholar 

  • Sivo, S. A., Saunders, C., Chang, Q., & Jiang, J. J. (2006). How low should you go? Low response rates and the validity of inference in IS questionnaire research. Journal of the Association for Information Systems,7(6), 351–414.

    Article  Google Scholar 

  • STIB Bruxelles. (2011). Manuel de maitrise de la qualitè de service. Technical report.

  • Stradling, S., Anable, J., & Carreno, M. (2007). Performance, importance and user disgruntlement: A six method for measuring satisfaction with travel modes. Transportation Research Part A,41(1), 98–106.

    Google Scholar 

  • Too, L., & Earl, G. (2010). Public transport service quality and sustainable development: A community stakeholder perspective. Sustainable Development,18(1), 51–61.

    Google Scholar 

  • Tyrinopoulos, Y., & Antoniou, C. (2008a). A complete methodology for the quality control of passenger services in the public transport business. European Transport,15, 1–16.

    Google Scholar 

  • Tyrinopoulos, Y., & Antoniou, C. (2008b). Public transit user satisfaction: Variability and policy implications. Transport Policy,15, 260–272.

    Article  Google Scholar 

  • Wang, T. C., & Lee, H. D. (2009). Developing a fuzzy TOPSIS approach based on subjective weights and objective weights. Experts Systems with Applications,36(5), 8980–8985.

    Article  Google Scholar 

  • Zelany, M. (1974). A concept of compromise solutions and the method of the displaced ideal. Computers and Operations Research,1(3–4), 479–496.

    Article  Google Scholar 

Download references

Acknowledgements

This work was partially supported by the Italian Ministry of University and Research (MIUR), within the Smart City framework (project: PON04a2_00381 “CAGLIARI2020”) and by Regione Autonoma della Sardegna (IT) (Grant Name: Programmazione Unitaria 2007/2013—P.O. FESR 2007/2013, Interventi a sostegno della competitività e dell’innovazione 2016-2018).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Claudio Conversano.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

See Tables 9, 10, 11 and 12.

Table 9 The long list of KQI.
Table 10 Distribution of observed weights of methodological and relevance to quality components
Table 11 Distribution of observed weights of methodological components
Table 12 Distribution of adjusted weights of quality components

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Barabino, B., Cabras, N.A., Conversano, C. et al. An Integrated Approach to Select Key Quality Indicators in Transit Services. Soc Indic Res 149, 1045–1080 (2020). https://doi.org/10.1007/s11205-020-02284-0

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11205-020-02284-0

Keywords

Mathematics Subject Classification

Navigation