Abstract

In this paper, we evaluate the performance of major public road transport organizations in India. The contribution of the paper lies in integrating four multicriteria decision-making (MCDM) techniques to assess the relative performance of public road transportation systems on twenty-three criteria across two consecutive years. The paper classifies the criteria into functional heads and establishes the relative importance of heads using the analytical hierarchical process (AHP). The efficiency scores of each organization referred to as a decision-making unit (DMU) were computed for the classified heads using the Data Envelopment Analysis (DEA) approach. The multicriteria optimization and compromise solution technique “VlseKriterijumska Optimizacija I Kompromisno Resenje” (VIKOR) was used to assign a final rank to each of the DMUs using computed efficiency scores and established weights. Finally, we analyzed the performance of the DMUs across the two consecutive years using the Malmquist Productivity Index (MPI). Our key findings are as follows: First, the performance of all DMUs has improved in the second year with respect to the first year; second, significant improvement is observed in the “expenses” functional head which carries a substantial weight among the functional heads; third, barring few DMUs, the performance of the majority of DMUs has worsened in the “accident” functional head; fourth, while few DMUs have been consistently very good performers in both the years, there are also few DMUs which have consistently performed poorly in both the years. The inferences drawn from the study can be leveraged for future policy formulations by the state government and local municipal corporations and for sharing best practices among the DMUs.

1. Introduction

Public road transport organizations are an integral part of the Indian transport sector. While an increasing number of car and two-wheelers contribute to traffic congestion and pollution, the bus-based public road transport services accommodate a larger number of commuters, thereby transporting the maximum number of people per unit of road space and passenger—km per litre. On an average, the energy consumption of a car is 6 times more than that of a bus, whereas energy consumption of two- and three-wheelers is 2.5 and 4.7 times more than that of a bus, respectively. This highlights the need for the growth of public road transport organizations as a means of mass commuting to meet the transport demand of the country.

Public road transportation organizations require substantial improvements on several fronts to become a preferred choice of commutation for passengers. During 2014-2015, public road transport organizations in India reported 19076 road accident cases, of which 4129 were fatal accidents [1]. Indian public road organizations lag on bus penetration. The bus penetration in India (1.4 buses per 1000 persons) is much lower as compared to that of other developing countries like Thailand (8.6 buses per 1000 persons), South Africa (6.5 buses per 1000 persons), and Mexico (2.8 buses per 1000 persons) [1]. It is suggested that public road transport organizations should modernize the fleet and scrap overaged buses which are necessary to maintain service quality and meet the expectation of passengers.

To become an effective means of mass commutation, it is important that public road transport organizations become financially and operationally efficient. The road transport organizations should boost traffic revenue, trim unnecessary expenses, increase operational efficiency, and provide accident-free safe services to the passengers. The best performing road transport organization on each criterion should be identified, benchmarked, and the key learnings should be shared among the organizations. A comprehensive performance evaluation technique needs to be developed which evaluates the relative performance of road transport organizations on multiple criteria and ranks these organizations based on their relative performances.

1.1. Contribution

The objective of the study is to develop a methodology to assess and compare the performance of DMUs on multiple functional criteria, thereby resulting in a comprehensive performance evaluation of the DMUs. The proposed methodology can draw comparisons between intrastate and interstate DMUs operating on different scales and hence can be applied for DMUs belonging to any region, state, or country. The methodology developed can evaluate the performance of a group of DMUs belonging to any common functional domain and thus can be applied widely. The primary contribution of the study lies in integrating the following MCDM techniques: AHP to establish the relative importance of functional heads; DEA to compute the efficiency score of DMUs for each functional head; VIKOR to rank DMUs based on computed efficiency scores and established weights; MPI to assess the performance of DMUs in the second year with respect to their performance in the first year.

To demonstrate the application of the proposed methodology, we evaluate the performance of major public road transport organizations in India, which shall provide state governments and local municipal corporations a base to identify the areas of improvement and make suitable policy amendments to address them. Based on twenty-three criteria spanning two consecutive years, we analyze the relative performance of forty-two public road transport organizations by constituting six functional heads. The best performing DMUs are identified for benchmarking and relative comparison among the DMUs.

The subsequent sections of this paper are organized in the following manner: We start by reviewing the extant literature and then explain briefly the tools used for this study such as AHP, DEA, VIKOR, and MPI. Then, we introduce our proposed methodology followed by results, analysis, and conclusion.

2. Literature Review

Many studies have been carried out to evaluate similar performance in different countries/regions. For instance, Annema et al. [2] have critically evaluated two methods of designing an appraisal tool for public transport. They have used two approaches: cost-benefit analysis (CBA) and multicriteria decision-making tools (MCDMTs). They developed a chart to study the trade-off information and suggested a possible approach to incorporate them together. Pineda et al. [3] have proposed an integrated method to evaluate the operational and financial performance of airlines. They incorporated the data analytics network process (DANP) along with VIKOR to evaluate different airlines in the USA. In this study, we provide an approach that uses MCDMT only, but it incorporates both operational and financial criteria for evaluation.

Many studies for the performance evaluation of transportation systems and other associated areas have been conducted using MCDM techniques. Pérez et al. [4] have presented a review of papers published between 1982 and 2014, which highlights the MCDM techniques being used for decision making in urban public transport systems. Cruz et al. [5] and Holmgren [6] conducted performance evaluation studies in Portugal and Sweden, respectively. While Cruz worked with DEA-based benchmarking models, Holmgren used frontier-based evaluation of efficiency. Similarly, Vaidya [7] and Saxena [8] evaluated road transportation in the Indian context. Vaidya [7] evaluated Indian state/regional transport units using DEA and AHP. He adopted a top-down approach and computed the overall efficiency values to understand the performance of a given transportation unit. Saxena [8] used the DEA approach to formulate a benchmarking strategy for Delhi Transport Corporation. Chakraborty et al. [9] performed a performance evaluation of Indian roads on state-wise data using PROMTHEE_GIS. Ranjan et al. [10] evaluated Indian railway zones using DEMATEL and VIKOR. Some authors have exclusively used DEA for performance evaluation in road transports systems. Hawas et al. [11] and Hahn et al. [12] used DEA exclusively for the evaluation of bus services. These investigations were used to reduce operating costs and make policy decisions like the addition of bus stops and reduction of taxes. Rodrigues et al. [13] evaluated road freight transport performance by developing “extra distance” as a measure for evaluation. In this study, we perform both year-specific relative evaluation (using DEA and VIKOR) and inter-year evaluation (using MPI) of Indian public transport systems.

Some of the recent works have focused on integrating stakeholder involvement with MCDM techniques to support decision making related to transportation. Macharis et al. [14] have proposed multiactor multicriteria analysis (MAMCA) for the evaluation of transport projects; they focus on the inclusion of qualitative as well as quantitative criteria. Ignaccolo et al. [15] have combined AHP with role-playing games for stakeholder engagement in transport decisions. Ghorbanzadeh et al. [16] have used interval AHP to create a decision support model while considering the involvement of various stakeholder groups in a sustainable urban transport model. Similarly, Moslem et al. [17] have used interval AHP and fuzzy AHP to analyze stakeholder consensus in urban transport development. Giuffrida et al. [18] have carried out a comprehensive literature review of the use of VGI and PPGIS in transport studies and proposed a framework for the evaluation of transport alternatives. They point towards the usefulness of integration between public participation, GIS, and quantitative methods to foster technically sound and shared decisions. Ignaccolo et al. [19] have investigated citizen preferences for designing a new transport service using MCDMT. Duleba and Moslem [20] examined the pareto-optimality of the eigenvector obtained from a pairwise comparison matrix in AHP; they applied it to the real data collected from Mersin, Turkey, to gauze the public preference on development of supply quality elements in local bus transportation services. Moslem et al. [21] have integrated a hybrid AHP with BWM to determine significant supply quality criteria for public transportation.

Some authors have tried to use MCDM techniques not only just to evaluate the performance of the public transport system but also to compare it against other modes of transportation. Lopez Lambas and Giuffrida [22] have proposed the use of TOPSIS with GIS to choose between the construction of bus rapid transit (BRT) and light-rail transit (LRT) systems. Nassereddine and Eskandari [23] evaluated the public transport system in Tehran. They proposed a novel MCDM method by integrating DELPHI, GAHP, and PROMETHEE and used it to determine the importance of various means of public transport in Tehran. Garcia Sanchez [24] used DEA, PCA, and Tobit regression for analyzing public bus transport in Spain and concluded that there was no significant difference in the performance of the public transport system against the private transport system. Gonçalves de Carvalho Wolff and Antonio Farah Caldas [25] proposed a transport infrastructure model (TIM) to evaluate Brazilian road transport. Sun et al. [26] have evaluated public transport accessibility in the urban network by using two indices: the supply level of urban public transport and a public transport-private car traveling time ratio.

This study primarily focuses on developing a methodology to evaluate the performance of the DMUs by integrating four MCDM techniques: AHP, DEA, VIKOR, and MPI. The application of the developed methodology is then illustrated by assessing the performance of public road transport organizations in India. The forty-two public road transport organizations are evaluated on twenty-three criteria classified under six functional heads. The performances of these DMUs are analyzed for two consecutive years, i.e., 2014-2015 and 2015-2016, respectively. The public road transport organizations are categorized based on their performance, the best-performing organizations in each year are identified, and improvement in their ranks across the two years is analyzed. This study uses the proposed methodology to compare road transport organizations among peers and identifies the best-performing units to help in policy formulation and sharing of best practices.

3. Research Method

In this section, we briefly explain the tools used in this study for the evaluation of performance of DMUs. A schematic representation of the proposed methodology is available in Figure 1. To facilitate the proposed analysis of the DMUs, we need to develop a phase-wise evaluation method using the four techniques we discuss below. The DMUs under consideration are spread across the country operating on different scales with varying size and staff strength. The magnitude of revenue and costs varies largely across DMUs. Hence, a direct comparison of their absolute numbers will not give accurate performance results; rather, we should focus on comparing the ratio of the output to input of each of the transportation system. Such an analysis is facilitated by DEA, but a number of DMUs may come out with an efficiency score of 1 in DEA. To obtain unique ranking for the DMUs, we use the efficiency scores obtained from DEA as input in VIKOR. Finally, we need to provide some weights to each of the evaluation criteria which is a highly judgemental call, for which we have resorted to AHP. Furthermore, we have also performed a longitudinal comparison of the DMUs to see how their performance has changed over the years; this analysis is facilitated by using Malmquist DEA.

3.1. Analytic Hierarchical Process (AHP)

AHP is used to determine the relative importance of the criteria involved in decision making. AHP can be used for both qualitative and quantitative criteria which can be compared to determine relative weights and rankings [27, 28]. To use AHP, following steps needs to be performed :(a)Structuring the decision problem: To solve any decision-making problem using AHP, it should be structured into a minimum of three levels as follows:(i)Level 1 (goal statement): in this study, the goal was to rank the DMUs in the order of their performance.(ii)Level 2 (criteria definition): DMUs were evaluated on 23 criteria which were classified into 6 functional heads.(iii)Level 3 (picking the alternatives): this study compared 42 DMUs for ranking the DMUs in terms of their performances.(b)Pairwise comparison: it is the subjective part of the AHP, wherein comparisons are carried out based on the judgment of area experts. Pairwise comparison results into the decision matrix whose elements consist of relative weights of one criterion over the other. The range of pairwise comparisons is from 1/9 to 9.(c)Calculation of weights: weights are calculated using the concept of the eigenvector. In this concept, the decision matrix is squared; the sum of the elements of the row is calculated and then normalized. The process must be iterated until the difference between the elements of the two resultant vectors (i.e., the difference in the eigenvector solution) is insignificant. The elements of the last eigenvector solution are the weights of the criteria.(d)Check for consistency: consistency check is done to check the consistency of judgments. The check for consistency is done using the consistency ratio (CR). If the value of CR exceeds 0.1, it is inferred that judgments are inconsistent, and the exercise must be repeated. The steps to use AHP are shown in Figure 2.(e)Sensitivity analysis: it is done to check the stability of the final result and identify the functional heads which are most critical to the results. We adopt the absolute top (AT) method given by Triantaphyllou and Sanchez [29]. AT is defined as the smallest change in the weight of criteria which will result in a change in the rank of the topmost DMU.

3.2. Data Envelopment Analysis (DEA)

The DEA concept was initially conceived by Farrell [30] for evaluating the US government program in the education sector. Later, Charnes et al. [31] developed the model which came to be known as the CCR DEA model. DEA is a performance measurement technique based on linear programming and is used for calculating the efficiencies of DMUs. The performance of a DMU is determined through efficiency which is defined as the ratio of total weighted outputs to total weighted inputs.

The efficiency of DMUs in DEA is measured relative to an efficiency frontier which is built by connecting the best-performing DMUs. The best-performing DMUs/efficient DMUs are allocated an efficiency score of 1 (100%) and lie on the frontier. Other DMUs whose efficiency score is less than 1 lie inside the frontier. None of the DMUs shall lie out of the frontier since the efficiency score of greater than 1 is not feasible. The notations and equations used in the formulation of DEA for the DMU are the following:where is the efficiency of the DMU, is the output of the DMU, is the weight of the output, is the input of the DMU, is the weight of the input, and and are the output and input of the DMU.

3.3. Multicriteria Optimization and Compromise Solution (VIKOR)

The initial concepts of VIKOR were developed by Opricovic S. with its application published by Duckstein and Opricovic [32]. The VIKOR method computes the utility and regret parameters for each of the DMUs. The VIKOR method results in 3 scores for each DMU: overall score (Q), utility score (S), and regret score (R). The overall score is computed by assigning equal weights to the utility and regret scores. The variables and equations used for calculation of the score as given by Opricovic and Tzeng [33] in their comparative analysis of TOPSIS and VIKOR are as follows:wherewhere is the number of alternatives, is the number of criteria, is the value of the criterion function for the alternative , is the overall score of the alternative, is the utility score of the alternative, is the regret score of the alternative, and is the weight of the majority of criteria.

After obtaining the values of S, R, and Q, alternatives are ranked by sorting these values in the decreasing order. The results are three ranking lists. A compromise solution, i.e., the alternative A(1), which is the best ranked by the measure Q (minimum) as given in [34, 35], is proposed if the following two conditions are satisfied:(a)Condition of acceptable advantage: when Q(A(2)) − Q(A(1)) ≥ DQ, where DQ = 1/(j − 1) and A(2) is the alternative with the second position on the ranking list by Q(b)Condition of acceptable stability in decision making: the alternative A(1) must also be the best ranked by S or/and R

If one of the conditions is not satisfied, then a set of compromise solutions is proposed, which consists of the following:(i)Alternative A(1) and A(2) if only condition (b) is not satisfied, or(ii)Alternatives A(1), A(2), …, A(M) if condition (a) is not satisfied, where A(M) is determined by the relation Q(A(M)) − Q(A(1)) < DQ for maximum M

3.4. Malmquist Productivity Index (MPI)

Malmquist [36] proposed the initial concept of the MPI which was further built upon by many authors. The method of measuring the change in efficiency through the MPI using the DEA frontier was given by Färe et al. [37]. The equivalent way of writing the MPI is given bywhere is the input at time t, is the output at time t, is the output-based Malmquist productivity change index, and is the output distance function at time t.

The value of should be interpreted as follows: indicates that efficiency has increased over the earlier period indicates that efficiency has decreased over the earlier period indicates no change in the efficiency

In this study, is applied to compare the efficiencies of DMUs across two years on each of the six functional heads.

We use these tools in a phased manner to perform the evaluation of the DMUs; the same has been elaborated in detail in the subsequent section.

4. Results

In this section, we explain the computational details of the analyses and show the subsequent results. The DMUs used in this study were the state/municipal run road transport corporations (Appendix A of Supplementary Material (available here)). The required data were taken from a report published by the Ministry of Road Transport and Highways, Government of India [1]. The data used were for two consecutive years: 2014-2015 and 2015-2016 (Tables B1 and B2 in Appendix B of Supplementary Material). The various input and output criteria for different functional heads used in DEA are briefly described in Appendix C of Supplementary Material.

4.1. Phase-Wise Performance Evaluation

The evaluation of the relative performance of the transportation system has been carried out in the following four phases.

4.1.1. Phase 1

In phase 1, AHP was used to determine the relative weights of the 6 functional heads: accident, traffic revenue, expenses, vehicle operations, manpower operations, and maintenance. A team of 5 experts provided their pairwise judgments. 2 experts were regular commuters of public transport, one expert was from the strategic team of an organization involved, one expert was from an operational team of an organization, and one expert was an academician. All the experts were at least a graduate and had three years of work experience. A questionnaire was given to all the experts to rate the importance of each of the criteria. Furthermore, discussions were held with the experts to form a pairwise comparison matrix for the functional heads under consideration. A consolidated pairwise comparison obtained as per requirements of group decision making (geometric mean) of the functional heads is shown in Table 1. The weights assigned to functional heads were accident (0.084), traffic revenue (0.258), expenses (0.258), vehicle operations (0.136), manpower (0.154), and maintenance (0.109) (Tables 2 and 3).

The consistency check for the pairwise comparison was done by calculating the consistency index (CI) and consistency ratio (CR). The value of CI was 0.014 and CR was 0.011 (less than 0.1), thereby ensuring consistency in the pair-wise judgments.

4.1.2. Phase 2

In this phase, single-stage input-oriented CCR DEA was used to compute the efficiency of functional heads of all the DMUs. It is to be noted that few functional heads like accident, expenses, and maintenance were of lower the better type. To accommodate this, Ali and Seiford [38] computed the efficiencies by considering the TRβ approach. In this approach, a large, scalar β was added to each of the undesirable output values such that the transformed values are positive. This transformation follows the expression:where r is the output, j is the DMU, q is the undesirable output value, and f(q) is the desired transformed value.

For computing the efficiency value of each of the DMU, we have used the DEAP 2.1 computer program developed by the Centre for Efficiency and Productivity Analysis, University of Queensland, Brisbane, Australia. Other methods/tools like excel solver can be used for the same. DEAP 2.1 has been used because of its ease of use and accessibility. The details of the software can be found in [39].

4.1.3. Phase 3

In the third phase of the study, the VIKOR method was applied to obtain the overall score of each of the DMUs. The weights and efficiency values used in VIKOR were those obtained in the first phase and second phase, respectively. The efficiency values were used to construct a decision matrix which acts as an input for the VIKOR method of ranking the alternatives. Ranks were awarded in the descending order of the score with the best performer having the minimum score.

4.1.4. Phase 4

The MPI was computed in the last phase, which measures the total factor productivity change between the two periods. It was applied to check whether the efficiency of DMUs has increased, decreased, or remained the same over the two years.

4.2. Performance Results of 2014-2015

The final ranks of DMUs based on the Q score are shown in Table 2. The DMUs can be identified from their serial number (Sr. No. of the DMU) using Appendix A of Supplementary Material.

From Table 2, we realize Thane MT (DMU Sr. No. 35), Navi Mumbai MT (DMU Sr. No. 22), and Odisha SRTC (DMU Sr. No. 26) ranked 1, 2, and 3, respectively, among the DMUs. Similarly, Gujarat SRTC (DMU Sr. No. 11), Telangana SRTC (DMU Sr. No. 34), and South Bengal STC (DMU Sr. No. 32) ranked the last among the DMUs with ranks 40, 41, and 42, respectively. It is important to note that the best performer with rank 1 has the least Q score and the last ranked DMU (rank 42) has the highest Q score.

4.2.1. Analyses for 2014-2015

Based on the Q score (obtained as an output of VIKOR), we have classified the DMUs into five categories: very good performers, good performers, average performers, modest performers, and poor performers (Table 4).

The very good performers like Thane MT and Navi Mumbai MT have been implementing some innovative initiatives to improve their efficiency. Thane MT had launched a mobile app that allows tracking the location of the running buses, booking of tickets, and monthly passes. It led to more customers availing their service and a boost in revenue. Navi Mumbai MT had added e-buses to its fleet discarding some of the old buses which led to a reduction in the maintenance costs. Similarly, Chandigarh TU had introduced electric buses and also a panic button (pressing which will send a message to the control room) in their buses to enhance the safety of women passengers.

We also identified the efficient DMUs in each functional head. The most efficient DMUs (efficient in 5 functional heads or more) are shown in Table 5 with the corresponding functional head in which they are efficient. From Table 5, we realize Thane MT (rank 1) and Navi Mumbai MT (rank 2) are efficient in 6 and 5 functional heads, respectively. Only Thane MT (DMU Sr. No. 35) was found to be efficient in all the functional heads, and it was also the most efficient DMUs as per the result of VIKOR analysis (Table 2).

Note other DMUs of Table 5 (Andaman & Nicobar ST, Chandigarh TU, and TN STC Kumbakonam Ltd.) are efficient in 5 functional heads, but their performance in maintenance functional head is dismal with an efficiency score less than 0.65 (Table 2). Odisha SRTC (rank 3), though efficient in 3 functional heads, yet maintains an efficiency score of 0.944 (accident), 0.946 (vehicle operations), and 0.702 (maintenance) in other functional heads and hence is ranked above the other DMUs (except Thane MT and Navi Mumbai MT) in Table 5.

The set of efficient DMUs for different combinations of functional heads are shown in Table 6 (serial numbers of DMUs are shown in Appendix A of Supplementary Material). Table 6 represents an upper diagonal portion of the 6 × 6 matrix of functional heads. For any combination of functional heads (a row and a column) in Table 6, the corresponding cell represents the list of DMUs that are efficient (having an efficiency score of 1) in both the functional heads. For example, a cell of row 1 (accident) and column 3 (expenses) lists the DMUs (3, 8, 9, 18, 20, 22, 31, 35, 37, and 41), which are efficient in both the functional heads in the year 2014-2015.

Note that Thane MT (DMU Sr. No. 35) is present in each cell of Table 6, which shows that Thane MT is efficient for any two combinations of the functional heads. The result is supported by the observation that Thane MT is efficient in all the six functional heads (Table 5) and hence is efficient for any two combinations of functional heads as seen in Table 6. Similarly, we observe Navi Mumbai MT (DMU Sr. No. 22), which is efficient in 5 functional heads (Table 5) is present in all the functional heads except the maintenance column of Table 6.

The study also identified the “peers” for the underperforming DMUs within each functional head. The term peer refers to a best-practice organization with an efficiency score equal to 1. A peer (or a combination of peers) may provide a benchmark for relatively less-efficient organizations. A list of some peer DMUs for different functional heads is summarized in Table B3 (Appendix B of Supplementary Material).

4.3. Performance Results of 2015-2016

The final ranks of DMUs based on the Q score are shown in Table 3. The DMUs of Table 3 can be identified from their serial number (Sr. No. of DMU) using Appendix A of Supplementary Material. From Table 3, we observe Navi Mumbai MT (DMU Sr. No. 22), Thane MT (DMU Sr. No. 35), and Ahmedabad MTC (DMU Sr. No. 1) ranked 1, 2, and 3, respectively, among the DMUs. Similarly, Gujarat SRTC (DMU Sr. No. 11), Telangana SRTC (DMU Sr. No. 34), and North Eastern Karnataka RT (DMU Sr. No. 24) ranked the last among the DMUs with ranks 40, 41, and 42, respectively.

4.3.1. Analyses for 2015-2016

Table 7 classifies DMUs based on the Q score for the year 2015-2016 (equivalent to Table 4 for the year 2014-2015). From Tables 4 and 7, we observe Navi Mumbai MT, Thane MT, Odisha SRTC, and Chandigarh TU are the DMUs which performed consistently well and are classified as very good performers in both the years. We realize TN STC (Kumbakonam) Ltd., Sikkim NT, and Delhi TC performed consistently as good performers in both the years. However, there are also DMUs like Gujarat SRTC and Telangana SRTC which are classified as very poor performers in both the years. These poorly performing DMUs required special attention by the respective state governments, and performance enhancement programs should be run to improve their efficiencies on several fronts.

Some of the very good performing DMUs have adopted the best practices like the introduction of electric buses. Odisha SRTC decided to purchase 100 new e-buses to replace the old buses; it also launched the luxury bus services on 11 routes with air-conditioned and GPS-enabled buses. Andaman and Nicobar ST, which is a very good performer in the year 2015-2016, serves one of the most famous tourist location in India and has thus focused on increasing its quality of service by the introduction of luxury buses and unlimited daily travel passes. It has also added a number of electric vehicles to its fleet to cut down on costs.

Table 8 lists the most efficient DMUs (efficient in 5 functional heads or more) for the year 2015-2016 (equivalent to Table 5 for the year 2014-2015). From Table 8, we observe both Navi Mumbai MT (DMU Sr. No. 22) and Thane MT (DMU Sr. No. 35) with ranks 1 and 2, respectively, are efficient in 5 functional heads only. None of the DMU is efficient in all the functional heads. Out of the 7 most efficient DMUs of Table 8, 5 DMUs are inefficient in the maintenance functional head. This observation clearly identifies maintenance as an area of improvement in which even the most efficient DMUs are lagging. Comparing the most efficient DMUs of the year 2015-2016 (Table 8) and year 2014-2015 (Table 5), we realize 5 DMUs (Andaman & Nicobar ST, Chandigarh TU, Navi Mumbai MT, Thane MT, and TN STC (Kumbakonam) Ltd.) have been the most efficient DMUs in both the years.

Table 9 identifies the set of efficient DMUs for different combinations of functional heads for the year 2015-2016 (equivalent to Table 6 for the year 2014-2015). For example, a cell of row 2 (traffic revenue) and column 6 (maintenance) lists the DMUs (1, 35, and 41) which are efficient in both the functional heads in the year 2015-2016. From Table 8, we realize Andaman & Nicobar ST (DMU Sr. No. 3), Chandigarh TU (DMU Sr. No. 9), Navi Mumbai MT (DMU Sr. No. 22), Odisha SRTC (DMU Sr. No. 26), and TN STC (Kumbakonam) Ltd. (DMU Sr. No. 37) are efficient in all functional heads except maintenance. Hence, in Table 9, these DMUs are present in all the cells except the ones which are under the maintenance column.

Similarly, we observe Thane MT (DMU Sr. No. 35) is efficient in all functional heads except vehicle operations (Table 8). Hence, Thane MT DMU is efficient for any two combinations of functional heads except the ones which involve vehicle operations (Table 9). The peers identified for each of the DMUs are shown in Table B4 (Appendix B of Supplementary Material).

4.4. Performance Analyses across Two Years

The above study (Sections 4.2, 4.2.1, 4.3, and 4.3.1) evaluated the performance of a DMU relative to other DMUs for the years 2014-2015 and 2015-2016. The consolidated results of the two years are shown in Table 10. From Table 10, we realize Thane MT and Navi Mumbai MT hold the top 2 ranks in both the years. However, Thane MT slipped to rank 2 (from rank 1 in the year 2014-2015) while Navi Mumbai MT raised to rank 1 in the year 2015-2016 (from rank 2 in the year 2014-2015).

Among all the DMUs, we observe the highest improvement in the rank of Ahmedabad MTC. The Ahmedabad MTC raise by 17 positions from rank 20 in the year 2014-2015 to rank 3 in the year 2015-2016. The observation from Table 10 is supported by the substantial improvement in the efficiency scores of Ahmedabad MTC (DMU Sr. No. 1) in Table 3 as compared with its efficiency scores in Table 2.

However, Table 10 reflects only upon the performance of a DMU relative to other DMUs for a given year. To see how the performance of a DMU has changed in the second year with respect to its own performance in the first year, in each of the functional heads, the Malmquist productivity change index (M0) was used. The base year for the study was 2014-2015. M0 greater than 1 indicates an improvement over the base year, M0 equal to 1 indicates the status quo, and M0 less than 1 indicates worsening of performance. We calculated the final score by taking a weighted average of M0 (weights obtained from AHP as earlier). The Malmquist indices of DMUs for the functional heads under consideration and their final score over the base year are shown in Table 11.

From Table 11, we observe that the Malmquist productivity change index (M0) of all the DMUs is greater than 1, which indicates that all the DMUs have overall improved their performance in the year 2015-2016 with respect to their performance in the base year 2014-2015. The improvement in the “expenses” functional head, as evident from Table 11, primarily leads to the net improved performance of DMUs with respect to their performance in the last year. However, the performance of most of the DMUs has degraded in the “accident” functional head (Table 11) as the productivity change index is less than 1.

4.5. Sensitivity Analysis

We have performed the sensitivity analysis using the approach suggested by Triantaphyllou and Sanchez [29]. They have proposed two types of sensitivity measures—Absolute Top (AT) or Percentage Top (PT) and Absolute Any (AA) or Percentage Any (PA). AT is defined as the smallest change in the weight of criteria which will result in a change in the rank of the topmost DMU. Similarly, AA is defined as the smallest change in the weight which will lead to a change in the rank of any of the DMUs. Our analysis is concerned with finding out the top performing DMUs so that the other DMUs can adopt its best practices and improve their performance. Hence, we focus on finding AT and PT only.

For the year 2014-2015, Thane MT achieves an efficiency of 1 in all the criteria, and hence the sensitivity coefficient comes out to be 0. For the year 2015-2016, none of the DMUs achieve an efficiency of 1 in all the criteria; vehicle operations come out to be the most sensitive criteria with a sensitivity coefficient of 1.149, followed by maintenance with a sensitivity coefficient of 0.697 (Table 12). A high sensitivity coefficient (typically greater than 5) indicates low stability; hence, our results are stable.

5. Discussions

The results of the study can be broadly viewed from two aspects. First, the relative performance of a DMU with respect to other DMUs in a particular year (Tables 29) is evaluated. This evaluation was done for two consecutive years, i.e., the year 2014-2015 and the year 2015-2016, and we observe the change in the rank of DMUs (Table 10). Second, the performance of all the DMUs in the second year with respect to their own performance in the first year (Table 11) is evaluated.

The inferences drawn from the first aspect of results are as follows:(a)Thane MT, Navi Mumbai MT, Odisha SRTC, and Chandigarh TU were consistently very good performers in both the years (Tables 4 and 7)(b)Gujarat SRTC and Telangana SRTC were consistently poor performers in both the years (Tables 4 and 7)

The inferences drawn from the second aspect of results are as follows:(a)The performance of all the DMUs has improved in the year 2015-2016 with respect to the year 2014-2015. The M0 of all the DMUs is greater than 1 (Table 11).(b)There was a substantial improvement in the “expenses” functional head with average M0 = 2.785 (Table 11). The “expenses” functional head carries higher priority with weight = 0.258 (Tables 2 and 3) for the DMUs, and the DMUs have performed well on this front.(c)There is a scope for improvement in other functional heads. For instance, the Uttar Pradesh SRTC (P) appears to have performed well only in the “expenses” front with M0 = 2.459 (Table 10). However, it has not performed well on the other parameters, eventually leading to a drop in the overall ranking by 8 points (Table 10).(d)The top performing DMU like Thane MT has slipped to the second position in the second year. The Malmquist productivity change index indicates that there is scope for improvement in the “accident” head (M0 = 0.788) and “maintenance” head (M0 = 0.73). A similar analysis can be carried out for all the other DMUs to identify their scope for further improvement.

Also, the results show that in the certain functional head (like accident), only a couple of DMUs have improved, and the performance of all others has worsened as the value of the productivity change index is less than 1 (Table 11). This highlights the need for strategic action plans/policy interventions to improve the existing situation.

A number of studies in Indian context have tried to evaluate the performance of the public road transportation system in a particular state or city. While a study [40] identifies the top cities in India for public transportation, Badami and Haider [41] use an analytical framework to determine the transit performance of public buses in Indian cities. Our study extends the geographical scope of analysis and identifies the top performing public road transportation systems across the country using a comprehensive methodology thereby making the results more robust.

6. Conclusions

In this paper, we considered twenty-three criteria to evaluate the relative performance of forty-two major road transportation organizations in India. We integrated four MCDM techniques (AHP, DEA, VIKOR, and MPI) to establish the relative importance of functional heads, compute efficiency scores of DMUs for the classified heads, assign ranks to DMUs based on efficiency scores and relative importance of functional heads, and evaluate interyear performance of DMUs. We realize that all the DMUs have performed better in the second year with respect to their performance in the first year. We identify the functional head in which significant improvement is observed in the performance of all the DMUs. We also identify the best performing DMUs and realize few DMUs have been consistently very good performers in both the years. However, there were also few DMUs which have poorly performed in both the years. We further observe, in the “accident” functional head, the performance of the majority of DMUs has deteriorated. The state government/local municipal corporations can build upon these observations and take necessary steps to enhance the efficiency of their respective road transport corporation. This study also identifies the best-performing DMUs which can be used for benchmarking and sharing key learnings among the DMUs. Currently, the Ministry of Urban Development, Government of India, uses a benchmarking manual to identify key performance indicators and carry out the performance evaluation. The benchmarking manual [42] states the data collection approach and the methodology to be used for performance evaluation. Such a method is time consuming and inefficient. Our study proposes to identify the top performing DMUs in a more adroit manner and uses their best practices. This can help policy makers make quick decisions which are also more reliable.

The limitation of this study is that few qualitative/quantitative criteria like cleanliness, staff behavior to customer, punctuality, on-board security, and on-time arrival/departure have not been considered in the evaluation of the performance. The future scope of the study lies in incorporating these criteria into consideration for a more exhaustive evaluation of the same. Future studies may explore the usage to other MCDM tools like stochastic DEA (SDEA), fuzzy DEA (FDEA), and imprecise DEA (IDEA) to accommodate qualitative criteria discussed above. Other MCDM tools like TOPSIS, DEMATEL, ELECTRE, and PROMETHEE may be explored to develop an evaluation scheme to validate/verify the findings of this study.

Data Availability

The data used in this study were drawn from the Ministry of Road Transport and Highways, Government of India, accessed on October 15, 2019. Any other additional derived data used to support the findings of the study are available from the corresponding author upon request (http://morth.nic.in/sites/default/files/Review_2015_2016.pdf).

Conflicts of Interest

The authors declare there are no conflicts of interest.

Supplementary Materials

The supplementary material consists of an appendix that contains details of DMUs (Appendix A), base data (Tables B1 and B2 of Appendix B), set of peer DMUs (Tables B3 and B4 of Appendix B), and description of criteria for evaluation (Appendix C). Tables B1, B2, B3, and B4 are available in the supplementary excel file. (Supplementary Materials)