Regular evaluation of the performance of an ITS service is seen as an important tool to improve the service and, if necessary, to streamline the business model chosen. In this way the success rate of the deployment of ITS services can be increased. This is necessary, as many promising ITS services do not survive the step from a successful pilot project to an economically viable product on the market (C-ITS platform, 2016; Ricardo, 2016). Despite the important role performance evaluation based on relevant key performance indicators (KPIs) can play, they are often not used by ITS service operators. NEWBITS assessed why.
Based on a review of the literature and an online survey of stakeholders in the global ITS community, the main barriers for the appliance of KPIs in measuring the performance of ITS services were identified. As shown in the graph below, the lack of compatible/available data and lack of knowledge/skills are the most frequently mentioned barriers by the stakeholders for not applying KPIs. Difficulties in accessing information due to data ownership was also frequently mentioned, as were lack of cooperation between stakeholders and funding shortages. A lack of staff resources was not frequently considered a major barrier to the application of KPIs, nor was data privacy.
The results of the NEWBITS study were quite well in line with the results found by AECOM (2015). They also found that lack of available/compatible data is one of the main barriers for applying KPIs, as well as funding shortages and a lack of cooperation between stakeholders. In contrast to the NEWBITS findings, lack of knowledge/skills were considered less important barriers by AECOM (2015).
For more information, see NEWBITS D2.2
- AECOM. (2015), Key Performance Indicators For Intelligent Transport Systems: Final Report. Bristol: Retrieved from http://ec.europa.eu/transport/themes/its/studies/doc/its-kpi-final_report_v7_4.pdf
- C-ITS Platform (2016), Final report, Brussels
- Ricardo (2016), Study on the Deployment of C-ITS in Europe: Final Report, London