The development process for a Performance Measurement System (PMS) can be split into four phases: (1) design; (2) planning and construction; (3) implementation, and; (4) operation and updating. The design phase focuses on the choice of performance indicators and is crucial to the success both of the PMS and the organization. This paper deals with the design phase for a PMS based on the Performance Prism using the Analytic Network Process (ANP) for modeling and ranking of the performance indicators. The application of the ANP as support for the PMS design was executed in the higher education sector with a view to the management of an undergraduate course in Production Engineering. The model and its results assured the representation of the various stakeholdersÂ´ objectives â€“ in a significant and balanced manner â€“ through 58 performance indicators distributed in four clusters: satisfaction, processes, capabilities and contribution.
Performance Measurement System, ANP, undergraduate course, The Performance Prism
development using system dynamics. Journal of the Operational Research Society, 56(8), 931-941.
Bourne, M., Mills, J., Wilcox, M., Neely, A. & Platts, K. (2000). Designing, implementing and updating
performance measurement systems. International Journal of Operations & Production Management,
Bourne, M., Neely, A., Platts, K. & Mills, J. (2002). The success and failure of performance measurement
initiatives. International Journal of Operations & Production Management, 22(11), 1288-1310.
Bressiani, F., Alt, P.R.C. & Massote, A.A. (2001). Using the Balanced Scorecard as an Instrument of
Improving Performance of an Institution of Higher Education. Proceedings of the Brazilian Congress on
Engineering Education (COBENGE), Porto Alegre, RS, Brazil, 29. [in Portuguese]
Fernandes, B.H. (2004). Competencies and organizational performance: an empirical study. Doctoral
dissertation, Faculdade de Economia e Administração, USP, Brazil. [in Portuguese]
Figueira, J., Salvatore, G. & Ehrgott, M. (2005). Multiple Criteria Decision Analysis. State of the art
surveys. Boston: Springer Science+Business Media, LLC.
Gomes, L.F.A.M., Araya, M.C.G. & Carignano, C. (2004). Decision making in complex scenarios:
Introduction to Discrete Methods of Multicriteria Decision Support. São Paulo: Pioneira Thomson
Learning. [in Portuguese]
Handy, C. (2002). The Performance Prism: Measuring more is easy, measuring better is hard. In: Neely,
A., Adams, C. & Kennerley, M (2002). The Performance Prism: The Scorecard for Measuring and
Managing Business Success. Great Britain: Prentice Hall Financial Times.
Kaplan, R. & Norton, D. (1992). The Balanced Scorecard – measures that drive performance. Harvard
Business Review, 70(1), 71-79.
Keeney, R.L. (1992). Value-Focused Thinking: a path to creative decisionmaking, Cambridge (USA):
Kennerley, M.P. & Neely, A.D. (2000). Performance Measurement Frameworks – A Review.
Proceedings of the 2nd International Conference on Performance Measurement, 291-298.
Law n. 10,861 of April 14th, 2004. (2004). Brasília, Federal District, Brazil. Retrieved Jun 26, 2005, from
http://www.planalto.gov.br. [in Portuguese]
Lee, M.C. (2007). A Method of Performance Evaluation by Using The Analytic Network Process and
Balanced Scorecard. Proceedings of The International Conference on Methods and Applications of
Multicriteria Decision Making, Gyeongju, Republic of Korea.
Macedo, A.R., Trevisan, L.M.V., Trevisan, P & Macedo, C.S. (2005). Higher Education in the XXI
Century and the Brazilian university reform. Revista Ensaio: Avaliação e Políticas Públicas em
Educação, Rio de Janeiro, 13(47), 127-148. [in Portuguese]
Neely, A., Adams, C & Kennerley, M. (2002). The Performance Prism: The Scorecard for Measuring and
Managing Business Success. Great Britain: Prentice Hall Financial Times.
Neely, A. & Bourne, M. (2000). Why measurement initiatives fail. Measuring Business Excellence, 4(4),
Neely, A., Gregory, M. & Platts, K. (2005). Performance measurement system design: developing a
literature review and research agenda. International Journal of Operations & Production Management,
Normative Ordinance n. 4, of August 5th, 2008. (2008). Brasília, Federal District, Brazil. Retrieved
August 7, 2008 from http://www.anaceu.org.br/conteudo/legislacao/portarias. [in Portuguese]
Oliveira, C.A. & Belderrain, M.C.N. (2008). Considerations on finding the AHP priority vectors. In:
Encuentro Nacional de Docentes de Investigación Operativa. Posadas, Argentina. [in Portuguese]
Paula, D.C. & Salomon, V.A.P. (2008). Using indicators to analyze the application of methods for
decision making with multiple criteria. Proceedings of XL Simpósio Brasileiro de Pesquisa Operacional
“A Pesquisa Operacional e o uso racional dos recursos hídricos”, João Pessoa, PE. [in Portuguese]
Piratelli, C.L., Belderrain, M.C.N & Azzolini Jr., W.A. (2009). Using Monte Carlo Simulation for
Analyze potentials shortcomings of the Evaluation Instrument for Course Accreditation. Proceedings of
16nd Simpósio de Engenharia de Produção: “Ensino de Engenharia de Produção”, Bauru, SP, 16. [in
Porter, M.E. (1998). Competitive Advantage to Corporate Strategy. In: Montgomery, C. A. & Porter, M.
E. (1998). Strategy: Searching for competitive advantage. Rio de Janeiro-RJ: Campus. [in Portuguese]
Saaty, R.W. (2003). Decision Making in Complex. The Analytic Hierarchy Process for Decision Making
and The Analytic Network Process for Decision Making with Dependence and Feedback [Superdecisions
Tutorial]. Retrieved Jun 01, 2008, from http://www.superdecisions.com.
Saaty, T.L. (1980). The Analytic Hierarchy Process. New York (USA): McGraw-Hill.
Saaty, T.L. (2001). Decision Making with Dependence and Feedback: The Analytic Network Process,
Pittsburgh, PA: RWS Publisher.
Saaty, T.L. (1994). Fundamentals of Decision Making and Priority Theory – With The Analytic
Hierarchy Process. Pittsburgh, PA: RWS Publications.
Saaty, T.L. (2005). Theory and applications of the analytic network process: decision making with
benefits, opportunities, costs, and risks, Pittsburgh, PA: RWS Publications.
Saaty, T.L. & Peniwati, K. (2007). Group decision-making: Drawing out and reconciling differences.
Pittsburgh, PA: RWS Publications.
Saaty, T. & Vargas, L.G. (2006). Decision Making with the Analytic Network Process. Economic,
Political, Social and Technological Applications with Benefits, Opportunities, Costs and Risks, New
York: NY: Springer Science+Business Media, LLC.
Silva, A.C., Nascimento, L.P., Ribeiro, J.R & Belderrain, C. N. (2009). ANP and Ratings model applied
to SSP. Proceedings of the International Symposium on the Analytic Hierarchy Process, Pittsburgh, PA, ,
Smith, M. (2005). The Balanced Scorecard. Financial Management, Feb 2005, 27-28.
Suwignjo, P, Bitici, U.S. & Carrie, A.S. (2000). Quantitative models for performance measurement
system. International Journal of Production Economics, 64, 231-241.
Copyright of all articles published in IJAHP is transferred to Creative Decisions Foundation (CDF). However, the author(s) reserve the following:
- All proprietary rights other than copyright, such as patent rights.
- The right to grant or refuse permission to third parties to republish all or part of the article or translations thereof. In case of whole articles, such third parties must obtain permission from CDF as well. However, CDF may grant rights with respect to journal issues as a whole.
- The right to use all or parts of this article in future works of their own, such as lectures, press releases, reviews, textbooks, or reprint books.
- The authors affirm that the article has been neither copyrighted nor published, that it is not being submitted for publication elsewhere, and that if the work is officially sponsored, it has been released for open publication.
The only exception to the statements in the paragraph above is the following: If an article published in IJAHP contains copyrighted material, such as a teaching case, as an appendix, then the copyright (and all commercial rights) of such material remains with the original copyright holder.
CDF will receive permission for publication of copyrighted material in IJAHP. This permission is not transferable to third parties. Permission to make electronic and paper copies of part or all of the articles, including all computer files that are linked to the articles, for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage.
This permission does not apply to previously copyrighted material, such as teaching cases. In paper copies of the article, the copyright notice and the title of the publication and its date should be visible. To copy otherwise is permitted provided that a per-copy fee is paid.
To republish, to post on servers, or redistribute to lists requires that you post a link to the IJAHP article, which is available in open access delivery mode. Do not upload the article itself.
Authors are permitted to present a talk, based on a paper submitted to or accepted by IJAHP, at a conference where the paper would not be published in a copyrighted publication either before or after the conference and where the author did not assign copyright to the conference or related publisher.