Evaluating the Content Validity of Instruments for Measuring Principal’s Ethical Leadership Practices Using the Content Validity Ratio (CVR) Method
Abstract
The principal’s ethical leadership practices are crucial for developing an excellent school. By embodying ethical values such as honesty, integrity, and responsibility, principals inspire students and staff to act ethically. Ethical principal ensures fairness in school management, attend to the needs of all stakeholders, and engage in open and effective communication. Although several measurement instruments assess ethical leadership, those with good validity are limited, especially for evaluating principals. This study aims to test the content validity of the Principal’s Ethical Leadership instrument using Lawshe's (1975) Content Validity Ratio (CVR) analysis. An online survey was conducted with five experts selected through purposive sampling, including individuals with backgrounds in educational management and administration from the Ministry of Education, state education departments, and school leaders. The instrument's validity involves seven constructs and 38 main items based on the Ethical Leadership at Workplace (ELW) model by Kalshoven et al. (2011). The study found that the instrument has good content validity, with 34 items reaching the minimum CVR value (N=5, CVRcritical=0.916). Three items that did not reach the minimum CVR value were improved, and one item was dropped, resulting in 37 refined items in the final instrument. This instrument has the potential to be a valuable tool for measuring ethical leadership practices among school leaders in Malaysia. A pilot study is recommended, with data analyzed using more in-depth statistical analysis such as SEM-PLS to refine items further and ensure the instrument's reliability and accuracy.
References
Abdul Rahim, M. H., Mohd Hamzah, M. I., & A. Hamid, A. H. (2023). Sustainable leadership practices among schools principals and their relationship with teacher commitment in malaysia rural school. E-Bangi: Journal of Social Science and Humanities. https://doi.org/10.17576/ebangi.2023.2004.11
Ahmad Fakhri, M. Z. (2021). Kepimpinan berintegriti guru besar dan hubungannya dengan penglibatan kerja guru. Universiti Kebangsaan Malaysia.
Ali, ashikin, Tretiakov, A., & Whiddett, D. (2014). A content validity study for a knowledge management system success model in healthcare. Journal of Information Technology Theory and Application, 15(2), 21–36.
Allahyari, T., Rangi, N. H., Khosravi, Y., & Zayeri, F. (2011). Development and Evaluation of a New Questionnaire for Rating of Cognitive Failures at Work. International Journal of Occupational Hygiene (IJOH), 3(1), 6–11. http://ijoh.tums.ac.ir
Almanasreh, E., Moles, R., & Chen, T. F. (2019). Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy, 15(2), 214–221. https://doi.org/10.1016/j.sapharm.2018.03.066
Ananthan, S. (2016). Kepimpinan beretika guru besar, kesejahteraan organisasi dan pengupayaan guru di sekolah jenis kebangsaan tamil. Universiti Sains Malaysia.
Avolio, B., & Bass, B. (2004). Multifactor leadership questionnaire : Manual and sample set. www.mindgarden.com
Ayre, C., & Scally, A. J. (2014). Critical values for Lawshe’s content validity ratio: Revisiting the original methods of calculation. Measurement and Evaluation in Counseling and Development, 47(1), 79–86. https://doi.org/10.1177/0748175613513808
Boynton, P. M., & Greenhalgh, T. (2004). Selecting, designing and developing your questionnaire. BMJ, 328, 1312–1315.
Brown, M. E., & Treviño, L. K. (2006). Ethical leadership: A review and future directions. Leadership Quarterly, 17(6), 595–616. https://doi.org/10.1016/j.leaqua.2006.10.004
Brown, M. E., Treviño, L. K., & Harrison, D. A. (2005). Ethical leadership: A social learning perspective for construct development and testing. Organizational Behavior and Human Decision Processes, 97, 117–134. https://doi.org/10.1016/j.obhdp.2005.03.002
Bush, T., & Oduro, G. K. T. (2006). New principals in Africa: Preparation, induction and practice. Journal of Educational Administration, 44(4), 359–375. https://doi.org/10.1108/09578230610676587
Chingwanangwana, B., & Kgari-Masondo, M. C. (2024). Probing the Practicality of Ethical School Leadership Amid Socio-Political and Economic Turmoil. E-Bangi Journal of Social Science and Humanities, 21(2). https://doi.org/10.17576/ebangi.2024.2102.06
Cohen, R. J., & Swerdlik, M. E. (2010). Psychological Testing and Assessment: An Introduction to Tests and Measurement (Seventh Edition). The McGraw-Hill Companies. http://www.primisonline.com
Connell, J., Carlton, J., Grundy, A., Taylor Buck, E., Keetharuth, A. D., Ricketts, T., Barkham, M., Robotham, D., Rose, D., & Brazier, J. (2018). The importance of content and face validity in instrument development: lessons learnt from service users when developing the Recovering Quality of Life measure (ReQoL). Quality of Life Research, 27(7), 1893–1902. https://doi.org/10.1007/s11136-018-1847-y
Dastan Kaduma, K. (2024). Compliance toward ethical leadership among school principals: A synthesis of qualitative research-based evidences. International Journal of Educational Administration and Policy Studies, 16(1), 6–15. https://doi.org/10.5897/IJEAPS2023.0773
De Hoogh, A. H. B., & Den Hartog, D. N. (2008). Ethical and despotic leadership, relationships with leader’s social responsibility, top management team effectiveness and subordinates’ optimism: A multi-method study. Leadership Quarterly, 19(3), 297–311. https://doi.org/10.1016/j.leaqua.2008.03.002
DeVellis, R. F. (2017). Scale Development Theory and Applications (4th Edition). Sage Publications Ltd.
Field, A. (2018). Discovering Statistics Using IBM SPSS Statistics (5th Edition). Sage Publications Ltd.
George, N., Barrett, N., McPeake, L., Goett, R., Anderson, K., & Baird, J. (2015). Content validation of a novel screening tool to identify emergency department patients with significant palliative care needs. Academic Emergency Medicine, 22(7), 823–827. https://doi.org/10.1111/acem.12710
Ghazali, D., & Sufean, H. (2016). Metodologi penyelidikan dalam pendidikan: Amalan dan analisis kajian (D. Ghazali & H. Sufean, Eds.; Edisi ke-2). University of Malaya Press.
Ilham, I. (2015). Pengaruh kepimpinan beretika dan kepuasan kerja guru terhadap komitmen organisasi di sekolah. Universiti Utara Malaysia.
Kalshoven, K., Den Hartog, D. N., & De Hoogh, A. H. B. (2011). Ethical leadership at work questionnaire (ELW): Development and validation of a multidimensional measure. Leadership Quarterly, 22(1), 51–69. https://doi.org/10.1016/j.leaqua.2010.12.007
Lawshe C. H. (1975). A Qualitative Approach to Content Validity. Personnel Psychology, 28, 563–575.
Marizan, N. S. S., & Abdul Wahab, J. L. (2018). Amalan Kepimpinan Etika Guru Besar Dan Hubungannya Dengan Kepuasan Kerja Guru Sekolah Kebangsaan (SK) Di Daerah Hulu Selangor. Jurnal Penyelidikan Sains Sosial (JOSSR).
Mohammad Rahim, K., Rohany, N., Wan Shahrazad, W. S., Rozainee, K., & Zainah, A. Z. (2017). Validity and Psychometric Properties of Malay Translated Religious Orientation Scale-Revised among Malaysian Adult Samples. Akademika, 87(2), 133–144. https://doi.org/10.17576/akad-2017-8702-10
Mohammed Afandi, Z., Mohd Effendi, M. M., & Wan Norshuhadah, W. M. (2022). Assessing psychometric of Malaysian version of school leaders transformational leadership instrument. Journal of Quality Measurement and Analysis JQMA, 18(3), 53–60. http://www.ukm.my/jqma
Mohammed Afandi, Z., Mohd Effendi, M. M., Wan Norshuhadah, W. M., & Noor Hashimah, H. (2020). Kesahan Kandungan Instrumen Pengukuran Tingkah Laku Inovatif Guru Menggunakan Kaedah Nisbah Kesahan Kandungan (CVR). Akademika, 90(Isu Khas 3), 43–54. https://doi.org/10.17576/akad-2020-90IK3-04
Mohd Effendi, M. M., Hisyamsani, I., Normawati, A. R., & Ahmad Zamri, K. (2017). Kesahan kandungan pakar instrumen IKBAR bagi pengukuran AQ menggunakan nisbah kesahan kandungan. Proceeding of International Conference On Global Education V (ICGE V), 979–997.
Nor Farhana, M. N. (2021). Pengaruh kepimpinan beretika pengetua terhadap kecekapan moral guru subjek pengurusan di daearah Larut Matang dan Selama, Perak. Universiti Pendidikan Sultan Idris.
Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Research in Nursing and Health, 29(5), 489–497. https://doi.org/10.1002/nur.20147
Powell, C. (2003). The Delphi technique: myths and realities. Journal of Advance Nursing, 41(4), 376–382.
Putro, H. C., Akhyak, & Sujianto, A. E. (2023). Transformational leadership: A strategy for building the image of elementary education institutions. International Journal of Educational Studies in Social Sciences. https://doi.org/10.53402/ijesss.v3i2.306
Rubio, D. M., Berg-Weger, M., Tebb, S. S., Lee, E. S., & Rauch, S. (2003). Objectifying content validity: Conducting a content validity study in social work research. Social Work Research, 27(2), 94–104.
Shrotryia, V. K., & Dhanda, U. (2019). Content validity of assessment instrument for employee engagement. SAGE Open, 9(1). https://doi.org/10.1177/2158244018821751
Siahaan, A., Aswaruddin, A., Maulidayan, M., Zaki, A., Sari, N., & Rahman, A. A. (2023). Principal Leadership Ethics as A Role Model in High School. AL-ISHLAH: Jurnal Pendidikan. https://doi.org/10.35445/alishlah.v15i3.1563
Taherdoost, H. (2016). Sampling Methods in Research Methodology; How to Choose a Sampling Technique for Research. International Journal of Academic Research in Management (IJARM), 5(2), 2296–1747. https://ssrn.com/abstract=3205035
Treviño, L. K., Brown, M., & Hartman, L. P. (2003). A qualitative investigation of perceived executive ethical leadership: Perceptions from inside and outside the executive suite. Human Relations, 56(1), 5–37. https://doi.org/10.1177/0018726703056001448
Velarde, J. M., Adams, D., Faizal, M., & Ghani, A. (2020). School Leadership in Multicultural Secondary Schools: Using Cultural Intelligence in Leading Culturally Diverse Learning Organisations. In International Online Journal of Educational Leadership (Vol. 4, Issue 2).
Vikaraman, Sharmini. S., Azlin Norhaini, M., Gurusamy, V., Nitce Isa, M., & Mohd Izham, M. H. (2019). Amalan kepimpinan beretika pengetua dan kepercayaan terhadap pemimpin di sekolah: Satu langkah integrasi. 4th Asia Pacific Conference on Educational Management and Leadership 2019, 404–414. https://seminarfpe.wixsite.com/apcemal2019
Vikaraman, S. S. (2019). Influence of principal’s ethical leadership on trust in leader and teacher work engagement in secondary schools of southern zone, Malaysia. Universiti Kebangsaan Malaysia.
Vikaraman, S. Siva., Azlin Norhaini, Mansor., Mohamed Yusoff, M. N., Bity Salwana, A., & Gurusamy, V. (2021). Ethical leadership practices and trust among public school leaders in Malaysia. Asian Journal of University Education, 17(3), 174–191. https://doi.org/10.24191/ajue.v17i3.14509
Yaghmale, F. (2003). Content validity and its estimation. Journal of Medical Education Spring, 3(1), 25–27.
Yazdanshenas, M., & Mirzaei, M. (2023). Leadership integrity and employees’ success: role of ethical leadership, psychological capital, and psychological empowerment. International Journal of Ethics and Systems. https://doi.org/10.1108/IJOES-05-2022-0117
Zaki, A. F. M., & Mansor, A. N. (2019). Amalan Kepimpinan Beretika di Sekolah. Prosiding Seminar Kebangsaan Pendiidkan Negara (SKEPEN).
Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., Alavi-Majd, H., & Nikanfar, A.-R. (2015). Design and implementation content validity study: Development of an instrument for measuring patient-centered communication. Journal of Caring Sciences, 4(2), 165–178. https://doi.org/10.15171/jcs.2015.017
Keywords
Full Text:
PDFDOI: http://dx.doi.org/10.17576/ebangi.2025.2201.08
Refbacks
- There are currently no refbacks.
-
_________________________________________________
eISSN 1823-884x
Faculty of Social Sciences & Humanities
Universiti Kebangsaan Malaysia
43600 UKM Bangi, Selangor Darul Ehsan
MALAYSIA
© Copyright UKM Press, Universiti Kebangsaan Malaysia