Rufina S. Hamafyelto1, Abubakar Hamman-Tukur1, Stephen S. Hamafyelto2
1Department of Education, Faculty of Education, University of Maiduguri
2Department of Physical and Health Education, University of Maiduguri
Correspondence to: Stephen S. Hamafyelto, Department of Physical and Health Education, University of Maiduguri.
Email: |  |
Copyright © 2015 Scientific & Academic Publishing. All Rights Reserved.
Abstract
This study assessed the relationship between commerce teachers’ competence in test construction and test quality. The objective was to assess the areas of competence of Borno State Senior Secondary Schools Teachers of commerce in constructing examination questions. Two research questions were answered and one null hypothesis tested. The population of the study was 75 teachers of commerce in senior secondary schools in Borno State. A 42-itemquestionnaire named “Teachers Competence Questionnaire” (TECOM-Q) was administered to the sampled teachers. The reliability coefficient of 0.816 was established for the instrument through Cronbach’s alpha. Frequency counts, percentages, mean and standard deviations were computed and Contingency coefficient was used to test whether there was significant relationship between teachers of commerce competence and content validity of their examination questions. The result of the analysis showed that there were significant relationships between teachers of commerce competence and content validity, the areas of teachers’ competence in constructing examination questions was low. It was found that teachers concentrated on the lower levels of the cognitive domain (remembering, understanding applying. The study recommended workshops and seminars to improve teachers’ competence in test construction.
Keywords:
Teacher Competence, Content Validity, Teacher-Made Examination
Cite this paper: Rufina S. Hamafyelto, Abubakar Hamman-Tukur, Stephen S. Hamafyelto, Assessing Teacher Competence in Test Construction and Content Validity of Teacher Made Examination Questions in Commerce in Borno State, Nigeria, Education, Vol. 5 No. 5, 2015, pp. 123-128. doi: 10.5923/j.edu.20150505.01.
1. Introduction
Test construction competence and quality are essential tools required by any teacher if teaching and learning goals are to be achieved. The significance of tests in a school system is bountiful since it is the means by which any meaningful educational goals are attained. The potency of learning objectives, embedded in a school curricula remain the most cardinal sign post for educational growth, institutional excellence and individual aspirations. Teachers who are custodians of knowledge must be seen to be competent in measuring learning goals with precision and accuracy. Similarly, the tools with which these learning goals are measured must also be precise and accurate to be able to measure what the teacher intends to measure and evaluate. These cannot be possible without teachers themselves being competent in the art and science of handling the tools; which are the tests and examinations (D’Agostino, 2007).Over the last few decades, there was a great employment of untrained and unqualified teachers into the teaching profession in Nigerian schools system. Teaching became a means to an end for many as such it was used as a stepping stone to greener pasture. The consequence of which was the influx of incompetent teachers in the schools’ system thereby resulting to persistent student failure in public examinations (Hamafyelto, 2008). This assertion was supported by a study conducted on competence of teachers of commerce in private senior secondary schools in Maiduguri Metropolis. It was reported in this study that majority of the teachers held B. Sc. Economics, B. Sc. Accountancy, B. Sc. Mathematics, B. Sc. Geography and B. Sc. Business Management (Hamafyelto, 2008). This was an abrasion to the provisions and guidelines for employment of teachers in our schools.
2. Teacher Competence in Constructing Tests
Teachers’ competence is specified by standards for educational assessment of students as adopted by UNESCO. This is adevelopmental model about the generic abilities or factors of the educator that aim at identifying the broad competence of the teachers in the art of teaching and learning processes across grade levels. It also include content areas showing the aspects of each ability as it typically develops from beginning to developing and to advance performance in teaching (UNESCO, 1990).The standards express specific expectations for assessing knowledge or skills that teachers should possess in order to perform well in their evaluation effort (Ololube, 2008). According to Sanderson and Vogel (1993) the standards call on teachers to demonstrate skill at selecting, developing, applying, using, communicating, and evaluating students’ assessment information and students’ assessment practices. Okpala (2002) noted that few teachers in Nigeria know that good teaching is characterized by assessments that motivate and engage students in ways that are consistent with their philosophies of teaching and learning and with theories of development, learning and motivation. Furthermore, Schafer (2002) asserted that most teachers want to use constructed-response assessments because they believe this kind of testing is best to ascertain students’ understanding. McMillan (2000) has observed that what is most essential about assessment is to understand how general, fundamental assessment principles and ideas can be used to enhance students’ learning and teacher effectiveness. Once all the alternatives are understood, priorities need to be made and trade- offs are inevitable. It is by this that teachers and administrators will appreciate that teaching standards will make better informed and better justified assessment decisions.Ololube (2008) evaluated competencies of professional and non-professional teachers in Nigeria. The researcher reported that professional teachers tend to construct various effective evaluative instruments more than the non-professional teachers. It was also found in Ololube’s study that professional teachers have the propensity to employ various evaluation techniques correctly, which is not likely with the non-professional teachers. The author therefore concludes that professional teachers kept assessment records more accurately than non-professional teachers.In a study carried out by Ololube (2005) on benchmarking the motivational competencies of academically qualified teachers and professionally qualified teachers in Nigerian secondary schools, it was found that academically qualified teachers were less satisfied with the evaluation processes of students than the professionally qualified teachers. By implication, the professional teachers were satisfied because they had competence in knowledge and skills in handling evaluation situations in the classrooms.Kazuko (2010) assessed Japanese high mathematics teacher competence in real world problem solving with test questions taken from American pre-calculus first year calculus textbooks. The study showed that the teachers, each of whom hold a B.A in Mathematics, physic or engineering possessed solid foundation of mathematical knowledge and skill in their written answers to mathematical modeling problems, concept of which they were not familiar with. Researchers such as Kanu (1996), Chau (1996), Whitty (1996) and Darling-Hammond (2000) referred to teacher competence when they stressed that the quality of test questions depends on the quality of the teacher. Chau (1996) maintains that a teachers’ level of competence is one of the factors that directly affect the quality of his/her test questions.
3. Content Validity of Teacher Made Test
The question is always asked whether a test is valid or not. Content validity has to do with the extent to which a test is able to measure what it intends to measure. When a test has content validity, the items on the test should represent all the range of possible items the test should cover. Oescher and Kirby (1990) in determining the content validity of mathematics and science (teacher made test) that were conducted by teachers; collected most recently administered questions constructed by teachers. They reported a relationship between teachers’ knowledge of test item construction and content validity. They also noted that teachers who had knowledge of test construction had qualitative items than those who do not have.Hamman-Tukur and kamis (2000) study of content analysis on implications for testing, teaching and development sampled three categories of students’ examinations questions in University of Maiduguri (200, 300, and 400 levels). All students were B. Sc. Biochemistry students of the university. The study revealed that a preponderance of examination questions assessed simple learning outcomes of knowledge and comprehension categories of the cognitive domain at the expense of learning outcomes that call for synthesis and evaluation. As a rider to this finding, the authors recommended that there is need to sensitize teachers on the importance of setting questions that assess these complex learning outcomes.
4. Methodology
Content analysis and correlational design was used to answer the research question and to test the hypothesis raised for this study. The population for the study was 75 teachers of commerce. Of this number, 16 of the teachers were from public schools (schools owned by Government) while 59 of the commerce teachers were from the private schools (schools owned by private individuals). A 42 item questionnaire divided into 8 sections covered all aspects of the standards. The response mode was fashioned after a five scale; 5 for always and 1 for not at all. The Cronbach alpha reliability = 0.818. A profoma for assessing content validity and learning outcome was used. Past teacher-made examination questions were also assessed. Contingency coefficient was used to test the hypothesis raised in the study.
5. Results
Research question 1: what is the area of competence of Borno state secondary school teachers of commerce in construction of examination questions?Table 1.1. Percentage distribution of commerce teachers’ competence in construction of examination questions  |
| |
|
Table 1.1 presents the areas of commerce teachers’ competence. It showed that teachers of commerce were competent in the areas of administering, scoring and interpreting results. Competence was also shown by the teachers of commerce in the areas of using assessment results to facilitate students learning and to evaluate their teaching methods.Teachers of commerce in Borno state senior secondary schools did not show competence in the areas of developing valid students grading procedures, communicating results, and recognizing unethical and illegal assessment methods.Research question 2: what is the content validity of examination questions set by Borno state senior secondary school teachers of commerce?Table 1.2A. Content validity of teachers of commerce multiple choice examination questions  |
| |
|
Table 1.2.a presents the percentage of the levels of the cognitive domain assessed by teachers against the ideal as recommended by the curriculum. The teachers assessed 18% more of remembering than the ideal and 1% more of applying than the ideal. On the other hand, they assessed low of understanding, creating, evaluating and analyzing than the ideal. The teachers emphasized remembering more than any of the levels of the cognitive domain.Table 1.2B. Content validity of teachers of commerce essay examination questions  |
| |
|
Table 1.2 b presents the percentage levels of cognitive domain assessed by teachers against the ideal as recommended by the curriculum. The teachers assessed 31% more of remembering than the ideal. On the other hand, they assessed low of understanding, applying, analyzing, evaluating and creating than ideal. The teachers emphasized remembering more than any other levels of the cognitive domain.It was hypothesized that there is no significant relationship between Borno state senior secondary schools teachers of commerce competence and content validity of their examination questions?The result of the hypothesis tested using contingency coefficient is presented in the table 1.3.Table 1.3. Contingency coefficient of teachers of commerce competence and content validity for multiple choice and essay examination questions  |
| |
|
Table 1.3: presents a contingency coefficient of teacher competence and content validity. The results indicate that the value of contingency coefficient was significant. The null hypothesis is therefore accepted. This means that teachers’ of commerce competence was not significantly related to the content validity of their examination questions.
6. Discussion
Commerce is a subject so flexible that exposes prospective students for accounting, business management, commercial law etc to be fully abreast of professionalization. The subject seems to be treated with levity in most Nigerian schools due to the emphasis on science based courses. From the foregoing analysis, it appears that teachers of commerce in Borno state senior secondary schools did not show competence in the areas of developing valid students grading procedures, communicating results, and recognizing unethical and illegal assessment methods. This is consistent with the findings of Okpala (2002) which revealed that few teachers in Nigeria know that good teaching is characterized by assessments that motivate and engage students in ways that are consistent with their philosophies of teaching and learning and with theories of development, learning and motivation.Apparently, it may be observed that due to insufficient knowledge of what it takes to construct examination questions, the teachers assessed 18% more of remembering than the ideal and 1% more of applying than the ideal. On the other hand, they assessed low understanding, creating, evaluating and analyzing than the ideal. The teachers emphasized remembering more than any of the levels of the cognitive domain. This supports the findings of Hamman-Tukur and kamis (2000) on in which the study revealed that a preponderance of examination questions assessed simple learning outcomes of knowledge and comprehension categories of the cognitive domain at the expense of learning outcomes that call for synthesis and evaluation.It was more revealing when the teachers assessed 31% more of remembering than the ideal. The results indicate that the value of contingency coefficient was not significant in which case the null hypothesis was accepted. This means that teachers’ of commerce competence was not significantly related to the content validity of their examination questions. This outcome is largely attributed to insufficient knowledge in the construction of examination questions based on the Bloom’s taxonomy being applied in teaching. As suggested by D’Agostino, (2007) that learning cannot be meaningful without teachers themselves being competent in the art and science of handling the tools; which are the tests and examinations
7. Conclusions
Based on the findings of this study, it was concluded that the teachers in Borno state senior secondary school were not competent in constructing their examination questions based on the United Nations Educational Scientific and Cultural Organization (UNESC0) standards. The teachers’ examination questions had low content validity that emphasized lower levels of cognitive domain remembering, understanding and applying.
8. Recommendations
The following recommendations are made:The state ministry of education should organize seminars/ workshops and provide in-service training for Borno state senior secondary school teachers to up-grade their knowledge in the art of testing to raise the standard of test construction to cover the different categories of the cognitive domain. Teachers of commerce in Borno state senior secondary schools should get use to the application of the Bloom’s taxonomy when setting their examination questions.
References
[1] | B.S. Bloom (1956). Taxonomy of Educational Objectives: The classification of educational goals, by a committee of college and university examiners. htt/www.odu.edu/ii schuit/bloom’staxonomy.htm retrieved 3 march 2008. |
[2] | T. N. Chau (1996). The quality of primary schools in different development contexts. Paris: UNESCO Publishing International Institute for Educational Planning. |
[3] | J.V. D’Agostino, (2007). Quantitative Research, Evaluation, and Management section. Ohio State University 29 W. Woodruff Avenue, Columbus, OH 42310-1177. USA. |
[4] | L. Darling – Hammond, (2002). Teacher quality and student achievement: A review of state policy evidence. Educational policy analysis archives, 8(1), http://epaa.asu.edu/epaa/ |
[5] | R.S. Hamafyelto, (2008). Assessment of Commerce Teachers Competence in Test Construction and Test Quality among secondary school Teachers in Maiduguri Metropolis, Unpublished Independent Study, Department of Education, University of Maiduguri. |
[6] | A .Hamman- Tukur, & A.B. Kamis, (2000). Content Analysis of B.Sc Bio-chemesrty Examination QUESTIONS Implication for Testing, teaching and development African Journal Research in Education. (1), 59-62. |
[7] | C.M. Kanu, (1996). The Art and Science of Classroom Assessment: the Missing part of pedagogy ASHE-ERIC Higher Education Report. (Vol.27 no,1) washingnton University Graduate School of Education and Human development. |
[8] | J W. Kazuko, (2010). Japanese High School Mathematics Teachers Competence in Real World Problem Solving. Keto Academy of new york and Teachers College Columbia University. |
[9] | J.H. McMillan, (2000). Essential assessment concepts for teachers and administrators. Thousand Oaks, CA Corwin publishing company. Amazon.com |
[10] | J. Oescher, & P.C. Kirby, (1990). Assessing teacher- made –test in secondary school math and science classroom. Retrieved 8/8/2008. From http://eric.ed.gov/ERICweb porlets/ records/detailmini.js |
[11] | E. O. Okpala, (2002). Effective Implementation of the Continous assessment policy in primary schools: A keynote presented at the train-the-trainers workshop on Continuous Assessment: Lagos. |
[12] | N.P. Ololube, (2005). Benchmarking the motivational competencies of Academically Qualified Teachers and Professionally Qualified Teachers in Nigerian Secondary Schools. The African Symposium: An on Line Journal of African educational research Network, 5(3),17-37. |
[13] | N. P. Ololube, (2008). Evaluation Competencies of Professional and Non Professional Teachers in Nigeria, Studies in Educational Evaluation (SEE), 34(1), 44-51. |
[14] | J.H. Sanderson, & R. S. Vogel, (1993). The development of Standards for Teachers competence in educational assessment of students, in S.L. Wise (Ed0, Teacher training in measurement and assessment skills, Lincoln, NB: Burros Institute of Mental measurements. |
[15] | E. Schafer, (2002). Standards and Criteria. Journal of Educational Measurement, 26 (7), 211-233. |
[16] | UNESCO Guidelines on Teachers’ Competence Procedures (1990). Code of Federal Regulations, Title 29, volume 4, part 1607, Revised as of July 2009. |
[17] | G. Whitty, (1996). Competencies and Professional characteristics: the Northern Ireland approach in the reform of teacher education in D. Hustler and D.I Mclntyre (eds). Developing Teachers: Approaches to professional Competence in Teacher Education in London. David Fulton. |