ارزشيابي سوالات شيمي كنكور سراسري رشته علوم تجربي در سال 1396 با استفاده از نظريه سوال-پاسخ

Evaluation of Chemistry Questions in Concur 2017 Using Item Response Theory

پژوهش حاضر به ارزشيابي سوالات شيمي كنكور سراسري گروه علوم تجربي در سال 1396 با اﺳﺘﻔﺎده از ﻧﻈﺮﯾﻪ ﺳﻮال-ﭘﺎﺳﺦ ﻣﯽ ﭘﺮدازذ. روش ﭘﮋوﻫﺶ: ﭘﮋوﻫﺶ ﮐﺎرﺑﺮدي، ﺗﻮﺻﯿﻔﯽ- ﭘﯿﻤﺎﯾﺸﯽ اﺳﺖ. ﺟﺎﻣﻌﻪ آﻣﺎري ﮐﻠﯿﻪ داوﻃﻠﺒﺎن ﮐﻨﮑﻮر ﺳﺮاﺳﺮي ﮔﺮوه ﻋﻠﻮم ﺗﺠﺮﺑﯽ در ﺳﺎل 1396 و ﻧﻤﻮﻧﻪ آﻣﺎري 5000 ﭘﺎ ﺳﺨﻨﺎﻣﻪ از ﻣﯿﺎن ﭘﺎ ﺳﺨﻨﺎﻣﻪ ﻫﺎي داوﻃﻠﺒﺎن ﺷﺮﮐﺖ ﮐﻨﻨﺪه در اﯾﻦ ﺳﺎل اﺳﺖ و ﻣﺤﺎﺳﺒﺎت ﺑﺎ ﻧﺮم اﻓﺰارﻫﺎي IRTPRO ،NOHARM و EXCEL اﻧﺠﺎم ﺷﺪه اﺳﺖ. ﯾﺎﻓﺘﻪﻫﺎ: ﺑﺮاﺳﺎس ﻧﻈﺮﯾﻪ ﮐﻼﺳﯿﮏ و ﺳﻮال ﭘﺎﺳﺦ، ﭘﺎراﻣﺘﺮﻫﺎي ﺗﮏ ﺗﮏ ﺳﻮاﻻت ﻣﺤﺎﺳﺒﻪ ﺷﺪ. ﻧﺘﺎﯾﺞ ﻧﺸﺎن داد 7 ﺳﻮال ﻫﻢ ﺑﺎ ﻣﺪل ﯾﮏ ﭘﺎراﻣﺘﺮي و ﻫﻢ دو ﭘﺎراﻣﺘﺮي و 21 ﺳﻮال ﺑﺎ ﻣﺪل ﺳﻪ ﭘﺎرارﻣﺘﺮي ﺑﺮازش ﻣﻨﺎﺳﺒﯽ ﻧﺸﺎن ﻣﯽ دﻫﻨﺪ و 13 ﺳﻮال ﻧﯿﺰ ﺑﺎ ﻫﯿﭽﮑﺪام از ﻣﺪﻟﻬﺎي ﻧﻈﺮﯾﻪ ﺳﻮال-ﭘﺎﺳﺦ ﺑﺮازش ﻧﺸﺎن ﻧﻤﯽ دﻫﻨﺪ. ﺗﺤﻠﯿﻞ ﺳﻮاﻻت ﺑﺎ ﻣﺪل ﺳﻪ ﭘﺎراﻣﺘﺮي ﻧﺸﺎن داد ﮐﻪ 26 ﺳﻮال از ﻧﻈﺮ ﺿﺮﯾﺐ ﺗﺸﺨﯿﺺ ﻗﻮي)1.3>a(، 6 ﺳﻮال ﻣﺘﻮﺳﻂ و 3 ﺳﻮال ﺿﻌﯿﻒ)0.65b( و 24 ﺳﻮال ﻣﻨﺎﺳﺐ )1.2

The aim of this study is to evaluate the chemistry questions of university entrance exam (concur) in 2017 by using item-response theory. Methods: This is an applied, descriptive research. 5,000 answer sheets of participants in Empirical Science group, were selected randomly as sample. All parameters were calculated with NOHARM and IRTPRO and EXCEL softwares. Results: First the initial assumptions of IRT theory (unidimensionality and local Independence) were investigated. The parameters of each questions such as difficulty and discrimination coefficient, were calculated based on the classic and the item response theories. The results showed that 7 questions show a good fit with one and two parameter models and 21 questions are also compatible with three-parameter model and 13 questions don’t fit with any IRT models. The analysis with 3-PL-IRT showed the discrimination coefficient of 26 questions are strong (a> 1.3), 6 are moderate and 3 are weak (a <0.65). Also 11 questions were very difficult (b> 1.2) and 24 questions were appropriate (-1.2