Analisis Peluang Guessing pada Culture Fair Intelligence Test (Cfit) 3A dengan Metode IRT

  • Medianta Tarigan Universitas Pendidikan Indonesia
  • Fadillah Fadillah
DOI: https://doi.org/10.25077/jip.5.1.92-100.2021

Abstract

Culture Fair Intelligence Test (CFIT) is a popular nonverbal intelligence measuring instrument used for psychological examination purposes. The figural form of a test with multiple choice as in CFIT can increase the chances of guessing behavior performed by the test subject. Guessing behavior will increase when subjects are encouraged to work on as many uncertain questions as possible whether they know the answer to the question. This behavior can affect the validity of test results in distinguishing quality and under-qualified test subjects. Until now, research related to CFIT psychometric properties is still limited. This study aims to evaluate the validity of CFIT by analyzing the guessing behavior using the Item Response Theory (IRT) method. The sample of this study was 1,955 participants and the results showed that based on IRT 3 PL modeling, the items in the CFIT 3A are still feasible to use. However, CFIT 3A contains items with an unacceptable guessing rate, 12% of the total number of items. The result of model fit test using Confirmatory Factor Analysis (CFA) method as an additional analysis shows that validity construct of CFIT 3A is good. It is expected that the results of the study can provide up-to-date information on the quality of CFIT 3A items and become a reference for other relevant research in the future.

Downloads

Download data is not yet available.

References

Adedoyin, O. O., & Mokobi, T. (2013). Using Irt Psychometric Analysis in Examining the Quality of Junior Certificate Mathematics Multiple Choice Examination Test Items. International Journal of Asian Social Science, 3(4), 992–1011.
An, X., & Yung, Y. (2014). Item Response Theory : What It Is and How You Can Use the IRT Procedure to Apply It. SAS Institute Inc., 1–14. https://support.sas.com/resources/papers/proceedings14/SAS364-2014.pdf
Andriani, F., Hadi, C., & Paramita, P. P. (2017). Development and Validity of Fluid Intelligence Test Based on Cattle-Horn-Carrol Theory: A Pilot Project. INSAN Jurnal Psikologi Dan Kesehatan Mental, 1(2), 76. https://doi.org/10.20473/jpkm.v1i22016.76-84
Baker, F. B. (2001). Item Response Theory the Basics of Item Response Theory the (C. Boston & L. Rudner (eds.); Second Edi). ERIC Clearinghouse on Assessment and Evaluation.
Boyle, G. J., Stankov, L., Martin, N. G., Petrides, K. V., Eysenck, M. W., & Ortet, G. (2016). Hans J. Eysenck and Raymond B. Cattell on intelligence and personality. Personality and Individual Differences, 103(November 2017), 40–47. https://doi.org/10.1016/j.paid.2016.04.029
Brown, R. E. (2016). Hebb and cattell: The genesis of the theory of fluid and crystallized intelligence. Frontiers in Human Neuroscience, 10(DEC2016). https://doi.org/10.3389/fnhum.2016.00606
Brown, T. A. (2015). Methodology in the social sciences.Confirmatory factor analysis for applied research (2nd ed.). The Guilford Press.
Bureau of Exceptional Education and Student Services. (2005). Nonverbal Tests of Intelligence. Florida Deparemtne of Education Technical Assisstance Paper, May, 1–12.
Byrne, B. M. (2013). Structural Equation Modeling With Lisrel, Prelis, and Simplis. Structural Equation Modeling With Lisrel, Prelis, and Simplis. https://doi.org/10.4324/9780203774762
Cattell, R. B. (2009). Reprinted from The British Journal of Psychology (1946), 36, 159-174: Personality structure and measurement II: the determination and utility of trait modality. British Journal of Psychology (London, England : 1953), 100(Pt 1A), 233–248. https://doi.org/10.1348/000712608X344807
Cattell, Raymond B. (1940). The Journal of Educational Psychology. Annual Review of Psychology, XXXI(3), 161–179. https://doi.org/10.1146/annurev.ps.13.020162.002103
Cattell, Raymond B. (1951). Classical and Standard Score IQ Standardization of The I.P.A.T. Culture Free Intelligence Scale 2. 154–159.
Cattell, Raymond B. (1963). Theory of fluid and crystallized intelligence: A critical experiment. Journal of Educational Psychology, 54(1), 1–22. https://doi.org/10.1037/h0046743
Cattell, Raymond B. (1986). The Discovery of Fluid and Crystallized General Intelligence. In Raymond B. Cattell (Ed.), Intelligence: Its Structure, Grown and Action (pp. 87–120). https://doi.org/doi.org/10.1016/S0166-4115(08)60118-1
Chin, W. W. (1998). The Partial LEast Squares Approach to Structural Equation Modelling. In Modern Methods for Business Research (pp. 295–336).
Chiu, T. W., & Camilli, G. (2013). Comment on 3PL IRT Adjustment for Guessing. Applied Psychological Measurement, 37(1), 76–86. https://doi.org/10.1177/0146621612459369
Colom, R., & García-López, O. (2003). Secular gains in fluid intelligence: Evidence from the culture-fair intelligence test. Journal of Biosocial Science, 35(1), 33–39. https://doi.org/10.1017/S0021932003000336
dictionary.apa.org. (n.d.). Nonverbal Test. https://dictionary.apa.org/nonverbal-test
Espinosa, M. P., & Gardeazabal, J. (2010). Optimal correction for guessing in multiple-choice tests. Journal of Mathematical Psychology, 54(5), 415–425. https://doi.org/10.1016/j.jmp.2010.06.001
Fischer, H. E., Boone, W. J., Fischer, H. E., & Boone, W. J. (2014). Quantitative Research Designs and Approaches Quantitative Research Designs and Approaches University of Duisburg-Essen , Essen , Germany Knut Neumann Leibniz-Institute for Science and Mathematics Education ( IPN ), Kiel , Germany. October 2015.
Ghozali, I., & Fuad, F. (2008). Structural Equation Modeling. Universitas Diponegoro.
Gregory, R. J. (2011). Psychological testing: History, principles, and applications (6th ed.) (6th ed.). Allyn & Bacon.
Gupta, S. (1991). Effects of time of day and personality on intelligence test scores. Personality and Individual Differences, 12(11), 1227–1231. https://doi.org/10.1016/0191-8869(91)90089-T
Ha, D. T. (2017). Applying Multidimensional Three-Parameter Logistic Model ( M3PL ) In Validating a Multiple-Choice Test. 7(2), 175–183.
Hair, Joseph F., J., Hult, G. T. M., Ringle, C., & Sarstedt, M. (2014). A Primer on Partial Least Squares Structural Equation Modelling {PLS-SEM}. SAGE Publication, Inc.
Hambleton, R. (1990). Item response theory: introduction and bibliography. Psicothema, 2(1), 97–107.
Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of Item Response Theory Library.
Heine, J.-H., Gebhard, M., Schwab, S., Neumann, P., Gorges, J., & Wild, E. (2018). Testing psychometric properties of the CFT 1-R for students with special educational needs. Psychological Test and Assessment Modeling, 60(1), 3–28.
IPAT. (1973). Measuring intelligence with the Culture Fair Tests: Manual for Scales 2 and 3. Institute for Personality and Ability Testing.
Kumar, P., & Kumar, M. (2015). Intelligence and Teaching Aptitude Among Future Professional Teachers. International Journal of Social Science & Interdisciplinary Research, 4(November 2015), 68–72.
Kumara, A. (1989). Studi Validitas dan Reliabilitas Culture Fair Intellegence Test Skala 3 Sebagai Alat Ukur Inteligensi pada Para Mahasiswa. Universitas Gadjah Mada.
Larson, S. S. (1967). DigitalCommons @ USU A Comparison of Two Non-Verbal Intelligence Tests as Predictors of Academic Success of Navajo Students.
Marquart, D. I., & Bailey, L. L. (1955). An evaluation of the culture free test of intelligence. Journal of Genetic Psychology, 86(2), 353–358. https://doi.org/10.1080/00221325.1955.10532206
McCowan, R. J., & McCowan, S. C. (1999). Item Analysis for Criterion-Referenced Tests. Reading Teacher.
Mukherjee, P., & Samanta, T. K. (2016). An Assessment of IQ by Applying Cattell’s Culture Fair Test and A Comparative Study of IQ BEtween Boys and Girls (Urban Area of Burdwan District, West Bengal, India). 4(1), 64–75. http://www.educationindiajournal.org/home_art_avi.php?path=&id=236
Naderi, H., Abdullah, R., Aizan, H. T., & Sharir, J. (2010). Intelligence and academic achievement: An investigation of gender differences. Life Science Journal, 7(1), 83–87.
Nenty, H. J., & Dinero, T. E. (1981). A Cross-Cultural Analysis of the Fairness of the Cattell Culture Fair Intelligence Test Using the Rasch Model. Applied Psychological Measurement, 5(3), 355–368. https://doi.org/10.1177/014662168100500309
Nurcahyo, F. A., Suprapto, M. H., Boeditjahjono, Hosea, J., & Putriadi, G. E. (2019). KORELASI ANTARA CFIT, TES PEMAHAMAN, DAN TES BERHITUNG PADA SISWA KELAS XII DI KEPULAUAN MENTAWAI. Journal of Chemical Information and Modeling, 53(9), 1689–1699. https://doi.org/10.1017/CBO9781107415324.004
Obinne, A. D. E. (2012). Using IRT in Determining Test Item Prone to Guessing. World Journal of Education, 2(1), 91–95. https://doi.org/10.5430/wje.v2n1p91
Rahmawati, E. (2014). Evaluasi Karakteristik Psikometri Intelligenz Struktur Test (IST). Proceeding Seminar Nasional Psikometri, 270–282.
Ruiz, P. E. (2009). Measuring fluid intelligence on a ratio scale: Evidence from nonverbal classification problems and information entropy. Behavior Research Methods, 41(2), 439–445. https://doi.org/10.3758/BRM.41.2.439
Sahadi, S., & Wibowo, M. A. (2013). Pengaruh Faktor Motivasi dan Kepercayaan Terhadap Kinerja Melalui Komitmen Pada Manajer Proyek Kontruksi Dengan Pendekatan Structural Equation Modeling. Jurnal Ilmu Dan Terapan Bidang Teknik Sipil, 19(2).
Saptoto, R. (2018). Pengaruh Adaptasi Waktu Administrasi yang disebabkan Penggunaan Lembar Jawaban Komputer terhadap Hasil CFIT 3 A dan 3 B. Jurnal Psikologi, 45(1), 52–65. https://doi.org/10.22146/jpsi.30853
Setiyowati, N. (2018). HUBUNGAN ANTARA KEMAMPUAN INTELEGENSI (CFIT) DAN POTENSI PERFORMA KERJA (DARI HASIL KRAEPELIN TEST) PADA CALON KARYAWAN BANK SWASTA DI JAWA TIMUR. 5.
Sigal, M. J., & Mckelvie, S. J. (2012). Is Exposure to Visual Media Related to Cognitive Ability? Testing Neisser’s Hypothesis for the Flynn Effect. Journal of Articles in Support of the Null Hypothesis Journal of Articles in Support of the Null Hypothesis. JASNH, 9(1), 23–50. www.jasnh.com
Sijtsma, K., & Junker, B. W. (2006). Item Response Theory: Past Performance, Present Developments, and Future Expectations. Behaviormetrika, 33(1), 75–102. https://doi.org/10.2333/bhmk.33.75
Soekadji, S. (1999). Guessing : Instructed or Discouraged Penalized or Unpenalized ? 2, 93–105.
Suwartono, C., Amiseso, C. P., & Handoyo, R. T. (2017). Uji Reliabilitas dan Validitas Eksternal The Raven’s Standard Progressive Matrices. Humanitas, 14(1), 1. https://doi.org/10.26555/humanitas.v14i1.5772
Suwartono, C., Hidajat, L. L., Halim, M. S., Hendriks, M. P. H., & Kessels, R. P. C. (2016). External Validity of the Indonesian Wechsler Adult Intelligence Scale – Fourth Edition (WAIS-IV-ID). ANIMA Indonesian Psychological Journal, 32(1), 16–28. https://doi.org/10.24123/aipj.v32i1.581
Tan, O., Okuyan, M., Albayrak, T., & Akgun, A. (2003). Sex Differences in Verbal and Spatial Ability Reconsidered in Relation to Body Size, Lung Volume, and Sex Hormones. Perceptual and Motor Skills, 1347–1360.
Wijanto, S. (2008). Struktural Equation Modelling dengan Lisrel 8.8. Graha Ilmu.
Wulan, R. (2010). Peranan Inteligensi, Penguasaan Kosakata, Sikap, dan Minat terhadap Kemampuan Membaca pada Anak. Jurnal Penelitian Dan Evaluasi Pendidikan, 14(2), 166–185. https://doi.org/10.21831/pep.v14i2.1077
Yang, F. M., & Kao, S. T. (2014). Item response theory for measurement validity. Shanghai Archives of Psychiatry, 26(3), 171–177. https://doi.org/10.3969/j.issn.1002-0829.2014.03.010
Zanon, C., Hutz, C. S., Yoo, H., & Hambleton, R. K. (2016). An application of item response theory to psychological test development. Psicologia: Reflexao e Critica, 29(1). https://doi.org/10.1186/s41155-016-0040-x
Published
2021-07-31
How to Cite
TARIGAN, Medianta; FADILLAH, Fadillah. Analisis Peluang Guessing pada Culture Fair Intelligence Test (Cfit) 3A dengan Metode IRT. Jurnal Ilmu Perilaku, [S.l.], v. 5, n. 1, p. 92-110, july 2021. ISSN 2581-0421. Available at: <http://jip.fk.unand.ac.id/index.php/jip/article/view/307>. Date accessed: 22 dec. 2024. doi: https://doi.org/10.25077/jip.5.1.92-100.2021.
Citation Formats
Issue
Vol 5 No 1 (2021): Jurnal Ilmu Perilaku
Section
Articles
Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

The non-commercial use of the article is governed by the Creative Commons Attribution license as currently displayed on Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

JIP's spirit is to disseminate articles published are as free as possible. Under the Creative Commons license, JIP permits users to copy, distribute, display, and perform the work for non-commercial purposes only. Users will also need to attribute authors and JIP on distributing works in the journal.

Please find the rights and licenses in Jurnal Ilmu Perilaku (JIP).

  1. License

The non-commercial use of the article will be governed by the Creative Commons Attribution license as currently displayed on Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. 

  1. Author’s Warranties

The author warrants that the article is original, written by stated author(s), has not been published before, contains no unlawful statements, does not infringe the rights of others, is subject to copyright that is vested exclusively in the author and free of any third party rights, and that any necessary written permissions to quote from other sources have been obtained by the author(s).

  1. User Rights

JIP's spirit is to disseminate articles published are as free as possible. Under the Creative Commons license, JIP permits users to copy, distribute, display, and perform the work for non-commercial purposes only. Users will also need to attribute authors and JIP on distributing works in the journal.

  1. Rights of Authors

Authors retain the following rights:

  • Copyright, and other proprietary rights relating to the article, such as patent rights,
  • The right to use the substance of the article in future own works, including lectures and books,
  • The right to reproduce the article for own purposes, provided the copies are not offered for sale,
  • The right to self-archive the article.
  1. Co-Authorship

If the article was jointly prepared by other authors, the signatory of this form warrants that he/she has been authorized by all co-authors to sign this agreement on their behalf, and agrees to inform his/her co-authors of the terms of this agreement.

  1. Termination

This agreement can be terminated by the author or JIP upon two months’ notice where the other party has materially breached this agreement and failed to remedy such breach within a month of being given the terminating party’s notice requesting such breach to be remedied. No breach or violation of this agreement will cause this agreement or any license granted in it to terminate automatically or affect the definition of JIP. 

  1. Royalties

This agreement entitles the author to no royalties or other fees. To such extent as legally permissible, the author waives his or her right to collect royalties relative to the article in respect of any use of the article by JIP or its sublicensee.

  1. Miscellaneous

JIP will publish the article (or have it published) in the journal if the article’s editorial process is successfully completed and JIP or its sublicensee has become obligated to have the article published. JIP may conform the article to a style of punctuation, spelling, capitalization, referencing and usage that it deems appropriate. The author acknowledges that the article may be published so that it will be publicly accessible and such access will be free of charge for the readers.