Document Type : Research Paper

Authors

1 Ph.D. candidate in Assessment and Measurement, Allameh Tabataba’i University

2 Associate Professor in Assessment and Measurement, Allameh Tabataba'i University

3 Assistant Professor in Assessment and Measurement, Allameh Tabataba'i University

Abstract

The goal of this research was to create and develop a combined test specification table based on the approaches of "Marzano and Kendall" and "Anderson et al." for the sixth-grade basic science curriculum, using a research and development methodology. The study population encompassed all web-based testing tools and experts in the fields of assessment and measurement, software, and science. This article outlines two phases of the research and development process, taking an architectural perspective into account. The first phase involved a thorough analysis of needs and background, while the second phase encompassed the design, architecture, and formative evaluation. In the initial phase, we examined research literature and software related to question design. In the subsequent phase, two software prototypes developed. The first prototype established the initial software framework based on a combined approach, employing artificial intelligence chatGPT-4 to generate 406 behavioral verbs and 5137 behavioral objectives, which their validity confirmed by assessment and measurement experts. In the second prototype, the software architecture was designed as a web application using the PHP language for the backend, the Laravel framework, JavaScript language, and the React framework for the frontend, along with a MySQL database and the REST protocol for server communication. This phase also addressed and resolved the initial sample's issues and bugs. Furthermore, the input and feedback from other experts were incorporated into the final design.

Keywords

Main Subjects

بروس. بی، فری (1395). سنجش کلاسی نوین (ترجمه: اسماعیل سعدی پور رها عابدی فاطمه رسولی). ناشر: موسسه فرهنگی مدرسه برهان
درتاج، فریبرز، و کرد نوقابی رسول. (1396). نظریه‌های آموزش: الگوها راهبردها، روش‌ها، فنون، ناشر: دانشگاه علامه طباطبایی
سهرابلو، مصطفی. (1397). ارزشیابی تکوینی الکترونیکی درس مطالعات اجتماعی. رشد آموزش علوم اجتماعی، پیاپی ۷۸ (زمستان ۱۳۹۷)، ص ۴۸. magiran.com/p1941078
سیف، علی‌اکبر. (1364). اندازه‌گیری و ارزشیابی پیشرفت تحصیلی. تهران: موسسه انتشارات آگاه
سیف، علی‌اکبر. (1395). اندازه‌گیری، سنجش و ارزشیابی آموزشی. تهران: دوران، چاپ 44
سیف، علی‌اکبر. (1395). روانشناسی پرورشی نوین. تهران: دوران.
طوفان زادۀ مژدهی، علی، علایی، ابراهیم، و رشیدی، حسن. (1398). رهیافتی کاربردی در معماری نرم‌افزار، تهران: سبزرایان گستر (چاپ دوم)
علی فرد، فاطمه، و کامیاب، شمس‌الدین. (1392). تأثیر فناوری‌های نوین بر آموزش زبان انگلیسی در سطوح بالای حیطه شناختی بلوم، اولین کنفرانس ملی آموزش زبان انگلیسی، ادبیات و مترجمی، شیراز، https://civilica.com/doc/221973
کیامنش، علیرضا؛ و گنجی، کامران. (1383). سنجش و یادگیری در دبیرستان. تهران: رشد
میگر. رابرت. او. (۱۳۵۵). تدارک هدف‌های آموزشی (ترجمه بهرام زنگنه و محمدحسین شمشیری). تهران: دانشگاه آزاد ایران (تاریخ انتشار اثر به زبان اصلی ۱۹۶۱).
نوروزی، داریوش و رضوی، سید عباس. (1390). مبانی طراحی آموزشی. تهران: سمت
نیکسون، رابین. (1399). مرجع کامل طراحی وب‌سایت با javascript, Mysql, PHP, HTML, CSS, jQuery (ترجمۀ یونس جمشیدی شیخ‌آبادی). انتشارات دانشگاهی کیان
References
Ali Fard, F., & Kamiab, Sh. (2013). The Impact of Modern Technologies on Teaching English at Higher Levels of Bloom's Cognitive Domain. First National Conference on English Language Teaching, Literature, and Translation, Shiraz, https://civilica.com/doc/221973. [In Persian]
Anderson, L. W., & Krathwohl, D. R. (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom's taxonomy of educational objectives. Longman.
Anderson, L. W., & Krathwohl, D. R. Airasian, P. W., Cruikshank, K. A., Mayer, R.E., Pintrich, P.R., Raths, J., & Wittrock. M.C. (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom's taxonomy of educational objectives. Longman.
Ausubel, D. P., Stager, M., & Gaite, A. J. H. (1968). Retroactive facilitation in meaningful verbal learning. Journal of Educational Psychology59(4), 250.
Biggs, J. B., & Collis, K. F. (2014). Evaluating the quality of learning: The SOLO taxonomy (Structure of the Observed Learning Outcome). Academic Press.
Bloom, B. S., Engelhart, M. D., Furst, E. J., Hill, W. H., & Krathwohl, D. R. (1956). Taxonomy of educational objetives: the classification of educational goals: handbook I: cognitive domain (No. 373.19 C734t). New York, US: D. Mckay. New York: McGraw-Hill
Bridge, P. D., Musial, J., Frank, R., Roe, T., & Sawilowsky, S. (2003). Measurement practices: methods for developing content-valid student examinations. Medical teacher25(4), 414-421.
Brookhart, S. M. (2010). How to assess higher-order thinking skills in your classroom. ASCD.
Bruce B. F. (2013). Modern classroom assessment. Sage publications. [In Persian]
Dortaj, F., & Kord Noghabi, R. (2016). Theories of Instruction, Allame Tabataba’I University, Tehran, Iran [In Persian]
Eggen, P., & Kauchak, D. (2001). Educational Psychology: Windows on Classrooms. 8th. Pearson
Eweda, G., Bukhary, Z. A., & Hamed, O. (2020). Quality assurance of test blueprinting. Journal of Professional Nursing36(3), 166-170.
Fink, L. D. (2013). Creating significant learning experiences: An integrated approach to designing college courses. John Wiley & Sons.
Flagg, B. N. (2013). Formative evaluation for educational technologies. Routledge.
Furst, E. J. (1994). Bloom's Taxonomy: Philosophical anbd Educational Issues. InAnderson, L.
Gagné, R. M., & Gagné, R. M. (1985). Conditions of learning and theory of instruction. Holt, Rinehart and Winston.
Gill, J. S., & Sen, S. (2020). Blueprinting of summative theory assessment of undergraduate medical students in microbiology. Medical journal armed forces india76(2), 207-212.
Kaur, M., Kurmi, N., Chauhan, S., Singhal, A., Sharma, S., & Chaudhary, S. (2021). Blueprinting for assessment in undergraduate medical physiology curriculum. Indian Journal of Physiology and Pharmacology65(1), 60-65.
Kiamanesh, A; & Ganji, K. (2004). Assessment and Learning in High School, Roshd Press, Tehran, Iran [In Persian]
Mager, R. F. (1984). Preparing Instructional Objectives (2nd edn), Pitman Learning Inc. [In Persian]
Marso, R. N., & Pigge, F. L. (1993). Teachers' testing knowledge, skills, and practices.
Marso, R. N., & Pigge, F. L. (1993). Training and Management Perceptions of Public School Testing Directors: Implications for Teacher Educators.
Marzano, R. J., & Kendall, J. S. (Eds.). (2007). The new taxonomy of educational objectives. Corwin Press.
McKenney, S. E. (2003). Computer-based support for science education materials developers in Africa: Exploring potentials.
McLaughlin, K., Coderre, S., Woloschuk, W., & Mandin, H. (2005). Does blueprint publication affect students’ perception of validity of the evaluation process? Advances in health sciences education10(1), 15-22.
McLaughlin, K., Lemaire, J., & Coderre, S. (2005). Creating a reliable and valid blueprint for the internal medicine clerkship evaluation. Medical teacher27(6), 544-547.
McLaughlin, K., Lemaire, J., & Coderre, S. (2005). Creating a reliable and valid blueprint for the internal medicine clerkship evaluation. Medical teacher27(6), 544-547.
McMillan, J. (2007). Classroom assessment: Principlesand practices for effective standards-based instruction (4th Ed.). Boston: Allyn & Bacon.
Newman, I., Lim, J., & Pineda, F. (2013). Content validity using a mixed methods approach: Its application and development through the use of a table of specifications methodology. Journal of Mixed Methods Research7(3), 243-260.
Nitko, A. (2004). Educational assessment of students (4th ed.). Upper Saddle River, NJ: Pearson.
Nixon, R. (2012). Learning PHP, MySQL, JavaScript, and CSS: A Step-by-Step Guide to Creating Dynamic Websites, O'Reilly Media [In Persian]
Norouzi, D., & Razavi, S. A. (2011). Fundamentals of Instructional Design, SAMT Press, Tehran, Iran. [In Persian]
Patel, T., Saurabh, M. K., & Patel, P. (2016). Perceptions of the use of blueprinting in a formative theory assessment in pharmacology education. Sultan Qaboos University Medical Journal16(4), e475.
Seif, A. A. (1985). Measurement and Evaluation of Educational achievement, Agah Press, Tehran, Iran [In Persian]
Seif, A. A. (2016). Educational Measurement, Assessment, and Evaluation, Doran Press, Tehran, Iran. [In Persian]
Seif, A. A. (2016). Modern Educational Psychology, Doran Press, Tehran, Iran. [In Persian]
Sohrabloo, M. (2018). Formative Electronic Assessment of Social Studies Course. Roshd Journal of Social Science Education, No. 78 (Winter 2018), p. 48. magiran.com/p1941078 [In Persian]
Tofanzadeh Mozhdehi, A., Alaei, E., & Rashidi, H. (2019). A Practical Approach to Software Architecture, 2nd edition, Sabz Rayan Gostar Press, Tehran, Iran. [In Persian]
Wiggins, G., Wiggins, G. P., & McTighe, J. (2005). Understanding by design. Ascd.