Development and validation of the “Organizational Planning Test”
(in Russian)
Abstract
Purpose. This study presents the development and validation of the “Organizational PlanningTest” (OPT), designed to assess planning competencies in working professionals (specialists and managers). Methodology. Employing contemporary psychometric approaches (classical test theory and item response theory), the test development followed a rigorous multi-stage procedure: (1) theoretical framework construction, (2) initial item pool generation, (3) think-aloud protocols, (4) expertreview, (5) pilot testing (N = 1,094; 74% female, 26% male; M = 49, SD = 9.2), and (6) psychometric evaluation with validity evidence collection. Findings. Psychometric analyses using the partial credit model demonstrated: (1) Essential unidimensionality (first contrast eigenvalue = 1.33), (2) Excellent item fit (Infit MNSQ = .92–1.17), (3) Adequate discrimination parameters (.23–.65), and (4) Strong reliability (α = .78, ω = .78). Convergent validity evidence emerged through significant correlations with: information analysis (r = .43, p < .001), systems thinking (r = .42, p < .001), self-organization(r = .15, p < .001), and anxiety (r = –.14, p < .001). ANOVA confirmed criterion validity through expected group differences: gender (η² = .01, p = .003), age (η² = .03, p = .000), and position level (η² = .01, p = .023). Implications for practice. The OPT constitutes a psychometrically robust measure of planning ability, with demonstrated applications for: (1) personnel selection, (2) competency assessments, (3) professional development programs, and (4) cognitive research. Future studies should explore cross-occupational adaptability and relationships with broader cognitive-personality constructs. Value of the results. The instrument provides HR practitioners and organizational psychologists with a validated diagnostic tool for workplace planning competencies, while contributing to research on cognitive predictors of job performance.
Downloads
References
Аббакумов, Д. Ф. (2023). Трудность тестового задания. В сб.: Большая российская энциклопедия. URL: https://bigenc.ru/c/trudnost-testovogo-zadaniia-da0711 (дата обращения: 27.03.2025)
Адаменко, А. А., Хорольская, Т. Е., Петров, Д. В. (2020). Роль стратегического планирования в развитии предпринимательской деятельности. Естественно-гуманитарные исследования, 3(29), 24–28.
Батурин, Н. А., Вучетич, Е. В., Костромина, С. Н., Кукаркин, Б. А., Куприянов, Е. А., Лурье, Е. В., Митина, О. В., Науменко, А. С., Орел, Е. А., Полетаева, Ю. С., Попов, А. Ю., Потапкин, А. А., Симоненко, С. И., Синицына, Ю. Д., Шмелев, А. Г. (2015). Российский стандарт тестирования персонала (временная версия, созданная для широкого обсуждения в 2015 году). Организационная психология, 5(2), 67–138.
Вилкова, К. А. (2020). Измерение саморегулируемого обучения: обзор инструментов. Современная зарубежная психология, 9(2), 123–133.
Моросанова, В. И., Кондратюк, Н. Г. (2020). К вопросу о факторной структуре краткой версии опросника В. И. Моросановой «Стиль саморегуляции поведения — ССПМ». В сб.: Т. Н. Банщикова, Е. А. Фомина, В. И. Моросанова (ред. колл.), Личностные и регуляторные ресурсы достижения образовательных и профессиональных целей в эпоху цифровизации (20-23 октября 2020 г.) (178–188). М.: Знание-М.
Смарт Бизнес Солюшнс. Организационный тест. Полная и экспресс версия. HR-маркет. URL: https://sbsc.ru/hrm/orgtest.html
Россия — страна возможностей. Департамент оценки и методологии. (2026). Каталог инструментов оценки и диагностики. URL: https://seafile.rsv.ru:9443/d/3e36d466a8534ec8ba2d/ (дата обращения: 10.02.2026)
Руководство к своду знаний по управлению проектами (Руководство PMBOK-6). (2020). М. : Олимп-бизнес.
Штроо, В. А. (2025). Методы активного социально-психологического обучения : учебник и практикум для академического бакалавриата. М.: Юрайт.
Ясин, М. И., Бажданова, Ю. В. (2024). Методика измерения долгосрочности и краткосрочности мотивации. Организационная психология, 14(1), 96–108.
A Guide to the Project Management Body of Knowledge — Seventh Edition. (2025). Moscow : ABC.
Aarts, H., Dijksterhuis, A. P., Midden, C. (1999). To plan or not to plan? Goal achievement or interrupting the performance of mundane behaviors. European Journal of Social Psychology, 29(8), 971–979.
AERA, APA, NCME. (2014). Standards for educational and psychological testing. American Educational Research Association, American Psychological Association, National Council on Measurement in Education. Washington, DC: AERA
Allan, J. L., Sniehotta, F. F., Johnston, M. (2013). The best laid plans: Planning skill determines the effectiveness of action plans and implementation intentions. Annals of Behavioral Medicine, 46(1), 114–120.
Andrich, D., Marais, I. (2019). A course in Rasch measurement theory. Measuring in the educational, social and health sciences, 41(8).
Antony, J. (2000). Ten key ingredients for making SPC successful in organisations. Measuring Business Excellence, 4(4), 7–10.
Barati, A. A., Asadi, A., Kalantari, K., Azadi, H., Mamoorian, M. (2014). Analyzing the impacts of agricultural land use change according to the experts opinion of agricultural land organization in Iran. Iranian Journal of Agricultural Economics and Development Research, 45(4), 639–650.
Bertua, C., Anderson, N., Salgado, J. F. (2005). The predictive validity of cognitive ability tests: A UK meta‐analysis. Journal of Occupational and Organizational psychology, 78(3), 387–409.
Bock, R. D., Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46(4), 443–459.
Bock, R. D., Mislevy, R. J. (1982). Adaptive EAP estimation of ability in a microcomputer environment. Applied psychological measurement, 6(4), 431–444.
Cao, D. S., Schüz, N., Xie, G. R., Lippke, S. (2013). Planning skills moderate the intention–planning cognitions–behaviour relation: a longitudinal study on physical activity in Chinese adolescents. Research in Sports Medicine, 21(1), 12–23.
Collins, A., Koechlin, E. (2012). Reasoning, learning, and creativity: Frontal lobe function and human decision-making. PLoS Biology, 10(3), el001293.
Costa, P. T., McCrae, R. R. (2014). The NEO Inventories. In Personality assessment (229–260). Routledge.
Costa, P. T. (1996). Work and personality: Use of the NEO‐PI‐R in industrial / organisational psychology. Applied Psychology, 45(3), 225–241.
Crocker, L., Algina, J. (1986). Introduction to classical and modern test theory. Holt, Rinehart and Winston, 6277 Sea Harbor Drive, Orlando, FL 32887.
Eagly, A. H., Woo, W., Diekman, A. B. (2012). Social role theory of sex differences and similarities: A current appraisal. In T. Eckes, H. M. Trautner (Eds.), The developmental social psychology of gender (123–174). New York: Psychology Press.
Evers, A., Hagemeister, C., Høstmælingen, A., Lindley, P., Muñiz, J., Sjöberg, A. (2013). EFPA review model for the description and evaluation of psychological and educational tests. Test review form and notes for reviewers. Version 4.2, 6.
Evers, A., Muñiz, J., Hagemeister, C., Høstmælingen, A., Lindley, P., Sjöberg, A., Bartram, D. (2013). Assessing the quality of tests: Revision of the EFPA review model. Psicothema, 25(3), 283–291.
Frederiksen, N., Saunders, D. R., Wand, B. (1957). The in-basket test. Psychological Monographs, 71(438). https://doi.org/10.1037/h0093706
Gouda, H. (2020). Exploring the relevant skills needed for the digital age employees. European Journal of Business and Management, 12(2), 58–67.
Gross, R. G., Grossman, M. (2010). Executive resources. Continuum: Lifelong Learning in Neurology, 16(4), 140–152.
Haladyna, T. M., Downing, S. M. (1988). Functional Distractors: Implications for Test-Item Writing and Test Design.
Harada, C. N., Love, M. C. N., Triebel, K. (2013). Normally cognitive aging. Clinics in geriatric medicine, 29(4), 737.
Hayes-Roth, B., Hayes-Roth, F. (1979). A cognitive model of planning. Cognitive Science, 3, 245—262.
Hsu, N., Badura, K. L., Newman, D. A., Speach, M. E. P. (2021). Gender, “masculinity,” and “femininity”: A meta-analytic review of gender differences in agency and communion. Psychological Bulletin, 147(10), 987.
Joshi, A., Kale, S., Chandel, S., Pal, D. K. (2015). Likert scale: Explored and explained. British journal of applied science & technology, 7(4), 396–403
Karat, J. (1982). A model of problem solving with incomplete constraint knowledge. Cognitive Psychology, 14, 538–559.
Kerzner, H. (2019). Using the Project Management Maturity Model: Strategic Planning for Project Management. John Wiley & Sons.
Kock, F., Berbekova, A., Assaf, A. G., Josiassen, A. (2024). Developing a scale is not enough: on the importance of nomological validity. International Journal of Contemporary Hospitality Management, 36(10), 3233–3244.
Köhler, C., Robitzsch, A., Hartig, J. (2020). A bias-corrected RMSD item fit statistic: An evaluation and comparison to alternatives. Journal of Educational and Behavioral Statistics, 45(3), 251–273.
Linacre, J. M. (2025). A User’s Guide to WINSTEPS® MINISTEP Rasch-Model Computer Programs. Program Manual 5.9.1. URL: https://www.winsteps.com/a/Winsteps-Manual.pdf (дата обращения: 27.03.2025)
Masters, G. N. (2016). Partial credit model. In W. J. Linden, R. K. Hambleton (Eds.), Handbook of item response theory (109–126). Chapman and Hall/CRC.
Matlock-Hetzel, S. (1997). Basic Concepts in Item and Test Analysis.
Morgeson, F. P., Campion, M. A., Dipboye, R. L., Hollenbeck, J. R., Murphy, K., Schmitt, N. (2007). Reconsidering the use of personality tests in personnel selection contexts. Personnel psychology, 60(3), 683–729.
Morris, R., Ward, G. (Eds.). (2004). The cognitive psychology of planning. New York : Psychology Press.
Nassif, V. M. J., Hashimoto, M., Amaral, D. J. (2014). Entrepreneurs self-perception of planning skills: evidences from Brazilian entrepreneurs. Revista Ibero Americana de Estratégia, 13(4), 107–121.
The OPC (2025). Graduate Situational Judgement Test (GSJT). opc assessment. URL: https://www.theopc.co.uk/assessment/test/gsjt/ (дата обращения: 28.10.2025)
Owen, A. (1997). Cognitive planning in humans: Neuropsychological, neuro anatomical and neuropharmalogical perspectives. Prog Neurobiol., 53, 431–450
Papa-Gusho, L., Biçaku-Çekrezi, R. (2015). Factors that affect effective planning skills of the teacher in the classrooms. Academic Journal of Interdisciplinary Studies, 4(3), 560–564.
Pellerin, R., Perrier, N. (2019). A review of methods, techniques and tools for project planning and control. International Journal of Production Research, 57(7), 2160–2178.
Phillips, L. H., MacLeod, M. S., Kliegel, M. (2005). Adult aging and cognitive planning. The cognitive psychology of planning, 111–134.
Powell, J. W., Pharris, L. J., Hardy, M. M. (2020). A Comparison of time management skills among accounting, business, and information systems students by age and gender. Issues in Information Systems, 21(3), 1–10.
Prencipe, A., Kesek, A., Cohen, J., Lamm, C., Lewis, M. D., Zelazo, P. D. (2011). Development of hot and cool executive function during the transition to adolescence. Journal of experimental child psychology, 108(3), 621–637.
Reilly, D., Neumann, D. L., Andrews, G. (2022). Gender differences in self-estimated intelligence: Exploring the male hubris, female humility problem. Frontiers in Psychology, 13.
Roshanai, A., Janeslätt, G., Marie White, S., Lidstroem Holmqvist, K., Holmefur, M. (2021). Psychometric properties of the original version of the assessment of time management skills. The American Journal of Occupational Therapy, 75(Supplement_2), 7512500038p1-7512500038p1.
Shallice, T. (1982). specific impairments of planning. philosophical transactions of the Royal Society of London. B, Biological Sciences, 298(1089), 199–209.
Sorel, O., Pennequin, V. (2008). Aging of the planning process: The role of executive functioning. Brain and cognition, 66(2), 196–201.
Syzmanowicz, A., Furnham, A. (2011). Gender differences in self-estimates of general, mathematical, spatial and verbal intelligence: Four meta-analyses. Learning and Individual Differences, 21(5), 493–504.
Testa, S., Toscano, A., Rosato, R. (2018). Distractor efficiency in an item pool for a statistics classroom exam: Assessing its relation with item cognitive level classified according to Bloom’s taxonomy. Frontiers in psychology, 9, 1585.
Thorndike, R. M., Thorndike-Christ, T. M. (2013). Measurement and evaluation in psychology and education. Pearson Education Limited.
UNESCO Institute of Statistics (2015). Researchers by age. UNESCO UIS. URL: https://uis.unesco.org/node/3080143 (дата обращения: 31.03.2025)
Verulava, T. (2023). Strategic management and planning for health care organizations in Georgia. Asia Pacific Journal of Health Management, 18(3), 41–48.
Viswesvaran, C., Ones, D. S. (1999). Meta-analyses of fakability estimates: Implications for personality measurement. Educational and psychological measurement, 59(2), 197–210.
Vita, S., Coplin, H., Feiereisel, K. B., Garten, S., Mechaber, A. J., Estrada, C. (2013). Decreasing the ceiling effect in assessing meeting quality at an academic professional meeting. Teaching and learning in medicine, 25(1), 47–54.
Wakita, T., Ueshima, N., Noguchi, H. (2012). Psychological distance between categories in the Likert scale: Comparing different numbers of options. Educational and psychological measurement, 72(4), 533–546.
Ward, L. B. (1959). The business in-basket test: A method of assessing certain administrative skills. ETS Research Bulletin Series, 1959(1), i-49.
Zelazo, P. D., Cunningham, W. (2007). Executive function: Mechanisms underlying emotion regulation. In J. J. Gross, R. A. Thompson (Eds.), Handbook of emotion regulation (135–158). Guilford Press.
.jpg)
