2026

Navigating ethical approval challenges: A case of cross-national multi-method social science project

Khavenson T, Yemini M, Sperduti V. Navigating ethical approval challenges: A case of cross-national multi-method social science project. Methods in Psychology. 2026 Jun;14:100223. [DOI] [Link to publication in Scopus]
 

The last few decades have significantly changed international research collaborations in the social sciences. Projects now span multiple countries, employ diverse methodologies, and involve various actors, producing varied data for dissemination across scholarship, practice, and policy domains. Such complexity poses not only research challenges but also considerable legislative concerns, particularly regarding privacy protection and the evolving landscape of data gathering and usage. Navigating the increasingly flexible and intricate nature of contemporary research, alongside constantly changing legislation, has become a new hurdle for delivering robust comparative projects. Employing a case study approach, we examine the ethical approval process experienced by the project team members, including postdoctoral and doctoral students, project advisory board members, and the PI. The project under investigation encompassed several potential challenges: a range of qualitative research methods, sensitive topics, multi-site data collection, participants under 18, and the use of social media data. We traced this process across multiple international sites, demonstrating how these challenges collectively contributed to the overall complexity of ethical and data governance issues. Our findings illustrate the difficulties presented by ethical approval processes, the changes these processes imposed on the study design, and inconsistencies within the ethical clearance process across funding entities, countries, and institutions. We underscore three disjunctures inherent in ethical approval processes. By mapping the ethical route across multiple sites, we offer insights for researchers planning international projects, as well as for Research Ethics Committees, institutions, and other stakeholders within higher education seeking to support research endeavours.

@article{d491e225f4ba44d1b5346752feb04a13,
title = "Navigating ethical approval challenges: A case of cross-national multi-method social science project",
abstract = "The last few decades have significantly changed international research collaborations in the social sciences. Projects now span multiple countries, employ diverse methodologies, and involve various actors, producing varied data for dissemination across scholarship, practice, and policy domains. Such complexity poses not only research challenges but also considerable legislative concerns, particularly regarding privacy protection and the evolving landscape of data gathering and usage. Navigating the increasingly flexible and intricate nature of contemporary research, alongside constantly changing legislation, has become a new hurdle for delivering robust comparative projects. Employing a case study approach, we examine the ethical approval process experienced by the project team members, including postdoctoral and doctoral students, project advisory board members, and the PI. The project under investigation encompassed several potential challenges: a range of qualitative research methods, sensitive topics, multi-site data collection, participants under 18, and the use of social media data. We traced this process across multiple international sites, demonstrating how these challenges collectively contributed to the overall complexity of ethical and data governance issues. Our findings illustrate the difficulties presented by ethical approval processes, the changes these processes imposed on the study design, and inconsistencies within the ethical clearance process across funding entities, countries, and institutions. We underscore three disjunctures inherent in ethical approval processes. By mapping the ethical route across multiple sites, we offer insights for researchers planning international projects, as well as for Research Ethics Committees, institutions, and other stakeholders within higher education seeking to support research endeavours.",
keywords = "Ethical clearance, Institutional review boards (IRB), International research collaboration, Minor participants, Qualitative research, Research ethics committees (REC), School-based research, Social media data",
author = "Tatiana Khavenson and Miri Yemini and Vanessa Sperduti",
note = "Publisher Copyright: Copyright {\textcopyright} 2025. Published by Elsevier Ltd.",
year = "2026",
month = jun,
doi = "10.1016/j.metip.2025.100223",
language = "אנגלית",
volume = "14",
journal = "Methods in Psychology",
issn = "2590-2601",
publisher = "Elsevier B.V.",

}

Youth, Migration, and Active Citizenship: Exploring Students’ Citizenship Vocabularies Across Six Countries

Yemini M, Stahl G, Khavenson T, Sperduti VR, Elerian M, Inguaggiato C et al. Youth, Migration, and Active Citizenship: Exploring Students’ Citizenship Vocabularies Across Six Countries. American Educational Research Journal. 2026 Apr;63(2):384-420. [DOI] [Link to publication in Scopus]
 

Migration profoundly shapes the lives of young people and is a polarizing topic in public discourse globally. This article examines if and how secondary school students across six countries with significant migration connect the issue of migration with their understanding of active citizenship. Employing Thorson's concept of citizenship vocabularies, we document and analyze young people's perceptions as well as the resources, narratives, and frameworks they use to make sense of migration, citizenship, and civic life. Drawing on data from deliberative discussion groups, the study adds depth to our understanding of how the current generation of youth engages with a complex and multifaceted social issue and makes an important contribution to debates concerning citizenship education, youth activism, and migration.

@article{63d1a43621ed4a3f872be917973e036f,
title = "Youth, Migration, and Active Citizenship: Exploring Students{\textquoteright} Citizenship Vocabularies Across Six Countries",
abstract = "Migration profoundly shapes the lives of young people and is a polarizing topic in public discourse globally. This article examines if and how secondary school students across six countries with significant migration connect the issue of migration with their understanding of active citizenship. Employing Thorson's concept of citizenship vocabularies, we document and analyze young people's perceptions as well as the resources, narratives, and frameworks they use to make sense of migration, citizenship, and civic life. Drawing on data from deliberative discussion groups, the study adds depth to our understanding of how the current generation of youth engages with a complex and multifaceted social issue and makes an important contribution to debates concerning citizenship education, youth activism, and migration.",
keywords = "active citizenship, citizenship vocabularies, civic education, migration, youth activism",
author = "Miri Yemini and Garth Stahl and Tatiana Khavenson and Sperduti, \{Vanessa R.\} and Martyna Elerian and Carla Inguaggiato and Tara Bartlett and \{Eten Angyagre\}, Simon and Ullrich Bauer",
note = "Publisher Copyright: {\textcopyright} 2026 The Author(s). This article is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 License (https://creativecommons.org/licenses/by-nc/4.0/) which permits non-commercial use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access page (https://us.sagepub.com/en-us/nam/open-access-at-sage).",
year = "2026",
month = apr,
doi = "10.3102/00028312261416919",
language = "אנגלית",
volume = "63",
pages = "384--420",
journal = "American Educational Research Journal",
issn = "0002-8312",
publisher = "SAGE Publications Ltd",
number = "2",

}

2025

A scoping review of research on school-age youth activism in global citizenship education

Inguaggiato C, Yemini M, Khavenson T. A scoping review of research on school-age youth activism in global citizenship education. Prospects. 2025 Jun;55(1-2):143-164. [DOI] [Link to publication in Scopus]
 

Global citizenship education (GCE) has become a key topic in educational discourse, especially since its inclusion in the United Nations’ 2030 Agenda for Sustainable Development. This scoping literature review analyses 43 articles published between 2012 and 2023 on school-age youth activism within GCE literature. Articles were sourced from the EBSCO, ERIC, and WoS databases, using keywords related to youth, activism, and GCE. The review finds that research on GCE programmes focused on promoting forms of activism found them to be resource-intensive and predominantly based in affluent schools in the Global North. Programmes featured in the studies often emphasise social sciences and promote student activism in topics such as climate change and human rights. Activism depicted in these studies largely excludes the epistemological questioning necessary for Global North–South cooperation, being confined to specific subjects and contexts. The review calls for more research on school-age youth activism within the GCE framework and for the development of new programmes addressing activism in various contexts and in more nuanced ways.

@article{b045dbc8c157487c9787fd5a1fdfa73a,
title = "A scoping review of research on school-age youth activism in global citizenship education",
abstract = "Global citizenship education (GCE) has become a key topic in educational discourse, especially since its inclusion in the United Nations{\textquoteright} 2030 Agenda for Sustainable Development. This scoping literature review analyses 43 articles published between 2012 and 2023 on school-age youth activism within GCE literature. Articles were sourced from the EBSCO, ERIC, and WoS databases, using keywords related to youth, activism, and GCE. The review finds that research on GCE programmes focused on promoting forms of activism found them to be resource-intensive and predominantly based in affluent schools in the Global North. Programmes featured in the studies often emphasise social sciences and promote student activism in topics such as climate change and human rights. Activism depicted in these studies largely excludes the epistemological questioning necessary for Global North{\textendash}South cooperation, being confined to specific subjects and contexts. The review calls for more research on school-age youth activism within the GCE framework and for the development of new programmes addressing activism in various contexts and in more nuanced ways.",
keywords = "Activism, Global citizenship education, School-age youth, Scoping review",
author = "Carla Inguaggiato and Miri Yemini and Tatiana Khavenson",
note = "Publisher Copyright: {\textcopyright} The Author(s) 2025.",
year = "2025",
month = jun,
doi = "10.1007/s11125-025-09728-w",
language = "אנגלית",
volume = "55",
pages = "143--164",
journal = "Prospects",
issn = "0033-1538",
publisher = "Springer Science and Business Media B.V.",
number = "1-2",

}

Whose Voices Are Heard in the Scholarship on Activism Related to School-Aged Youth With Migrant Backgrounds? A Systematic Review

Khavenson T, Yemini M, Stahl G. Whose Voices Are Heard in the Scholarship on Activism Related to School-Aged Youth With Migrant Backgrounds? A Systematic Review. Review of Educational Research. 2025. [DOI] [Link to publication in Scopus]
 

This review outlines the scholarship landscape and uncovers the nature and key characteristics of activism related to migrant school-aged youth. Employing PICOT and PRISMA protocols, 126 relevant articles published in peer-reviewed journals from 2007 to 2023 were identified. We employed a three-layered, mixed-methods analytical framework to map the scholarship and to decipher the nature of agency and the voice of activism. The review revealed that migrant youth engage in diverse forms of activism, primarily driven by their anchoring to society and a desire to secure their rights. Furthermore, we found activism concerning school-aged migrants is often initiated and led by their allies (e.g., NGOs, schools) and consequently studied from the latter’s perspectives. Our findings highlight an overrepresentation of investigations focusing on issues surrounding activism rather than migrants’ lived experiences of activism. This analysis lays the groundwork for a further conceptualization of the field of migrant school-aged youth.

@article{4542a30d055a4387a9bd7014290382d1,
title = "Whose Voices Are Heard in the Scholarship on Activism Related to School-Aged Youth With Migrant Backgrounds? A Systematic Review",
abstract = "This review outlines the scholarship landscape and uncovers the nature and key characteristics of activism related to migrant school-aged youth. Employing PICOT and PRISMA protocols, 126 relevant articles published in peer-reviewed journals from 2007 to 2023 were identified. We employed a three-layered, mixed-methods analytical framework to map the scholarship and to decipher the nature of agency and the voice of activism. The review revealed that migrant youth engage in diverse forms of activism, primarily driven by their anchoring to society and a desire to secure their rights. Furthermore, we found activism concerning school-aged migrants is often initiated and led by their allies (e.g., NGOs, schools) and consequently studied from the latter{\textquoteright}s perspectives. Our findings highlight an overrepresentation of investigations focusing on issues surrounding activism rather than migrants{\textquoteright} lived experiences of activism. This analysis lays the groundwork for a further conceptualization of the field of migrant school-aged youth.",
keywords = "adolescence, civic participation gap, comparative education, forms of activism, immigration/immigrants, migrant school students, mixed methods, social justice, systematic review, textual analysis, youth activism",
author = "Tatiana Khavenson and Miri Yemini and Garth Stahl",
note = "Publisher Copyright: {\textcopyright} The Author(s) 2025. This article is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 License (https://creativecommons.org/licenses/by-nc/4.0/) which permits non-commercial use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access page (https://us.sagepub.com/en-us/nam/open-access-at-sage).",
year = "2025",
doi = "10.3102/00346543251384312",
language = "אנגלית",
journal = "Review of Educational Research",
issn = "0034-6543",
publisher = "SAGE Publications Inc.",

}

Internal quality assurance of graduate engineering programmes in Russia—perspectives of programme directors

Korchak A, Akhmedjanova D, Khavenson T. Internal quality assurance of graduate engineering programmes in Russia—perspectives of programme directors. Quality in Higher Education. 2025;31(3):380-401. [DOI] [Link to publication in Scopus]
 

This study investigates how internal quality and quality assurance are perceived and operated by Russian graduate engineering programmes directors. Based on semi-structured interviews (n = 15) and thematic analysis, four themes are revealed: the managerial role, with varying levels of directors’ proactivity; students’ intake quality, ranging from passive to proactive approaches; the managerial insight, represented by a combination of internal perceptions and different metrics and quality assurance practices, including student feedback, personal interactions and handling complaints. It was identified that quality, when matched to Harvey and Green’s (1993) conceptualisation, is viewed by directors as ‘exceptional’ across all the approaches, whereas quality as ‘fit for purpose’ is highlighted less frequently. This study contributes to discussions on quality culture and quality conceptualisations in contexts where engineering education is prioritised and heavily regulated. The findings may inform policymakers in similar contexts and guide university managers in fostering a quality culture within their institutions.

@article{29068f4fc44f4597b4a4bad05c5bf2cd,
title = "Internal quality assurance of graduate engineering programmes in Russia{\textemdash}perspectives of programme directors",
abstract = "This study investigates how internal quality and quality assurance are perceived and operated by Russian graduate engineering programmes directors. Based on semi-structured interviews (n = 15) and thematic analysis, four themes are revealed: the managerial role, with varying levels of directors{\textquoteright} proactivity; students{\textquoteright} intake quality, ranging from passive to proactive approaches; the managerial insight, represented by a combination of internal perceptions and different metrics and quality assurance practices, including student feedback, personal interactions and handling complaints. It was identified that quality, when matched to Harvey and Green{\textquoteright}s (1993) conceptualisation, is viewed by directors as {\textquoteleft}exceptional{\textquoteright} across all the approaches, whereas quality as {\textquoteleft}fit for purpose{\textquoteright} is highlighted less frequently. This study contributes to discussions on quality culture and quality conceptualisations in contexts where engineering education is prioritised and heavily regulated. The findings may inform policymakers in similar contexts and guide university managers in fostering a quality culture within their institutions.",
keywords = "Engineering education, graduate education, internal quality assurance, quality conceptualisation, quality culture",
author = "Anna Korchak and Diana Akhmedjanova and Tatiana Khavenson",
note = "Publisher Copyright: {\textcopyright} 2025 Informa UK Limited, trading as Taylor \& Francis Group.",
year = "2025",
doi = "10.1080/13538322.2025.2572886",
language = "אנגלית",
volume = "31",
pages = "380--401",
journal = "Quality in Higher Education",
issn = "1353-8322",
publisher = "Routledge",
number = "3",

}

2024

How to Measure Adaptive and Innovative Cognitive Styles: Adaptation of the M. Kirton Questionnaire for Education

Andreeva A, Sternik O, Khavenson T. How to Measure Adaptive and Innovative Cognitive Styles: Adaptation of the M. Kirton Questionnaire for Education. Voprosy Obrazovaniya / Educational Studies Moscow. 2024;(2):8-41. [DOI] [Link to publication in Scopus]
 

As the research focus shifts from the technical to the human side of education, the relevance of measuring sociopsychological traits is growing. Despite proven validity and demand for the Kirton AdaptionInnovation Inventory, or KAI, in international and Russian studies, the scale has not previously been adapted for the Russianspeaking audience. The article describes the results of scale adaptation aimed at estimating the cognitive style of Russian teachers and school administrators. The proposed version of the translation considers the specifics of the Russian language and the context of the educational sphere, simultaneously being equivalent in meaning to the original scale. The readability check indicated that the question wordings fit the education level of the target audience. An iterative process of development and empirical testing of the psychometric properties (N1 = 137, N2 = 1236, N3 = 204) led to satisfactory scores for the three scales, items, and response categories. The analysis relies on the classical test theory and the IRTRSM model. The final questionnaire includes 26 items and allows us to evaluate the three factors: “Originality and independence”, “Thoroughness and selforganization”, and “Inertia and request for instructions”. Besides, the article demonstrates that the adapted version of the questionnaire does not show increased social desirability. The proposed tool is potentially useful for research and practical purposes to study the cognitive styles of teachers and school administrators, as well as groups close to them, including workers at other levels of education and the social sphere in general. The article provides a full version of the final methodology and practical recommendations for managing innovators and adaptors within an educational organization.

@article{74da9380b0c2450d85e1b94056589cd0,
title = "How to Measure Adaptive and Innovative Cognitive Styles: Adaptation of the M. Kirton Questionnaire for Education",
abstract = "As the research focus shifts from the technical to the human side of education, the relevance of measuring sociopsychological traits is growing. Despite proven validity and demand for the Kirton AdaptionInnovation Inventory, or KAI, in international and Russian studies, the scale has not previously been adapted for the Russianspeaking audience. The article describes the results of scale adaptation aimed at estimating the cognitive style of Russian teachers and school administrators. The proposed version of the translation considers the specifics of the Russian language and the context of the educational sphere, simultaneously being equivalent in meaning to the original scale. The readability check indicated that the question wordings fit the education level of the target audience. An iterative process of development and empirical testing of the psychometric properties (N1 = 137, N2 = 1236, N3 = 204) led to satisfactory scores for the three scales, items, and response categories. The analysis relies on the classical test theory and the IRTRSM model. The final questionnaire includes 26 items and allows us to evaluate the three factors: {\textquotedblleft}Originality and independence{\textquotedblright}, {\textquotedblleft}Thoroughness and selforganization{\textquotedblright}, and {\textquotedblleft}Inertia and request for instructions{\textquotedblright}. Besides, the article demonstrates that the adapted version of the questionnaire does not show increased social desirability. The proposed tool is potentially useful for research and practical purposes to study the cognitive styles of teachers and school administrators, as well as groups close to them, including workers at other levels of education and the social sphere in general. The article provides a full version of the final methodology and practical recommendations for managing innovators and adaptors within an educational organization.",
keywords = "KAI, Kirton{\textquoteright}s Adaptation-Innovation Inventory, Russian language version, adaptors, cognitive style, innovators, psychometric assessment, scale adaptation, school staff, teachers, Ключевые слова когнитивный стиль, адаптация опросника, адапторы, инноваторы, психометрическая проверка, русскоязычная версия, сотрудники образовательных организаций, учителя",
author = "Anastasia Andreeva and Olga Sternik and Tatiana Khavenson",
note = "Publisher Copyright: {\textcopyright} (2024), (Voprosy Obrazovaniya / Educational Studies Moscow). All rights reserved.",
year = "2024",
doi = "10.17323/vo-2024-16820",
language = "אנגלית",
pages = "8--41",
journal = "Voprosy Obrazovaniya / Educational Studies Moscow",
issn = "1814-9545",
publisher = "National Research University, Higher School of Econoimics",
number = "2",

}

2023

What We Can Learn About Latin American Educational Systems from International Tests: A Brief Foray / ‪Qué podemos aprender sobre los sistemas educativos latinoamericanos a partir de las pruebas internacionales. Una breve incursión‬

Carnoy M, Khavenson T. What We Can Learn About Latin American Educational Systems from International Tests: A Brief Foray / ‪Qué podemos aprender sobre los sistemas educativos latinoamericanos a partir de las pruebas internacionales. Una breve incursión‬. Revista Latinoamericana de Estudios Educativos. 2023;(53(Especial)):13-50. [DOI]
 
‪The article points out that more than 50 years ago there were already concerns about educational quality, but there were almost no databases to compare national systems and the analytical tools available were not very powerful. Analyzes the scores obtained in the PISA 20002018 tests by students from Argentina, Brazil, Chile, Mexico, Peru and Uruguay, adjusting them to discount the influence of family resources, the average social class of the school and the grade in which they are enrolled. The adjusted results are different from raw scores, to the extent that students from Mexico, Uruguay, and perhaps Brazil perform better than those from Chile. In some countries, especially Peru and Uruguay, there were significant improvements, but much of it was due to an increase in social class and the average school grade reached by young people, rather than to improvements in learning. Other analyzes compare the results of the federal states of Mexico, showing that there were important differences, since in some the students achieved significant gains, but in a few the scores dropped. Differences in the relationship between the state authority and the union are pointed out as a possible explanation.
@article{f53711932bc4403a8d65b3f6d7aaea84,
title = "What We Can Learn About Latin American Educational Systems from International Tests: A Brief Foray / ‪Qu{\'e} podemos aprender sobre los sistemas educativos latinoamericanos a partir de las pruebas internacionales. Una breve incursi{\'o}n‬",
abstract = "‪The article points out that more than 50 years ago there were already concerns about educational quality, but there were almost no databases to compare national systems and the analytical tools available were not very powerful. Analyzes the scores obtained in the PISA 20002018 tests by students from Argentina, Brazil, Chile, Mexico, Peru and Uruguay, adjusting them to discount the influence of family resources, the average social class of the school and the grade in which they are enrolled. The adjusted results are different from raw scores, to the extent that students from Mexico, Uruguay, and perhaps Brazil perform better than those from Chile. In some countries, especially Peru and Uruguay, there were significant improvements, but much of it was due to an increase in social class and the average school grade reached by young people, rather than to improvements in learning. Other analyzes compare the results of the federal states of Mexico, showing that there were important differences, since in some the students achieved significant gains, but in a few the scores dropped. Differences in the relationship between the state authority and the union are pointed out as a possible explanation.",
keywords = "Educational inequality, LSA, LSA. PISA, my",
author = "Martin Carnoy and Tatiana Khavenson",
year = "2023",
doi = "10.48102/rlee.2023.53.Especial.595",
language = "American English",
pages = "13--50",
journal = "Revista Latinoamericana de Estudios Educativos",
number = "53(Especial)",

}

2022

A time to gather stones – barriers to use technologies before the COVID-19 school closures

Kapuza A, Kolygina D, Khavenson T, Koroleva D. A time to gather stones – barriers to use technologies before the COVID-19 school closures. International Journal of Educational Management. 2022 Aug 9;36(6):923-936. [DOI] [Link to publication in Scopus]
 

Purpose: The study examines how teachers and school administrative staff perceive external and internal barriers to the implementation of technologies into the teaching process and how teachers and school administrative staff technology readiness is related to these perceptions. These data were used for discussion and construction of an explanatory model. Design/methodology/approach: The data from 8,188 Russian respondents who took the survey just before the first massive lockdown announcement due to coronavirus disease 2019 (COVID 19) was used. First, descriptive statistics were shown for two groups: teachers and administrative staff. Second, confirmatory factor analysis was applied to construct external and internal barriers scales. These scales were then used as dependent in a series of regressions with the technology readiness index (TRI) and the respondent role in schools as independent variables. Findings: Results showed that administrative staff compared to teachers were more likely to select internal barriers related to teachers, while teachers were more likely to choose external obstacles. The technology optimism scale was negative, and negative attitudes toward technologies were positively related to both barriers. Originality/value: The originality of the study lies in determining the relationship between the technology readiness and choosing barriers perception as well as comparing the sense of responsibility for the introduction of technologies in schools experienced by teachers and administrators.

@article{091c0840c8f2407d975d15dd5f5af46b,
title = "A time to gather stones {\textendash} barriers to use technologies before the COVID-19 school closures",
abstract = "Purpose: The study examines how teachers and school administrative staff perceive external and internal barriers to the implementation of technologies into the teaching process and how teachers and school administrative staff technology readiness is related to these perceptions. These data were used for discussion and construction of an explanatory model. Design/methodology/approach: The data from 8,188 Russian respondents who took the survey just before the first massive lockdown announcement due to coronavirus disease 2019 (COVID 19) was used. First, descriptive statistics were shown for two groups: teachers and administrative staff. Second, confirmatory factor analysis was applied to construct external and internal barriers scales. These scales were then used as dependent in a series of regressions with the technology readiness index (TRI) and the respondent role in schools as independent variables. Findings: Results showed that administrative staff compared to teachers were more likely to select internal barriers related to teachers, while teachers were more likely to choose external obstacles. The technology optimism scale was negative, and negative attitudes toward technologies were positively related to both barriers. Originality/value: The originality of the study lies in determining the relationship between the technology readiness and choosing barriers perception as well as comparing the sense of responsibility for the introduction of technologies in schools experienced by teachers and administrators.",
keywords = "Barriers for the implementation of technologies, CFA, COVID -19, Digital transformation, Emergency remote teaching, Lockdown, Pandemia, Technology readiness index, TRI",
author = "Anastasiia Kapuza and Daria Kolygina and Tatiana Khavenson and Diana Koroleva",
note = "Publisher Copyright: {\textcopyright} 2022, Emerald Publishing Limited.",
year = "2022",
month = aug,
day = "9",
doi = "10.1108/IJEM-02-2022-0069",
language = "אנגלית",
volume = "36",
pages = "923--936",
journal = "International Journal of Educational Management",
issn = "0951-354X",
publisher = "Emerald Publishing",
number = "6",

}

Erratum: Raising the Stakes: Inequality and Testing in the Russian Education System (Social Forces (2020) 98:4 (1613–1635) DOI: 10.1093/sf/soz113)

Jackson M, Khavenson T, Chirkina T. Erratum: Raising the Stakes: Inequality and Testing in the Russian Education System (Social Forces (2020) 98:4 (1613–1635) DOI: 10.1093/sf/soz113). Social Forces. 2022 Jun 1;100(4):1935. [DOI] [Link to publication in Scopus]
 

Upon initial publication this article's publication date was incorrectly listed as 05 September. The actual publication date was 15 October. The publisher regrets this error.

@article{3e5339653a584172a00b5fd925de4c49,
title = "Erratum: Raising the Stakes: Inequality and Testing in the Russian Education System (Social Forces (2020) 98:4 (1613–1635) DOI: 10.1093/sf/soz113)",
abstract = "Upon initial publication this article's publication date was incorrectly listed as 05 September. The actual publication date was 15 October. The publisher regrets this error.",
author = "Michelle Jackson and Tatiana Khavenson and Tatiana Chirkina",
note = "Publisher Copyright: {\textcopyright} 2020 The Author(s). Published by Oxford University Press on behalf of the University of North Carolina at Chapel Hill. All rights reserved.",
year = "2022",
month = jun,
day = "1",
doi = "10.1093/sf/soz152",
language = "אנגלית",
volume = "100",
pages = "1935",
journal = "Social Forces",
issn = "0037-7732",
publisher = "Oxford University Press",
number = "4",

}

2021

Мотивы инноваторов в образовании: Подходы к определению и разработка шкалы для измерения

Translated title of the contribution: Measuring Motivation for Innovation in Education: Concept Definition and Scale Validation
Khavenson TE, Lukina AA. Мотивы инноваторов в образовании: Подходы к определению и разработка шкалы для измерения. Psychology, Journal of the Higher School of Economics. 2021;18(1):92-108. [DOI] [Link to publication in Scopus]
 

The reasons for innovations inside and outside the education system have attracted much research interest over the past decades. However, there is still a lack of methodological tools to measure motives of actors coming from inside and outside the system to launch their innovative projects. The article describes approaches to measure the construct “motivation for innovative activity,” as well as the results of adaptation of the scale aimed at measuring motives for creation of innovative educational projects. The tool is based on the scale, constructed in English, “Reasons to create business projects” (PSED). In this research the scale was translated into Russian, adapted for the group of innovators in education and validated within a classical framework of combining exploratory and confirmatory factor analysis (EFA and CFA, respectively). Additionally, the subscales were evaluated in terms of internal coherence. The Russian and the English version of the scale were compared, and each subscale was interpreted. Adaptation was performed on the sample of innovators in education, that is, the participants of Competition of Innovations in Education (N = 286). The final scale includes 16 statements and allows to evaluate the intensity of four motivational attitudes towards innovative activity: “Social significance,” “Innovations and creativity,” “Self-realization and achievement,” “Finance and autonomy.” The identified motives reflect certain endeavors and goals of innovators and determine the content and orientation of their educational projects. The instrument can be used for both research and practice purposes to explore motivation of proactive actors in education, as well as similar groups involved in the development of public social spheres. The full version of the scale is presented in the appendix and contains the instructions for respondents and scoring criteria for four subscales.

@article{7a0c805fb756482e8bc94a8e5f8e1f87,
title = "Мотивы инноваторов в образовании: Подходы к определению и разработка шкалы для измерения",
abstract = "The reasons for innovations inside and outside the education system have attracted much research interest over the past decades. However, there is still a lack of methodological tools to measure motives of actors coming from inside and outside the system to launch their innovative projects. The article describes approaches to measure the construct “motivation for innovative activity,” as well as the results of adaptation of the scale aimed at measuring motives for creation of innovative educational projects. The tool is based on the scale, constructed in English, “Reasons to create business projects” (PSED). In this research the scale was translated into Russian, adapted for the group of innovators in education and validated within a classical framework of combining exploratory and confirmatory factor analysis (EFA and CFA, respectively). Additionally, the subscales were evaluated in terms of internal coherence. The Russian and the English version of the scale were compared, and each subscale was interpreted. Adaptation was performed on the sample of innovators in education, that is, the participants of Competition of Innovations in Education (N = 286). The final scale includes 16 statements and allows to evaluate the intensity of four motivational attitudes towards innovative activity: “Social significance,” “Innovations and creativity,” “Self-realization and achievement,” “Finance and autonomy.” The identified motives reflect certain endeavors and goals of innovators and determine the content and orientation of their educational projects. The instrument can be used for both research and practice purposes to explore motivation of proactive actors in education, as well as similar groups involved in the development of public social spheres. The full version of the scale is presented in the appendix and contains the instructions for respondents and scoring criteria for four subscales.",
keywords = "Measuring motives of innovative activity, Motivation towards innovations, PSED, Scale adaptation",
author = "Khavenson, \{T. E.\} and Lukina, \{Anastasia A.\}",
note = "Publisher Copyright: {\textcopyright} 2021 National Research University Higher School of Economics. All rights reserved.",
year = "2021",
doi = "10.17323/1813-8918-2021-1-92-108",
language = "רוסית",
volume = "18",
pages = "92--108",
journal = "Psychology, Journal of the Higher School of Economics",
issn = "1813-8918",
publisher = "National Research University, Higher School of Econoimics",
number = "1",

}

2020

Factors of student resilience obtained from timss and pisa longitudinal studies

Chirkina T, Khavenson T, Pinskaya M, Zvyagintsev R. Factors of student resilience obtained from timss and pisa longitudinal studies. Issues in Educational Research. 2020;30(4):1245-1263. [Link to publication in Scopus]
 

It is well established that family socio-economic status (SES) is strongly related to academic performance. Nonetheless, there is a group of children with high levels of academic achievement who come from disadvantaged family backgrounds. These children possess what is called ‘academic resilience’. In our study, we want to see whether the two largest international comparative studies are consistent in terms of identifying resilient students and whether the factors of academic resilience are common for the two studies. We use data from a Russian longitudinal study Trajectories in Education and Careers (TrEC), in which students' achievement was measured with both the Trends in International Mathematics and Science Study (TIMSS, 8th grade) and, a year later, the Programme for International Student Assessment (PISA). Our study focuses on the relationship between individual and school-related factors of resilience and whether these factors are specific to a particular educational outcome (TIMSS or PISA), or are of a more universal nature. We show that attitudes towards mathematics and test scores in general are positively related to the probability of becoming a resilient student. We also find that school related variables (such as average school SES and school type) are more significant for TIMSS than for PISA results. Our study shows that there are students who are both TIMSS and PISA resilient.

@article{cebe36aaa3a84e5fa644ccb42ebc4246,
title = "Factors of student resilience obtained from timss and pisa longitudinal studies",
abstract = "It is well established that family socio-economic status (SES) is strongly related to academic performance. Nonetheless, there is a group of children with high levels of academic achievement who come from disadvantaged family backgrounds. These children possess what is called {\textquoteleft}academic resilience{\textquoteright}. In our study, we want to see whether the two largest international comparative studies are consistent in terms of identifying resilient students and whether the factors of academic resilience are common for the two studies. We use data from a Russian longitudinal study Trajectories in Education and Careers (TrEC), in which students' achievement was measured with both the Trends in International Mathematics and Science Study (TIMSS, 8th grade) and, a year later, the Programme for International Student Assessment (PISA). Our study focuses on the relationship between individual and school-related factors of resilience and whether these factors are specific to a particular educational outcome (TIMSS or PISA), or are of a more universal nature. We show that attitudes towards mathematics and test scores in general are positively related to the probability of becoming a resilient student. We also find that school related variables (such as average school SES and school type) are more significant for TIMSS than for PISA results. Our study shows that there are students who are both TIMSS and PISA resilient.",
author = "Tatiana Chirkina and Tatiana Khavenson and Marina Pinskaya and Roman Zvyagintsev",
note = "Publisher Copyright: {\textcopyright} 2020, Western Australian Institute for Educational Research Inc.. All rights reserved.",
year = "2020",
language = "אנגלית",
volume = "30",
pages = "1245--1263",
journal = "Issues in Educational Research",
issn = "0313-7155",
publisher = "Western Australian Institute for Educational Research Inc.",
number = "4",

}

Raising the stakes: Inequality and testing in the russian education system

Jackson M, Khavenson T, Chirkina T. Raising the stakes: Inequality and testing in the russian education system. Social Forces. 2020;98(4):1751-1773. [DOI] [Link to publication in Scopus]
 

Sociologists have argued that high-stakes tests open the door to high levels of educational inequality at transition points: In a high-stakes testing regime, parents and students are able to focus all energy and resources on test preparation, thus enhancing pre-existing inequalities in academic performance. But arguments about a special role for high-stakes tests are often prosecuted without explicit comparisons to other types of tests and assessments, usually because information on other tests is not available. In this article, we analyze a unique dataset on a contemporary cohort of Russian students, forwhom we have PISA and TIMSS scores, low-stakes test scores, and high-stakes test scores.We compare the role each test plays in mediating socioeconomic background inequalities at the important transitions in the Russian educational system: The transition to upper secondary education and the transition to university. We find evidence in favor of a special role for the high-stakes test at the transition to university, but we also find evidence that gives cause to question the standard assumption that high-stakes tests should be a primary focus for those concerned about inequality of educational opportunity.

@article{540cc6ae3aee42d9b302a1dec9ce0fd1,
title = "Raising the stakes: Inequality and testing in the russian education system",
abstract = "Sociologists have argued that high-stakes tests open the door to high levels of educational inequality at transition points: In a high-stakes testing regime, parents and students are able to focus all energy and resources on test preparation, thus enhancing pre-existing inequalities in academic performance. But arguments about a special role for high-stakes tests are often prosecuted without explicit comparisons to other types of tests and assessments, usually because information on other tests is not available. In this article, we analyze a unique dataset on a contemporary cohort of Russian students, forwhom we have PISA and TIMSS scores, low-stakes test scores, and high-stakes test scores.We compare the role each test plays in mediating socioeconomic background inequalities at the important transitions in the Russian educational system: The transition to upper secondary education and the transition to university. We find evidence in favor of a special role for the high-stakes test at the transition to university, but we also find evidence that gives cause to question the standard assumption that high-stakes tests should be a primary focus for those concerned about inequality of educational opportunity.",
author = "Michelle Jackson and Tatiana Khavenson and Tatiana Chirkina",
note = "Publisher Copyright: {\textcopyright} 2020 Oxford University Press. All rights reserved.",
year = "2020",
doi = "10.1093/SF/SOZ113",
language = "אנגלית",
volume = "98",
pages = "1751--1773",
journal = "Social Forces",
issn = "0037-7732",
publisher = "Oxford University Press",
number = "4",

}

Образование и социально-профессиональный статус: сглаживание неравенства среди мужчин и женщин в России

Translated title of the contribution: Higher Educaton and Socio-Professional Status: Mitigation of Gender Inequalities in Russia?
Кармаева НН, Хавенсон ТЕ, Илиева-Тричкова П. Образование и социально-профессиональный статус: сглаживание неравенства среди мужчин и женщин в России. Sotsiologicheskie issledovaniia. 2020;(3):108-120. [DOI]
 
As the situation in education and labour market is changing in Russia, characterized by the expansion of services sectors and high participation in higher education, the mechanisms of social inequality reproduction are evolving. According to the intersectionality theory, social advantages and disadvantages are reproduced at the intersection of various social categories – social class, gender and others. In the paper, the outcomes of individuals in education and in the labour market representing three cohorts, born in 1954–1964, 1965–1975 and 1976–1986, were analyzed. Using the data provided by the European Social Survey, rounds 3–6 and 8, the hypotheses about the presence of cumulative effect from the intersection of gender and social class were tested. The results partially confirm the formulated hypotheses in case of achieved socio-professional status, but not in case of achieved higher education. 1) Women have more chances than men to obtain higher education; 2) women from families where fathers were workers have more chances than men from such families to move to the group “lower services class”. The latter positive effect is observed in case social class is specified based on mother’s profession, however, it is not significant. Therefore, women are likely to benefit the most from the recent changes in education and the labour market, compared to men. However, women are likely to find themselves in the less prestigious and less paid segments of the services sector, despite the fact that their jobs require more skills.
@article{735a571c54dd4841ac542c72c7f18e9d,
title = "Образование и социально-профессиональный статус: сглаживание неравенства среди мужчин и женщин в России",
abstract = "As the situation in education and labour market is changing in Russia, characterized by the expansion of services sectors and high participation in higher education, the mechanisms of social inequality reproduction are evolving. According to the intersectionality theory, social advantages and disadvantages are reproduced at the intersection of various social categories – social class, gender and others. In the paper, the outcomes of individuals in education and in the labour market representing three cohorts, born in 1954–1964, 1965–1975 and 1976–1986, were analyzed. Using the data provided by the European Social Survey, rounds 3–6 and 8, the hypotheses about the presence of cumulative effect from the intersection of gender and social class were tested. The results partially confirm the formulated hypotheses in case of achieved socio-professional status, but not in case of achieved higher education. 1) Women have more chances than men to obtain higher education; 2) women from families where fathers were workers have more chances than men from such families to move to the group “lower services class”. The latter positive effect is observed in case social class is specified based on mother{\textquoteright}s profession, however, it is not significant. Therefore, women are likely to benefit the most from the recent changes in education and the labour market, compared to men. However, women are likely to find themselves in the less prestigious and less paid segments of the services sector, despite the fact that their jobs require more skills.",
keywords = "Educational inequality, Trajectories. Generations, my, Russia",
author = "Кармаева, {Наталья Николаевна} and Хавенсон, {Татьяна Евгеньевна} and Петя Илиева-Тричкова",
year = "2020",
doi = "10.31857/S013216250008811-5",
language = "רוסית",
pages = "108--120",
journal = "Sotsiologicheskie issledovaniia",
issn = "0132-1625",
publisher = "Russian Academy of Sciences",
number = "3",

}

2019

Do students make greater achievement gains in some higher education institutions’ programs than others? Insights from Brazil

Dalmon DL, Fonseca I, Avena CP, Carnoy M, Khavenson T. Do students make greater achievement gains in some higher education institutions’ programs than others? Insights from Brazil. Higher Education. 2019 Nov 1;78(5):887-910. [DOI] [Link to publication in Scopus]
 

How much university students learn in their studies is highly debated and important to understanding the value of higher education. Yet, information on learning gains at this level are scarce. Our paper contributes to the debate by using unique data for Brazil to estimate absolute test score gains across various fields of study in higher education and to assess whether students who attend certain categories of programs (public/private, research/non-research, highly selective/less selective) make greater relative gains than in others. Our results suggest that students in STEM fields tend to have higher absolute achievement gains compared to students in humanities and pedagogical programs, and that in a few fields, such as civil engineering and history, the relative gains for students in highly selective programs in that field of study are significantly higher than if they had attended somewhat less selective programs. However, students attending lowest quintile selective programs in a field of study have consistently lower gains across a range of study fields than similar students attending programs just one quintile higher. The results have important implications for the equity effects of higher education.

@article{d4d5ee0ed5384f4ab12025e22d567b2c,
title = "Do students make greater achievement gains in some higher education institutions{\textquoteright} programs than others? Insights from Brazil",
abstract = "How much university students learn in their studies is highly debated and important to understanding the value of higher education. Yet, information on learning gains at this level are scarce. Our paper contributes to the debate by using unique data for Brazil to estimate absolute test score gains across various fields of study in higher education and to assess whether students who attend certain categories of programs (public/private, research/non-research, highly selective/less selective) make greater relative gains than in others. Our results suggest that students in STEM fields tend to have higher absolute achievement gains compared to students in humanities and pedagogical programs, and that in a few fields, such as civil engineering and history, the relative gains for students in highly selective programs in that field of study are significantly higher than if they had attended somewhat less selective programs. However, students attending lowest quintile selective programs in a field of study have consistently lower gains across a range of study fields than similar students attending programs just one quintile higher. The results have important implications for the equity effects of higher education.",
keywords = "Achievement gains, Higher education accountability, Institutional selectivity, Propensity score matching",
author = "Dalmon, \{Danilo Leite\} and Izabel Fonseca and Avena, \{Cl{\'a}udio Pond{\'e}\} and Martin Carnoy and Tatiana Khavenson",
note = "Publisher Copyright: {\textcopyright} 2019, Springer Nature B.V.",
year = "2019",
month = nov,
day = "1",
doi = "10.1007/s10734-019-00376-6",
language = "אנגלית",
volume = "78",
pages = "887--910",
journal = "Higher Education",
issn = "0018-1560",
publisher = "Springer Netherlands",
number = "5",

}

Do human and cultural capital lenses contribute to our understanding of academic success in Russia

Bodovski K, Chykina V, Khavenson T. Do human and cultural capital lenses contribute to our understanding of academic success in Russia. British Journal of Sociology of Education. 2019 Apr 3;40(3):393-409. [DOI] [Link to publication in Scopus]
 

Using newly available data from the Trajectories in Education and Careers Study, the first longitudinal study on a representative sample of high school students in Russia, we examined the importance of investments in human and cultural capital on students’ mathematics and reading standardized examinations, as well as on the likelihood of matriculation into a selective institution of higher education. Studying mathematics and the Russian language on one’s own for more than a year was positively and significantly associated with standardized scores and with an increased likelihood of matriculating into a selective university. A higher number of books at home was also associated with an increased likelihood of matriculating into a selective university. The findings are discussed within the particular institutional context of the Russian educational system.

@article{3887db83919f42bf969e3144934d2189,
title = "Do human and cultural capital lenses contribute to our understanding of academic success in Russia",
abstract = "Using newly available data from the Trajectories in Education and Careers Study, the first longitudinal study on a representative sample of high school students in Russia, we examined the importance of investments in human and cultural capital on students{\textquoteright} mathematics and reading standardized examinations, as well as on the likelihood of matriculation into a selective institution of higher education. Studying mathematics and the Russian language on one{\textquoteright}s own for more than a year was positively and significantly associated with standardized scores and with an increased likelihood of matriculating into a selective university. A higher number of books at home was also associated with an increased likelihood of matriculating into a selective university. The findings are discussed within the particular institutional context of the Russian educational system.",
keywords = "academic achievement, cultural capital, Human capital, Russia",
author = "Katerina Bodovski and Volha Chykina and Tatiana Khavenson",
note = "Publisher Copyright: {\textcopyright} 2019, {\textcopyright} 2019 Informa UK Limited, trading as Taylor \& Francis Group.",
year = "2019",
month = apr,
day = "3",
doi = "10.1080/01425692.2018.1552844",
language = "אנגלית",
volume = "40",
pages = "393--409",
journal = "British Journal of Sociology of Education",
issn = "0142-5692",
publisher = "Taylor and Francis Ltd.",
number = "3",

}

Образовательный выбор учащихся после 9-го и 11-го классов: сравнение первичных и вторичных эффектов социально-экономического положения семьи

Translated title of the contribution: Student educational choice after the 9th and 11th grades: Comparing the primary and secondary effects of family socioeconomic status
Khavenson T, Chirkina T. Образовательный выбор учащихся после 9-го и 11-го классов: сравнение первичных и вторичных эффектов социально-экономического положения семьи. Zhurnal Issledovanii Sotsial'noi Politiki. 2019;17(4):539-554. [DOI] [Link to publication in Scopus]
 

In this paper, we study the relationship between family characteristics and the choice of educational trajectory in high school. We explore two aspects of educational choice: whether to pursue academic or vocational education after grade 9 (middle to high school transition); and choices made after grade 11 (postsecondary) including preferences in selecting universities. In accordance with Budon’s theory on education and inequality, we explore the primary and secondary effects of a family’s socioeconomic status (SES). The primary effects are revealed in the higher educational performance of families with higher SES. Secondary effects are expressed in longer periods in educational pathways for students with a higher SES. The paper is based on the data from a longitudinal project entitled ‘Trajectories in Education and Careers’. It was launched in 2011, when respondents studied in the 8th grade, and continues to the current day. The dataset provides variables on a wide range of achievement, family’s SES and other important information proxies. For achievement TIMSS mathematics and USE in Russian language were used. The results showed that the primary effects reduce in salience from the 9th to the 11th grades, while, in the same period, secondary effects increase. Even high-achieving students from families with a low level of cultural, educational, and social capital chose less ambitious education strategies. Conversely, students from families with high SES, but low academic achievements, tend to chose in favour of higher education. On the basis of these results, we draw some conclusions on the degree of accessibility during transition into the high school and higher education, as well as the probable causes of inequality.

@article{5e4dcde2fbfe4e518a544b5a1e7f22a4,
title = "Образовательный выбор учащихся после 9-го и 11-го классов: сравнение первичных и вторичных эффектов социально-экономического положения семьи",
abstract = "In this paper, we study the relationship between family characteristics and the choice of educational trajectory in high school. We explore two aspects of educational choice: whether to pursue academic or vocational education after grade 9 (middle to high school transition); and choices made after grade 11 (postsecondary) including preferences in selecting universities. In accordance with Budon{\textquoteright}s theory on education and inequality, we explore the primary and secondary effects of a family{\textquoteright}s socioeconomic status (SES). The primary effects are revealed in the higher educational performance of families with higher SES. Secondary effects are expressed in longer periods in educational pathways for students with a higher SES. The paper is based on the data from a longitudinal project entitled {\textquoteleft}Trajectories in Education and Careers{\textquoteright}. It was launched in 2011, when respondents studied in the 8th grade, and continues to the current day. The dataset provides variables on a wide range of achievement, family{\textquoteright}s SES and other important information proxies. For achievement TIMSS mathematics and USE in Russian language were used. The results showed that the primary effects reduce in salience from the 9th to the 11th grades, while, in the same period, secondary effects increase. Even high-achieving students from families with a low level of cultural, educational, and social capital chose less ambitious education strategies. Conversely, students from families with high SES, but low academic achievements, tend to chose in favour of higher education. On the basis of these results, we draw some conclusions on the degree of accessibility during transition into the high school and higher education, as well as the probable causes of inequality.",
keywords = "Boudon, Education, Educational choice, Inequality, Key word: socio-economic status of family",
author = "Tatiana Khavenson and Tatiana Chirkina",
note = "Publisher Copyright: {\textcopyright} 2019 National Research University Higher School of Economics. All rights reserved.",
year = "2019",
doi = "10.17323/727-0634-2019-17-4-539-554",
language = "רוסית",
volume = "17",
pages = "539--554",
journal = "Zhurnal Issledovanii Sotsial'noi Politiki",
issn = "1727-0634",
publisher = "National Research University, Higher School of Econoimics",
number = "4",

}

2018

Effectively maintained inequality the choice of postsecondary educational trajectory in Russia

Khavenson T, Chirkina T. Effectively maintained inequality the choice of postsecondary educational trajectory in Russia. Ekonomicheskaya Sotsiologiya. 2018 Nov;19(5):66-89. [DOI] [Link to publication in Scopus]
 

Because of a number of social and demographic changes in recent years, the amount of available places at the level of higher education has significantly increased, and at the same time, the number of applicants for them has decreased. Theoretically, this could lead to an increase in the equality of access to higher education for different social classes. In the paper, using Russian data for the first time, the theory of effectively maintained inequality is tested. According to this theory, the increase in the number of places at a specific level of education may not lead to a decrease in socioeconomic inequality on this level. This is because inequality will be maintained at the level due to the qualitative difference in the received education. Using data from the longitudinal project, “Trajectories in Education and Profession,” two postsecondary educational choices are examined: (1) the choice between vocational and higher education and (2) the choice between going to a selective or non-selective university. Following R. Boudon's theory, the effect of the family's socio-economic background on the choice of an educational trajectory is estimated directly and indirectly (through academic achievement). The results show that after finishing school, the direct effect of the socio-economic background is more important for moving to a more academic trajectory than the family's efforts to improve academic performance. Even with high educational achievements, students from families with low social status make a choice in favor of vocational education rather than a university. When choosing between selective and non-selective higher education institutions, the impact of the family through academic achievement weakens even more. The characteristics of the family directly affect the choice of the trajectory becoming a key predictor.

@article{f440b479207b4746b2018c3616e6f677,
title = "Effectively maintained inequality the choice of postsecondary educational trajectory in Russia",
abstract = "Because of a number of social and demographic changes in recent years, the amount of available places at the level of higher education has significantly increased, and at the same time, the number of applicants for them has decreased. Theoretically, this could lead to an increase in the equality of access to higher education for different social classes. In the paper, using Russian data for the first time, the theory of effectively maintained inequality is tested. According to this theory, the increase in the number of places at a specific level of education may not lead to a decrease in socioeconomic inequality on this level. This is because inequality will be maintained at the level due to the qualitative difference in the received education. Using data from the longitudinal project, {\textquotedblleft}Trajectories in Education and Profession,{\textquotedblright} two postsecondary educational choices are examined: (1) the choice between vocational and higher education and (2) the choice between going to a selective or non-selective university. Following R. Boudon's theory, the effect of the family's socio-economic background on the choice of an educational trajectory is estimated directly and indirectly (through academic achievement). The results show that after finishing school, the direct effect of the socio-economic background is more important for moving to a more academic trajectory than the family's efforts to improve academic performance. Even with high educational achievements, students from families with low social status make a choice in favor of vocational education rather than a university. When choosing between selective and non-selective higher education institutions, the impact of the family through academic achievement weakens even more. The characteristics of the family directly affect the choice of the trajectory becoming a key predictor.",
keywords = "Choice of educational trajectory, Education system differentiation, Effectively maintained inequality, Primary and secondary effects, R. Boudon, Socio-economic inequality",
author = "Tatiana Khavenson and Tatiana Chirkina",
note = "Publisher Copyright: {\textcopyright} 2018 National Research University Higher School of Economics. All rights reserved.",
year = "2018",
month = nov,
doi = "10.17323/1726-3247-2018-5-66-89",
language = "אנגלית",
volume = "19",
pages = "66--89",
journal = "Ekonomicheskaya Sotsiologiya",
issn = "1726-3247",
publisher = "National Research University, Higher School of Econoimics",
number = "5",

}

The Quality of the Responses of Schoolchildren to Questions Concerning Family Socioeconomic Status

Khavenson TE. The Quality of the Responses of Schoolchildren to Questions Concerning Family Socioeconomic Status. Russian Education and Society. 2018 Jul 3;60(7):555-573. [DOI] [Link to publication in Scopus]
 

The article investigates the quality of the answers given by school-age children in survey questionnaires. We present the results of a systematic review of studies dedicated to the socioeconomic status of the family. By answer quality, we mean the ability of children to correctly indicate the educational attainment and profession of their parents and the number of skipped questions. The article focuses on assessing school students’ responses about the level of education, profession, or form of employment of parents. We investigate the role that is played by the following traits of respondents: age, academic performance, and family composition. The review is based on 16 studies that were conducted between 1990 and 2015. The obtained results allow us to conclude that high school students are generally aware of the level of education and profession of their parents. Respondents’ answers can essentially be used as a basic source of information. At the same time, we must be careful about how we methodologically process the judgments of schoolchildren.

@article{f310d51365a34f2e94a1aa8f49807f4e,
title = "The Quality of the Responses of Schoolchildren to Questions Concerning Family Socioeconomic Status",
abstract = "The article investigates the quality of the answers given by school-age children in survey questionnaires. We present the results of a systematic review of studies dedicated to the socioeconomic status of the family. By answer quality, we mean the ability of children to correctly indicate the educational attainment and profession of their parents and the number of skipped questions. The article focuses on assessing school students{\textquoteright} responses about the level of education, profession, or form of employment of parents. We investigate the role that is played by the following traits of respondents: age, academic performance, and family composition. The review is based on 16 studies that were conducted between 1990 and 2015. The obtained results allow us to conclude that high school students are generally aware of the level of education and profession of their parents. Respondents{\textquoteright} answers can essentially be used as a basic source of information. At the same time, we must be careful about how we methodologically process the judgments of schoolchildren.",
author = "Khavenson, \{T. E.\}",
note = "Publisher Copyright: {\textcopyright} 2018, {\textcopyright} 2018 Taylor \& Francis Group, LLC.",
year = "2018",
month = jul,
day = "3",
doi = "10.1080/10609393.2018.1527163",
language = "אנגלית",
volume = "60",
pages = "555--573",
journal = "Russian Education and Society",
issn = "1060-9393",
publisher = "M.E. Sharpe Inc.",
number = "7",

}

How international tests fail to inform policy: The unsolved mystery of Australia's steady decline in PISA scores

Morsy L, Khavenson T, Carnoy M. How international tests fail to inform policy: The unsolved mystery of Australia's steady decline in PISA scores. International Journal of Educational Development. 2018 May;60:60-79. [DOI] [Link to publication in Scopus]
@article{4b026f0805b04596b40ce979ee182661,
title = "How international tests fail to inform policy: The unsolved mystery of Australia's steady decline in PISA scores",
keywords = "Educational policies, International tests, Private education, Quality of education, Social class differences",
author = "Leila Morsy and Tatiana Khavenson and Martin Carnoy",
year = "2018",
month = may,
doi = "10.1016/j.ijedudev.2017.10.018",
language = "אנגלית",
volume = "60",
pages = "60--79",
journal = "International Journal of Educational Development",
issn = "0738-0593",
publisher = "Elsevier B.V.",

}

School Climate: A History of the Concept and Approaches to Defining and Measuring it on PISA Questionnaires

Chirkina TA, Khavenson TE. School Climate: A History of the Concept and Approaches to Defining and Measuring it on PISA Questionnaires. Russian Education and Society. 2018 Feb 1;60(2):133-160. [DOI] [Link to publication in Scopus]
 

School climate is one of the significant factors determining educational achievement. However, the lack of instruments to measure it has complicated the study of this concept in Russia. We review the history of the study of the concept of “school climate,” and we discuss approaches to how it can be defined. We describe the most widely used questionnaires for studying school climate and analyze the set of components that have been included in them. To conduct the empirical study, we chose the student questionnaire that is used in the PISA international study, which provides a theoretical basis for measuring a number of dimensions of school climate. We conducted a psychometric analysis using methods from confirmatory factor analysis and modern test theory. It turned out that the structure of the indices that are used to measure school climate is not what the framers of the questionnaire assumed it would be. It is unclear whether the questions reflect the school climate indicators that are specifically proposed in the questionnaires. Some of the judgments in the questionnaire have been worded in such a way as to elicit most students’ agreement or disagreement with them without revealing any differences in how students perceive the subject of the question. The answer categories are unbalanced for most of the judgments. Respondents tended to fill them out in a one-sided fashion. We propose steps for how the instrument can be further improved.

@article{fe0467be415e468cad1634f1eb8b05b0,
title = "School Climate: A History of the Concept and Approaches to Defining and Measuring it on PISA Questionnaires",
abstract = "School climate is one of the significant factors determining educational achievement. However, the lack of instruments to measure it has complicated the study of this concept in Russia. We review the history of the study of the concept of {\textquotedblleft}school climate,{\textquotedblright} and we discuss approaches to how it can be defined. We describe the most widely used questionnaires for studying school climate and analyze the set of components that have been included in them. To conduct the empirical study, we chose the student questionnaire that is used in the PISA international study, which provides a theoretical basis for measuring a number of dimensions of school climate. We conducted a psychometric analysis using methods from confirmatory factor analysis and modern test theory. It turned out that the structure of the indices that are used to measure school climate is not what the framers of the questionnaire assumed it would be. It is unclear whether the questions reflect the school climate indicators that are specifically proposed in the questionnaires. Some of the judgments in the questionnaire have been worded in such a way as to elicit most students{\textquoteright} agreement or disagreement with them without revealing any differences in how students perceive the subject of the question. The answer categories are unbalanced for most of the judgments. Respondents tended to fill them out in a one-sided fashion. We propose steps for how the instrument can be further improved.",
author = "Chirkina, \{T. A.\} and Khavenson, \{T. E.\}",
note = "Publisher Copyright: {\textcopyright} 2018 Taylor \& Francis Group, LLC.",
year = "2018",
month = feb,
day = "1",
doi = "10.1080/10609393.2018.1451189",
language = "אנגלית",
volume = "60",
pages = "133--160",
journal = "Russian Education and Society",
issn = "1060-9393",
publisher = "Routledge",
number = "2",

}

Above Barriers: A survey of resilient schools

Pinskaya M, Khavenson T, Kosaretsky S, Zvyagincev R, Mikhailova A, Chirkina T. Above Barriers: A survey of resilient schools. Voprosy Obrazovaniya / Educational Studies Moscow. 2018;(2):198-227. [DOI] [Link to publication in Scopus]
 

A field study was performed by experts from the Institute of Education, National Research University Higher School of Economics, as part of the Monitoring of Education Markets and Organizations conducted by HSE in cooperation with the Levada Center. Interviews and focus groups were organized with school principals, teachers, students and their parents in three schools teaching the most challenging type of students from low socioeconomic and cultural backgrounds, who nevertheless achieve high learning outcomes. This is a follow-up of the 2015 study of environment characteristics, management and education strategies of schools operating in unfavorable social contexts. Such schools are defined as resilient, meaning that they successfully resist the disadvantaged context beyond their control. The schools surveyed differ in the number of students, education programs, and the level of regional deprivation, yet all of them pursue similar strategies that are well-targeted and recognized by all educational process participants. Such strategies include: introducing limited selection and levelling off the student body, imposing high expectations and transparent requirements to learning outcomes, providing individual support and encouragement to students, and developing the skills boosting graduates' chances of successful socialization. Consistent implementation of these strategies will create conditions to promote academic resilience among students. Studying the experience of such schools appears to be crucial for solving the problem of inequality in education.

@article{26155dc289a6452b91867ba9c38ee039,
title = "Above Barriers: A survey of resilient schools",
abstract = "A field study was performed by experts from the Institute of Education, National Research University Higher School of Economics, as part of the Monitoring of Education Markets and Organizations conducted by HSE in cooperation with the Levada Center. Interviews and focus groups were organized with school principals, teachers, students and their parents in three schools teaching the most challenging type of students from low socioeconomic and cultural backgrounds, who nevertheless achieve high learning outcomes. This is a follow-up of the 2015 study of environment characteristics, management and education strategies of schools operating in unfavorable social contexts. Such schools are defined as resilient, meaning that they successfully resist the disadvantaged context beyond their control. The schools surveyed differ in the number of students, education programs, and the level of regional deprivation, yet all of them pursue similar strategies that are well-targeted and recognized by all educational process participants. Such strategies include: introducing limited selection and levelling off the student body, imposing high expectations and transparent requirements to learning outcomes, providing individual support and encouragement to students, and developing the skills boosting graduates' chances of successful socialization. Consistent implementation of these strategies will create conditions to promote academic resilience among students. Studying the experience of such schools appears to be crucial for solving the problem of inequality in education.",
keywords = "Academic resilience, Educational strategies, Educational trajectories, Physically challenged school students, School effectiveness, Socioeconomic status",
author = "M. Pinskaya and T. Khavenson and S. Kosaretsky and R. Zvyagincev and A. Mikhailova and T. Chirkina",
note = "Publisher Copyright: {\textcopyright} 2018, Educational Studies Moscow.",
year = "2018",
doi = "10.17323/1814-9545-2018-2-198-227",
language = "אנגלית",
pages = "198--227",
journal = "Voprosy Obrazovaniya / Educational Studies Moscow",
issn = "1814-9545",
publisher = "National Research University, Higher School of Econoimics",
number = "2",

}

2017

Intranational comparative education: What state differences in student achievement can teach us about improving education-the case of Brazil

Carnoy M, Marotta L, Louzano P, Khavenson T, Guimarães FRF, Carnauba F. Intranational comparative education: What state differences in student achievement can teach us about improving education-the case of Brazil. Comparative Education Review. 2017 Nov;61(4):726-759. [DOI] [Link to publication in Scopus]
 

Implicit in much of comparative and international education research is that education is a creature of the nation-state, shaped largely by economic, political, and social forces defined by national boundaries. However, in federal nation-states, primary and secondary schooling is the juridical responsibility of the constituent states, not the national government. We make the case in this article that in comparative education analysis, there is persuasive support in political theory to consider subnational state comparisons in federalist nations and that such comparisons can yield valuable insights for improving education in the federal nation-state as a whole. Wefocus on one federal country, Brazil, and on the possible differences in the “effectiveness” of state education administrations in delivering education. We measure state effectiveness by students’ mathematics achievement gains on a national test in 1999-2013. We also examine the possible reasons why gains differ greatly in states with similar demographic characteristics.

@article{82c4ccb392f043ddba157f1d607dfb31,
title = "Intranational comparative education: What state differences in student achievement can teach us about improving education-the case of Brazil",
abstract = "Implicit in much of comparative and international education research is that education is a creature of the nation-state, shaped largely by economic, political, and social forces defined by national boundaries. However, in federal nation-states, primary and secondary schooling is the juridical responsibility of the constituent states, not the national government. We make the case in this article that in comparative education analysis, there is persuasive support in political theory to consider subnational state comparisons in federalist nations and that such comparisons can yield valuable insights for improving education in the federal nation-state as a whole. Wefocus on one federal country, Brazil, and on the possible differences in the {\textquotedblleft}effectiveness{\textquotedblright} of state education administrations in delivering education. We measure state effectiveness by students{\textquoteright} mathematics achievement gains on a national test in 1999-2013. We also examine the possible reasons why gains differ greatly in states with similar demographic characteristics.",
author = "Martin Carnoy and Luana Marotta and Paula Louzano and Tatiana Khavenson and Guimar{\~a}es, \{Filipe Recch Franca\} and Fernando Carnauba",
note = "Publisher Copyright: {\textcopyright} 2017 by the Comparative and International Education Society. All rights reserved.",
year = "2017",
month = nov,
doi = "10.1086/693981",
language = "אנגלית",
volume = "61",
pages = "726--759",
journal = "Comparative Education Review",
issn = "0010-4086",
publisher = "University of Chicago Press",
number = "4",

}

School climate: The history of the concept, approaches to defining, and measurement in pisa questionnaire

Chirkina T, Khavenson T. School climate: The history of the concept, approaches to defining, and measurement in pisa questionnaire. Voprosy Obrazovaniya / Educational Studies Moscow. 2017;2017(1):207-229. [DOI] [Link to publication in Scopus]
 

School climate is a significant factor of educational achievement. However, relevant research in Russia is difficult due to the absence of instruments. The paper peeks into the histor y of the notion of school climate, discussing approaches to defining the term. It also describes the most widespread questionnaires used to measure school climate and provides an analysis of their components. The empirical study is based on the student questionnaire used by the Programme for International Student Assessment (PISA), which should ideally allow measuring a number of school climate aspects. A psychometric analysis based on the methods of confirmatory factor analysis and modern test theory reveals that the structure of school climate indices is different from what questionnaire designers expected it to be. It can not be clearly determined whether the questions reflect the school climate indicators that the questionnaires were supposed to measure. Some statements are worded in such a way that most school students should either agree or disagree with them, without showing any difference in their attitude toward the subject. The scale is unbalanced for the majority of items. The article suggests making some specific steps to improve this instrument.

@article{0a3155f940af4705b77143daa3d0e287,
title = "School climate: The history of the concept, approaches to defining, and measurement in pisa questionnaire",
abstract = "School climate is a significant factor of educational achievement. However, relevant research in Russia is difficult due to the absence of instruments. The paper peeks into the histor y of the notion of school climate, discussing approaches to defining the term. It also describes the most widespread questionnaires used to measure school climate and provides an analysis of their components. The empirical study is based on the student questionnaire used by the Programme for International Student Assessment (PISA), which should ideally allow measuring a number of school climate aspects. A psychometric analysis based on the methods of confirmatory factor analysis and modern test theory reveals that the structure of school climate indices is different from what questionnaire designers expected it to be. It can not be clearly determined whether the questions reflect the school climate indicators that the questionnaires were supposed to measure. Some statements are worded in such a way that most school students should either agree or disagree with them, without showing any difference in their attitude toward the subject. The scale is unbalanced for the majority of items. The article suggests making some specific steps to improve this instrument.",
keywords = "Confirmatory factor analysis, Educational measurement, Item response theory, Modern test theory, PISA, Schoolclimate",
author = "Tatiana Chirkina and Tatiana Khavenson",
year = "2017",
doi = "10.17323/1814-9545-2017-1-207-229",
language = "אנגלית",
volume = "2017",
pages = "207--229",
journal = "Voprosy Obrazovaniya / Educational Studies Moscow",
issn = "1814-9545",
publisher = "National Research University, Higher School of Econoimics",
number = "1",

}

Educational attainment and social inequality in Russia: Dynamics and correlations with education policies

Kapuza A, Kersha Y, Zakharov A, Khavenson T. Educational attainment and social inequality in Russia: Dynamics and correlations with education policies. Voprosy Obrazovaniya / Educational Studies Moscow. 2017;2017(4):10-35. [DOI] [Link to publication in Scopus]
 

Dynamics of academic performance of Russian school students depending on cultural capital and the size of community is analyzed using PISA and TIMSS data. In order to reveal tendencies in TIMSS and PISA scores dynamics ten educational experts were interviewed. The last 15 years have witnessed a slight improvement in performance of Russian school students and a drop in social and territorial inequality. These changes do not affect all subject areas and result from educational attainment improvements in small populated localities and social groups of low cultural capital. Meanwhile, no growth has been observed in the scores of students with higher levels of cultural capital. The interviews shed light on possible changes in the education system associated with the dynamics of school students' educational attainment.

@article{979160fd4a664ad8ae59d76049cf3088,
title = "Educational attainment and social inequality in Russia: Dynamics and correlations with education policies",
abstract = "Dynamics of academic performance of Russian school students depending on cultural capital and the size of community is analyzed using PISA and TIMSS data. In order to reveal tendencies in TIMSS and PISA scores dynamics ten educational experts were interviewed. The last 15 years have witnessed a slight improvement in performance of Russian school students and a drop in social and territorial inequality. These changes do not affect all subject areas and result from educational attainment improvements in small populated localities and social groups of low cultural capital. Meanwhile, no growth has been observed in the scores of students with higher levels of cultural capital. The interviews shed light on possible changes in the education system associated with the dynamics of school students' educational attainment.",
keywords = "Education quality, PISA, School, Social inequality, Territorial inequality, TIMSS",
author = "Anastasiya Kapuza and Yuliya Kersha and Andrey Zakharov and Tatiana Khavenson",
note = "Publisher Copyright: {\textcopyright} Voprosy obrazovaniya / Educational Studies Moscow. 2017.",
year = "2017",
doi = "10.17323/1814-9545-2017-4-10-35",
language = "אנגלית",
volume = "2017",
pages = "10--35",
journal = "Voprosy Obrazovaniya / Educational Studies Moscow",
issn = "1814-9545",
publisher = "National Research University, Higher School of Econoimics",
number = "4",

}

2016

Revisiting the Relationship Between International Assessment Outcomes and Educational Production: Evidence From a Longitudinal PISA-TIMSS Sample

Carnoy M, Khavenson T, Loyalka P, Schmidt WH, Zakharov A. Revisiting the Relationship Between International Assessment Outcomes and Educational Production: Evidence From a Longitudinal PISA-TIMSS Sample. American Educational Research Journal. 2016 Aug 1;53(4):1054-1085. [DOI] [Link to publication in Scopus]
 

International assessments, such as the Program for International Student Assessment (PISA), are being used to recommend educational policies to improve student achievement. This study shows that the cross-sectional estimates behind such recommendations may be biased. We use a unique data set from one country that applied the PISA mathematics test in 2012 in ninth grade to all students who had taken the Trends in International Mathematics and Science Survey (TIMSS) test in 2011 and collected information on students’ teachers in ninth grade. These data allowed us to more precisely estimate the effects of classroom variables on students’ PISA performance. Our results suggest that the positive roles of teacher “quality” and “opportunity to learn” in improving student performance are much more modest than claimed in PISA documents.

@article{5f7b139286074fa28e868ec563f6d268,
title = "Revisiting the Relationship Between International Assessment Outcomes and Educational Production: Evidence From a Longitudinal PISA-TIMSS Sample",
abstract = "International assessments, such as the Program for International Student Assessment (PISA), are being used to recommend educational policies to improve student achievement. This study shows that the cross-sectional estimates behind such recommendations may be biased. We use a unique data set from one country that applied the PISA mathematics test in 2012 in ninth grade to all students who had taken the Trends in International Mathematics and Science Survey (TIMSS) test in 2011 and collected information on students{\textquoteright} teachers in ninth grade. These data allowed us to more precisely estimate the effects of classroom variables on students{\textquoteright} PISA performance. Our results suggest that the positive roles of teacher “quality” and “opportunity to learn” in improving student performance are much more modest than claimed in PISA documents.",
keywords = "educational policy, international tests, opportunity to learn, teacher effects, value-added analysis",
author = "Martin Carnoy and Tatiana Khavenson and Prashant Loyalka and Schmidt, \{William H.\} and Andrey Zakharov",
note = "Publisher Copyright: {\textcopyright} 2016, {\textcopyright} 2016 AERA.",
year = "2016",
month = aug,
day = "1",
doi = "10.3102/0002831216653180",
language = "אנגלית",
volume = "53",
pages = "1054--1085",
journal = "American Educational Research Journal",
issn = "0002-8312",
publisher = "SAGE Publications Ltd",
number = "4",

}

The unintended and intended academic consequences of educational reforms: the cases of Post-Soviet Estonia, Latvia and Russia

Khavenson T, Carnoy M. The unintended and intended academic consequences of educational reforms: the cases of Post-Soviet Estonia, Latvia and Russia. Oxford Review of Education. 2016 Mar 3;42(2):178-199. [DOI] [Link to publication in Scopus]
 

In this paper, we try to unravel some of the unintended and intended academic effects associated with post-Soviet educational reforms by focusing on three cases: Estonia, Latvia and Russia. We have chosen this comparison because a unique ‘natural experiment’ in the three countries allows us to compare the changing academic performance on an international test of a largely similar population in the three countries—Russian origin students attending Russian-medium schools—subjected to three variations of post-Soviet reforms. We find that relative to students in Russia, Russian-medium students in the Baltics made significant gains in the Programme for International Student Assessment (PISA) test. In Latvia, these appear to be an unintended effect of somewhat ‘softened’ state language policies, the conditions surrounding minority rights, and the general context of maintaining social cohesion. In Estonia, the (later) relative gains of Russian students appear to an intended effect of locally grown educational (and language) policies and increased, more effective cooperation with Russian medium schools to further improve PISA performance in a relatively high scoring, PISA-focused country.

@article{797b7712fb704eda90044293774c8ff4,
title = "The unintended and intended academic consequences of educational reforms: the cases of Post-Soviet Estonia, Latvia and Russia",
abstract = "In this paper, we try to unravel some of the unintended and intended academic effects associated with post-Soviet educational reforms by focusing on three cases: Estonia, Latvia and Russia. We have chosen this comparison because a unique {\textquoteleft}natural experiment{\textquoteright} in the three countries allows us to compare the changing academic performance on an international test of a largely similar population in the three countries—Russian origin students attending Russian-medium schools—subjected to three variations of post-Soviet reforms. We find that relative to students in Russia, Russian-medium students in the Baltics made significant gains in the Programme for International Student Assessment (PISA) test. In Latvia, these appear to be an unintended effect of somewhat {\textquoteleft}softened{\textquoteright} state language policies, the conditions surrounding minority rights, and the general context of maintaining social cohesion. In Estonia, the (later) relative gains of Russian students appear to an intended effect of locally grown educational (and language) policies and increased, more effective cooperation with Russian medium schools to further improve PISA performance in a relatively high scoring, PISA-focused country.",
keywords = "achievement gains, educational reforms, language policy, natural experiment, State legitimation",
author = "Tatiana Khavenson and Martin Carnoy",
note = "Publisher Copyright: {\textcopyright} 2016 Informa UK Limited, trading as Taylor \& Francis Group.",
year = "2016",
month = mar,
day = "3",
doi = "10.1080/03054985.2016.1157063",
language = "אנגלית",
volume = "42",
pages = "178--199",
journal = "Oxford Review of Education",
issn = "0305-4985",
publisher = "Routledge",
number = "2",

}

2015

A educação Brasileira está melhorando? Evidências do PISA e do SAEB

Translated title of the contribution: Is Brazilian education improving? Evidence from PISA and SAEB
Carnoy M, Khavenson T, Fonseca I, Costa L, Marotta L. A educação Brasileira está melhorando? Evidências do PISA e do SAEB. Cadernos de Pesquisa. 2015 Jul;45(157):450-485. [DOI] [Link to publication in Scopus]
 

This article assesses the changes in mathematics and reading scores of socially advantaged or disadvantaged Brazilian students, in the International Student Assessment Program – Pisa – between 2000 and 2012, and the National Basic Education Assessment System – Saeb – between 1995 to 2013, in order to extract some provisional conclusions regarding the variations in the effectiveness of basic education in Brazil (1st to 8th/9th grades). Our findings show that the gains in the Pisa math test are much larger than in the reading test. The gains (or their absence), in the Saeb test, for the 1999-2013 period, are also higher in mathematics than in Portuguese. Part of the gains in the Pisa math test and most of those in the reading test result from the gradual increase in the number of years fifteen year-old students spend in school. The gains in the Pisa test for more advantaged Brazilian students are lower than for those coming from families with lower educational resources; this also applies for the Saeb test.

@article{5f698cb2dc3948aa966b6051c9c22197,
title = "A educa{\c c}{\~a}o Brasileira est{\'a} melhorando? Evid{\^e}ncias do PISA e do SAEB",
abstract = "This article assesses the changes in mathematics and reading scores of socially advantaged or disadvantaged Brazilian students, in the International Student Assessment Program {\textendash} Pisa {\textendash} between 2000 and 2012, and the National Basic Education Assessment System {\textendash} Saeb {\textendash} between 1995 to 2013, in order to extract some provisional conclusions regarding the variations in the effectiveness of basic education in Brazil (1st to 8th/9th grades). Our findings show that the gains in the Pisa math test are much larger than in the reading test. The gains (or their absence), in the Saeb test, for the 1999-2013 period, are also higher in mathematics than in Portuguese. Part of the gains in the Pisa math test and most of those in the reading test result from the gradual increase in the number of years fifteen year-old students spend in school. The gains in the Pisa test for more advantaged Brazilian students are lower than for those coming from families with lower educational resources; this also applies for the Saeb test.",
keywords = "Basic education, Evaluation, PISA, SAEB",
author = "Martin Carnoy and Tatiana Khavenson and Izabel Fonseca and Leandro Costa and Luana Marotta",
note = "Publisher Copyright: {\textcopyright} 2015, Fundacao Carlos Chagas. All rights reserved.",
year = "2015",
month = jul,
doi = "10.1590/198053143331",
language = "פורטוגזית",
volume = "45",
pages = "450--485",
journal = "Cadernos de Pesquisa",
issn = "0100-1574",
publisher = "Fundacao Carlos Chagas",
number = "157",

}

Using TIMSS and PISA results to inform educational policy: a study of Russia and its neighbours

Carnoy M, Khavenson T, Ivanova A. Using TIMSS and PISA results to inform educational policy: a study of Russia and its neighbours. Compare. 2015 Mar 4;45(2):248-271. [DOI] [Link to publication in Scopus]
 

In this paper, we develop a multi-level comparative approach to analyse Trends in International Mathematics and Science Survey (TIMSS) and Programme of International Student Achievement (PISA) mathematics results for a country, Russia, where the two tests provide contradictory information about students’ relative performance. Russian students do relatively well on the TIMSS mathematics test but relatively poorly on the PISA. We compare the performance of Russian students with different levels of family academic resources over the past decade on these tests compared to students with similar family resources in Russia’s neighbours and to Russian students studying in Latvian and Estonian Russian-medium schools. These comparisons and interviews with educators in Latvia and Estonia help us understand why students in Russia may perform lower on the PISA and to draw education policy lessons for improving international test performance generally and Russian students’ PISA mathematics performance specifically.

@article{850ae221b92743d9b118f67b3f97c321,
title = "Using TIMSS and PISA results to inform educational policy: a study of Russia and its neighbours",
abstract = "In this paper, we develop a multi-level comparative approach to analyse Trends in International Mathematics and Science Survey (TIMSS) and Programme of International Student Achievement (PISA) mathematics results for a country, Russia, where the two tests provide contradictory information about students{\textquoteright} relative performance. Russian students do relatively well on the TIMSS mathematics test but relatively poorly on the PISA. We compare the performance of Russian students with different levels of family academic resources over the past decade on these tests compared to students with similar family resources in Russia{\textquoteright}s neighbours and to Russian students studying in Latvian and Estonian Russian-medium schools. These comparisons and interviews with educators in Latvia and Estonia help us understand why students in Russia may perform lower on the PISA and to draw education policy lessons for improving international test performance generally and Russian students{\textquoteright} PISA mathematics performance specifically.",
keywords = "educational policy, family academic resources, international tests, mathematics achievement, natural experiment",
author = "Martin Carnoy and Tatiana Khavenson and Alina Ivanova",
note = "Publisher Copyright: {\textcopyright} 2013, {\textcopyright} 2013 British Association for International and Comparative Education.",
year = "2015",
month = mar,
day = "4",
doi = "10.1080/03057925.2013.855002",
language = "אנגלית",
volume = "45",
pages = "248--271",
journal = "Compare",
issn = "0305-7925",
publisher = "Routledge",
number = "2",

}

Portrait of a 21st century's innovator

Koroleva D, Khavenson T. Portrait of a 21st century's innovator. Voprosy Obrazovaniya / Educational Studies Moscow. 2015;2015(1):182-200. [DOI] [Link to publication in Scopus]
 

This is an analysis of social and professional characteristics, as well as value orientations of a modern educational innovator. The survey included participants of the 2014 Contest of Innovations in Education, with the sample of 304 respondents. Value orientations were revealed with the help of a questionnaire based on the Schwartz's value theory. The results were compared to those of the European Social Survey of the Russian population conducted in 2012. Answers of the Contest participants differed dramatically from those of an average Russian, both in subjective importance of specific value orientations and in the structure of value orientation hierarchy. Innovators appreciated more often the values of self-sufficiency, kindness and universalism, as well as willingness to take risks in their professional life. They were less guided in their actions by the desire to take and to hold power which was not associated with their personal achievements. The survey demonstrated that innovations in education could be offered and implemented not only by experts, i. e. people working in educational institutions of different levels, but also by employees of companies that are not directly related to education, as well as by school and university students. Innovators have a better educational background and participate actively in supplementary education events.

@article{7fea255d8462440a938592e567c75f1c,
title = "Portrait of a 21st century's innovator",
abstract = "This is an analysis of social and professional characteristics, as well as value orientations of a modern educational innovator. The survey included participants of the 2014 Contest of Innovations in Education, with the sample of 304 respondents. Value orientations were revealed with the help of a questionnaire based on the Schwartz's value theory. The results were compared to those of the European Social Survey of the Russian population conducted in 2012. Answers of the Contest participants differed dramatically from those of an average Russian, both in subjective importance of specific value orientations and in the structure of value orientation hierarchy. Innovators appreciated more often the values of self-sufficiency, kindness and universalism, as well as willingness to take risks in their professional life. They were less guided in their actions by the desire to take and to hold power which was not associated with their personal achievements. The survey demonstrated that innovations in education could be offered and implemented not only by experts, i. e. people working in educational institutions of different levels, but also by employees of companies that are not directly related to education, as well as by school and university students. Innovators have a better educational background and participate actively in supplementary education events.",
keywords = "Education reforms, Innovations in education, Innovator's image, Portrait Values Questionnaire (Schwartz), Values",
author = "Diana Koroleva and Tatiana Khavenson",
year = "2015",
doi = "10.17323/1814-9545-2015-1-182-200",
language = "אנגלית",
volume = "2015",
pages = "182--200",
journal = "Voprosy Obrazovaniya / Educational Studies Moscow",
issn = "1814-9545",
publisher = "National Research University, Higher School of Econoimics",
number = "1",

}

2012

Teacher characteristics and student performance at school. Applying the first difference method to TIMSS 2007 data

Tyumeneva Y, Khavenson T. Teacher characteristics and student performance at school. Applying the first difference method to TIMSS 2007 data. Voprosy Obrazovaniya / Educational Studies Moscow. 2012;2012(3):112-140. [DOI] [Link to publication in Scopus]
 

The Trends in International Mathematics and Science Study (TIMSS) does have a clear advantage in that, apart from a direct cognitive appraisal of students, it enables to collect information on their teachers, including their education background, work experience and teaching practices. The first difference method was used to determine how teacher characteristics were correlated with student achievements and to overcome restrictions of TIMSS correlation design. In addition, effects of teacher characteristics were evaluated by the conventional regression analysis. The discovered correlations differed across subject areas, and the results of the first difference method differed from those of the conventional correlation analysis. In mathematics, the first difference method revealed negative relation between academic progress and rule-based tasks or collaborative learning, while tasks designed to develop meta-subject skills showed a positive effect on performance. In natural sciences, on the contrary, rule-based tasks showed positive relation, while tasks designed to develop meta-subject skills produced a negative effect or no effect at all. Unlike in mathematics, teacher experience also had a significant influence on student achievements in natural sciences. Implementing the new methodological approach has allowed not only to determine relation between teacher characteristics and academic performance of students but also to identify characteristics typical of specific teacher categories, as, for example, those who work in elite schools or teach better-prepared students. This information may be used both in developing the educational policy and in designing future studies, especially experimental ones.

@article{c2af3d1dd96047fcbf5468aedc8b97f6,
title = "Teacher characteristics and student performance at school. Applying the first difference method to TIMSS 2007 data",
abstract = "The Trends in International Mathematics and Science Study (TIMSS) does have a clear advantage in that, apart from a direct cognitive appraisal of students, it enables to collect information on their teachers, including their education background, work experience and teaching practices. The first difference method was used to determine how teacher characteristics were correlated with student achievements and to overcome restrictions of TIMSS correlation design. In addition, effects of teacher characteristics were evaluated by the conventional regression analysis. The discovered correlations differed across subject areas, and the results of the first difference method differed from those of the conventional correlation analysis. In mathematics, the first difference method revealed negative relation between academic progress and rule-based tasks or collaborative learning, while tasks designed to develop meta-subject skills showed a positive effect on performance. In natural sciences, on the contrary, rule-based tasks showed positive relation, while tasks designed to develop meta-subject skills produced a negative effect or no effect at all. Unlike in mathematics, teacher experience also had a significant influence on student achievements in natural sciences. Implementing the new methodological approach has allowed not only to determine relation between teacher characteristics and academic performance of students but also to identify characteristics typical of specific teacher categories, as, for example, those who work in elite schools or teach better-prepared students. This information may be used both in developing the educational policy and in designing future studies, especially experimental ones.",
keywords = "Cognitive development, First difference method, Mathematics, Meta-subject skills, Professional experience, School students, Teachers, TIMSS",
author = "Yulia Tyumeneva and Tatiana Khavenson",
year = "2012",
doi = "10.17323/1814-9545-2012-3-113-140",
language = "אנגלית",
volume = "2012",
pages = "112--140",
journal = "Voprosy Obrazovaniya / Educational Studies Moscow",
issn = "1814-9545",
publisher = "National Research University, Higher School of Econoimics",
number = "3",

}

2011

Social professional status and political values - Russia, Germany, USA (a comparative analysis)

Khavenson TE, Migol' EV. Social professional status and political values - Russia, Germany, USA (a comparative analysis). Sotsiologicheskie Issledovaniya. 2011;(9):61-72. [Link to publication in Scopus]
@article{964ede6dbd9a488192a5dd81d6b352d8,
title = "Social professional status and political values - Russia, Germany, USA (a comparative analysis)",
author = "Khavenson, \{T. E.\} and Migol', \{E. V.\}",
year = "2011",
language = "אנגלית",
pages = "61--72",
journal = "Sotsiologicheskie Issledovaniya",
issn = "0132-1625",
publisher = "Russian Academy of Sciences",
number = "9",

}

© 2026 Copyright Elyachar Central Library, Technion - Israel Institute of Technology