Programme for International Student Assessment explained

Programme for International Student Assessment
Abbreviation:PISA
Formation:1997
Purpose:Comparison of education attainment across the world
Headquarters:OECD Headquarters
Location:2 rue André Pascal, 75775 Paris Cedex 16
Region Served:World
Membership:79 government education departments
Language:English and French
Leader Title:Head of the Early Childhood and Schools Division
Leader Name:Yuri Belfali
Main Organ:PISA Governing Body (Chair – Michele Bruniges)
Parent Organization:OECD

The Programme for International Student Assessment (PISA) is a worldwide study by the Organisation for Economic Co-operation and Development (OECD) in member and non-member nations intended to evaluate educational systems by measuring 15-year-old school pupils' scholastic performance on mathematics, science, and reading.[1] It was first performed in 2000 and then repeated every three years. Its aim is to provide comparable data to enable countries to improve their education policies and outcomes. It measures problem solving and cognition.[2]

The results of the 2022 data collection were released in December 2023.[3]

Influence and impact

PISA, and similar international standardised assessments of educational attainment are increasingly used in the process of education policymaking at both national and international levels.[4]

PISA was conceived to set in a wider context the information provided by national monitoring of education system performance through regular assessments within a common, internationally agreed framework; by investigating relationships between student learning and other factors they can "offer insights into sources of variation in performances within and between countries".[5]

Until the 1990s, few European countries used national tests. In the 1990s, ten countries / regions introduced standardised assessment, and since the early 2000s, ten more followed suit. By 2009, only five European education systems had no national student assessments.[4]

The impact of these international standardised assessments in the field of educational policy has been significant, in terms of the creation of new knowledge, changes in assessment policy, and external influence over national educational policy more broadly.[6] [7] [8]

Creation of new knowledge

Data from international standardised assessments can be useful in research on causal factors within or across education systems.[4] Mons notes that the databases generated by large-scale international assessments have made it possible to carry out inventories and comparisons of education systems on an unprecedented scale[9] on themes ranging from the conditions for learning mathematics and reading, to institutional autonomy and admissions policies.[10] They allow typologies to be developed that can be used for comparative statistical analyses of education performance indicators, thereby identifying the consequences of different policy choices. They have generated new knowledge about education: PISA findings have challenged deeply embedded educational practices, such as the early tracking of students into vocational or academic pathways.[11]

Barroso and de Carvalho find that PISA provides a common reference connecting academic research in education and the political realm of public policy, operating as a mediator between different strands of knowledge from the realm of education and public policy.[12] However, although the key findings from comparative assessments are widely shared in the research community[4] the knowledge they create does not necessarily fit with government reform agendas; this leads to some inappropriate uses of assessment data.

Changes in national assessment policy

Emerging research suggests that international standardised assessments are having an impact on national assessment policy and practice. PISA is being integrated into national policies and practices on assessment, evaluation, curriculum standards and performance targets; its assessment frameworks and instruments are being used as best-practice models for improving national assessments; many countries have explicitly incorporated and emphasise PISA-like competencies in revised national standards and curricula; others use PISA data to complement national data and validate national results against an international benchmark.[11]

External influence over national educational policy

PISA may influence national education policy choices in a variety of ways. Participation in international assessments like PISA has been linked to significant education policy changes and outcomes, such as higher student enrollments and education reforms. However, critics have argued that participation could lead to undesirable outcomes, such as higher repetition rates and narrowing of curricula. The impact of PISA may also vary according to the specific country context.[13]

Policy-makers in most participating countries see PISA as an important indicator of system performance; PISA reports can define policy problems and set the agenda for national policy debate; policymakers seem to accept PISA as a valid and reliable instrument for internationally benchmarking system performance and changes over time; most countries—irrespective of whether they performed above, at, or below the average PISA score—have begun policy reforms in response to PISA reports.[11]

Against this, impact on national education systems varies markedly. For example, in Germany, the results of the first PISA assessment caused the so-called 'PISA shock': a questioning of previously accepted educational policies; in a state marked by jealously guarded regional policy differences, it led ultimately to an agreement by all Länder to introduce common national standards and even an institutionalised structure to ensure that they were observed.[14] In Hungary, by comparison, which shared similar conditions to Germany, PISA results have not led to significant changes in educational policy.[15]

Because many countries have set national performance targets based on their relative rank or absolute PISA score, PISA assessments have increased the influence of their (non-elected) commissioning body, the OECD, as an international education monitor and policy actor, which implies an important degree of 'policy transfer' from the international to the national level; PISA in particular is having "an influential normative effect on the direction of national education policies".[11] Thus, it is argued that the use of international standardised assessments has led to a shift towards international, external accountability for national system performance; Rey contends that PISA surveys, portrayed as objective, third-party diagnoses of education systems, actually serve to promote specific orientations on educational issues.[4]

National policy actors refer to high-performing PISA countries to "help legitimise and justify their intended reform agenda within contested national policy debates".[16] PISA data can be "used to fuel long-standing debates around pre-existing conflicts or rivalries between different policy options, such as in the French Community of Belgium".[17] In such instances, PISA assessment data are used selectively: in public discourse governments often only use superficial features of PISA surveys such as country rankings and not the more detailed analyses. Rey (2010:145, citing Greger, 2008) notes that often the real results of PISA assessments are ignored as policymakers selectively refer to data in order to legitimise policies introduced for other reasons.[18]

In addition, PISA's international comparisons can be used to justify reforms with which the data themselves have no connection; in Portugal, for example, PISA data were used to justify new arrangements for teacher assessment (based on inferences that were not justified by the assessments and data themselves); they also fed the government's discourse about the issue of pupils repeating a year, (which, according to research, fails to improve student results).[19] In Finland, the country's PISA results (that are in other countries deemed to be excellent) were used by Ministers to promote new policies for 'gifted' students.[20] Such uses and interpretations often assume causal relationships that cannot legitimately be based upon PISA data which would normally require fuller investigation through qualitative in-depth studies and longitudinal surveys based on mixed quantitative and qualitative methods,[21] which politicians are often reluctant to fund.

Recent decades have witnessed an expansion in the uses of PISA and similar assessments, from assessing students' learning, to connecting "the educational realm (their traditional remit) with the political realm".[22] This raises the question of whether PISA data are sufficiently robust to bear the weight of the major policy decisions that are being based upon them, for, according to Breakspear, PISA data have "come to increasingly shape, define and evaluate the key goals of the national / federal education system".[11] This implies that those who set the PISA tests – e.g. in choosing the content to be assessed and not assessed – are in a position of considerable power to set the terms of the education debate, and to orient educational reform in many countries around the globe.[11]

Framework

PISA stands in a tradition of international school studies, undertaken since the late 1950s by the International Association for the Evaluation of Educational Achievement (IEA). Much of PISA's methodology follows the example of the Trends in International Mathematics and Science Study (TIMSS, started in 1995), which in turn was much influenced by the U.S. National Assessment of Educational Progress (NAEP). The reading component of PISA is inspired by the IEA's Progress in International Reading Literacy Study (PIRLS).

PISA aims to test literacy of students in three competence fields: reading, mathematics, science on an indefinite scale.[23]

The PISA mathematics literacy test asks students to apply their mathematical knowledge to solve problems set in real-world contexts. To solve the problems students must activate a number of mathematical competencies as well as a broad range of mathematical content knowledge. TIMSS, on the other hand, measures more traditional classroom content such as an understanding of fractions and decimals and the relationship between them (curriculum attainment). PISA claims to measure education's application to real-life problems and lifelong learning (workforce knowledge).

In the reading test, "OECD/PISA does not measure the extent to which 15-year-old students are fluent readers or how competent they are at word recognition tasks or spelling." Instead, they should be able to "construct, extend and reflect on the meaning of what they have read across a wide range of continuous and non-continuous texts."[24]

PISA also assesses students in innovative domains. In 2012 and 2015 in addition to reading, mathematics and science, they were tested in collaborative problem solving. In 2018 the additional innovative domain was global competence.

Implementation

PISA is sponsored, governed, and coordinated by the OECD, but paid for by participating countries.

Method of testing

Sampling

The students tested by PISA are aged between 15 years and 3 months and 16 years and 2 months at the beginning of the assessment period. The school year pupils are in is not taken into consideration. Only students at school are tested, not home-schoolers. In PISA 2006, however, several countries also used a grade-based sample of students. This made it possible to study how age and school year interact.

To fulfill OECD requirements, each country must draw a sample of at least 5,000 students. In small countries like Iceland and Luxembourg, where there are fewer than 5,000 students per year, an entire age cohort is tested. Some countries used much larger samples than required to allow comparisons between regions.

Test

Each student takes a two-hour computer based test. Part of the test is multiple-choice and part involves fuller answers. There are six and a half hours of assessment material, but each student is not tested on all the parts. Following the cognitive test, participating students spend nearly one more hour answering a questionnaire on their background including learning habits, motivation, and family. School directors fill in a questionnaire describing school demographics, funding, etc. In 2012 the participants were, for the first time in the history of large-scale testing and assessments, offered a new type of problem, i.e. interactive (complex) problems requiring exploration of a novel virtual device.[25] [26]

In selected countries, PISA started experimentation with computer adaptive testing.

National add-ons

Countries are allowed to combine PISA with complementary national tests.

Germany does this in a very extensive way: On the day following the international test, students take a national test called (E=Ergänzung=complement). Test items of PISA-E are closer to TIMSS than to PISA. While only about 5,000 German students participate in the international and the national test, another 45,000 take the national test only. This large sample is needed to allow an analysis by federal states. Following a clash about the interpretation of 2006 results, the OECD warned Germany that it might withdraw the right to use the "PISA" label for national tests.[27]

Data scaling

From the beginning, PISA has been designed with one particular method of data analysis in mind. Since students work on different test booklets, raw scores must be 'scaled' to allow meaningful comparisons. Scores are thus scaled so that the OECD average in each domain (mathematics, reading and science) is 500 and the standard deviation is 100. This is true only for the initial PISA cycle when the scale was first introduced, though, subsequent cycles are linked to the previous cycles through IRT scale linking methods.

This generation of proficiency estimates is done using a latent regression extension of the Rasch model, a model of item response theory (IRT), also known as conditioning model or population model. The proficiency estimates are provided in the form of so-called plausible values, which allow unbiased estimates of differences between groups. The latent regression, together with the use of a Gaussian prior probability distribution of student competencies allows estimation of the proficiency distributions of groups of participating students. The scaling and conditioning procedures are described in nearly identical terms in the Technical Reports of PISA 2000, 2003, 2006. NAEP and TIMSS use similar scaling methods.

Ranking results

All PISA results are tabulated by country; recent PISA cycles have separate provincial or regional results for some countries. Most public attention concentrates on just one outcome: the mean scores of countries and their rankings of countries against one another. In the official reports, however, country-by-country rankings are given not as simple league tables but as cross tables indicating for each pair of countries whether or not mean score differences are statistically significant (unlikely to be due to random fluctuations in student sampling or in item functioning). In favorable cases, a difference of 9 points is sufficient to be considered significant.

PISA never combines mathematics, science and reading domain scores into an overall score. However, commentators have sometimes combined test results from all three domains into an overall country ranking. Such meta-analysis is not endorsed by the OECD, although official summaries sometimes use scores from a testing cycle's principal domain as a proxy for overall student ability.

PISA 2022 ranking summary

The results of PISA 2022 were presented on 5 December 2023, which included data for around 700,000 participating students in 81 countries and economies, with Singapore emerging as the top performer in all categories.[28]

Both Lebanon and the Chinese provinces/municipalities of Beijing, Shanghai, Jiangsu and Zhejiang participated this edition, but their results were not published as they were not able to fully collect data because of COVID restrictions.[29]

Because of the Russian full-scale invasion of Ukraine, only 18 of 27 Ukrainian regions had their data collected, thus the results are not representative of the following regions: Dnipropetrovsk Oblast, Donetsk Oblast, Kharkiv Oblast, Luhansk Oblast, Zaporizhzhia Oblast, Kherson Oblast, Mykolaiv Oblast, the Autonomous Republic of Crimea and the city of Sevastopol.[30]

Rankings comparison 2000–2022

Mathematics
Country2022[31] 2018[32] 201520122009200620032000
data-sort-type=number Scoreclass=unsortable Rankdata-sort-type=number Scoreclass=unsortable Rankdata-sort-type=number Scoreclass=unsortable Rankdata-sort-type=number Scoreclass=unsortable Rankdata-sort-type=number Scoreclass=unsortable Rankdata-sort-type=number Scoreclass=unsortable Rankdata-sort-type=number Scoreclass=unsortable Rankdata-sort-type=number Scoreclass=unsortable Rank
International Average (OECD)data-sort-value=472.36472—489—490—494—495—494—499—492—
3686843748413573945437753————data-sort-value=381.3338133
————36072——————————
37866data-sort-value=379.453797140958————————38830
data-sort-value=487.084871749129data-sort-value=494.25494255041751413data-sort-value=520.125201252410data-sort-value=533.065336
data-sort-value=487.2748716data-sort-value=498.94499234972050616496225051750618data-sort-value=503.1250312
B-S-J-G————5316——————————
B-S-J-Z——5911————————————
Baku3975642056————————————
——data-sort-value=471.8747238————————————
data-sort-value=489.494891250815507155151351512data-sort-value=520.115201152975208
——40662————————————
3796538470377683895538651data-sort-value=370.5370503563933435
44240data-sort-value=430.1143051————————————
417494364944147439434284141343——43028
CABA————4564341849————————
33681——————————————
49795121251610data-sort-value=518.1151811527852775326data-sort-value=533.065336
412524175942350423474214441144——38432
547353155424560354345491————
383643916939064data-sort-value=376.583765838152data-sort-value=370.4937049————
38563402634006240753————————
463364644046441471384603846734————
41848data-sort-value=450.684514543748——————————
data-sort-value=48748718data-sort-value=499.4749922data-sort-value=492.28492284992249325510155161249814
data-sort-value=489.2748913data-sort-value=509.450913data-sort-value=511.1251112data-sort-value=500.250020503175131451414data-sort-value=514.151410
339793257832873——————————
34378——————————————
51075238520952195121551513————
4842050716data-sort-value=511.1351113519105415548254425365
47426data-sort-value=495.41495254932649523data-sort-value=497.24972049622511155179
390603986640460——————————
data-sort-value=474.8347525data-sort-value=500.0450020506165141451314data-sort-value=504.1950419data-sort-value=503.195031949016
43044data-sort-value=451.3745144454444534046637459374453244724
34477——————————————
54045514548256125552data-sort-value=547.03547355015601
data-sort-value=472.7847328data-sort-value=481.084813647737477374902749126data-sort-value=490.254902548817
45937data-sort-value=495.19495264883149325507165061651513data-sort-value=514.151410
data-sort-value=365.5336670data-sort-value=378.67379723866637560data-sort-value=371.5537155391473603736734
49211data-sort-value=499.6350021data-sort-value=504.1850418data-sort-value=501.1850118data-sort-value=487.34873050121data-sort-value=503.250320data-sort-value=503.1250312
4583846341data-sort-value=470.3947039466394473944238——43326
4713048731data-sort-value=490.34903048530data-sort-value=483.334833346236data-sort-value=466.314663145722
37767——————————————
53655276532553665297523953455572
36173data-sort-value=399.764006538067386573875038448————
data-sort-value=425.444254642354460424324540548——————
52765267524755445463data-sort-value=547.04547454235473
data-sort-value=354.96355753667536271——————————
4832149624482344912648234data-sort-value=486.348630data-sort-value=483.274832746321
——3936839663——————————
data-sort-value=475.1547524data-sort-value=481.1948135478364793547735data-sort-value=486.2948629————
——48333data-sort-value=486.33486334902748928data-sort-value=490.27490274932344625
5522558354435385525105258data-sort-value=527.085278——
data-sort-value=408.6940954440474464542148————————
46633data-sort-value=471.724723947935——————————
39557409614085941350data-sort-value=419.4641946406453853638731
data-sort-value=414.24145042155data-sort-value=420.5242052——————————
data-sort-value=424.5942547——————————————
40655data-sort-value=429.6143053data-sort-value=418.5441854410514034939946————
3657136874————————————
493105199512115238526953155384——
4792349427data-sort-value=495.2149521data-sort-value=500.21500215191152210523115374
data-sort-value=388.58389623946737169————————data-sort-value=381.3338133
4683250119502194892849819data-sort-value=490.28490284952249913
data-sort-value=365.7536669——————————————
35774data-sort-value=352.8535376————————————
33880——————————————
39159data-sort-value=399.8440064387653686136557————29236
data-sort-value=354.7235576data-sort-value=352.5735377————————————
data-sort-value=488.964891551610data-sort-value=504.1750417data-sort-value=518.1251812data-sort-value=495.2349523data-sort-value=495.2449524data-sort-value=490.244902447020
data-sort-value=471.914722949228data-sort-value=492.294922948729data-sort-value=487.314873146635data-sort-value=466.34663045423
data-sort-value=414.11414514146040261data-sort-value=376.59376593685631852————
42845data-sort-value=429.92430524444644542data-sort-value=427.424274241542——42629
——48830data-sort-value=494.2349423data-sort-value=482.324823246836476324682947818
4404244846————————————
data-sort-value=388.783896137373————————————
57515692564157315621——————
464354863247538data-sort-value=482.3348233data-sort-value=497.21497214922549821——
48519data-sort-value=508.95091451014data-sort-value=501.195011950118data-sort-value=504.1850418————
data-sort-value=473.1447327data-sort-value=481.3948134data-sort-value=486.324863248431data-sort-value=483.3248332480314852647619
48222data-sort-value=502.3950217data-sort-value=494.24494244783649424502205091651011
5088515115218531753465306data-sort-value=527.095279data-sort-value=529.075297
39458419574155642746data-sort-value=419.4541945417414173543227
————41755——41447——————
————3677038856data-sort-value=371.54371543655135938——
4533945442data-sort-value=420.514205144841445404244042333——
4414145343————————————
43143435504274943444————————
data-sort-value=488.9848914data-sort-value=501.7750218data-sort-value=492.2749227data-sort-value=494.244942449226data-sort-value=495.234952350817data-sort-value=529.075297
4653447837data-sort-value=470.44704048134data-sort-value=487.294872947433data-sort-value=483.284832849315
data-sort-value=408.714095341858data-sort-value=418.534185340952data-sort-value=427.43427434273942234——
36472——————————————
46931——data-sort-value=495.224952251115————————
Science
Country202220182015201220092006
data-sort-type=number Scoreclass=unsortable Rankdata-sort-type=number Scoreclass=unsortable Rankdata-sort-type=number Scoreclass=unsortable Rankdata-sort-type=number Scoreclass=unsortable Rankdata-sort-type=number Scoreclass=unsortable Rankdata-sort-type=number Scoreclass=unsortable Rank
International Average (OECD)data-sort-value=484.65485—489—493—501—501—498—
3767041759427543975839154——
————37672——————
40660data-sort-value=404.07144046543252——————
50710data-sort-value=502.96465031751014data-sort-value=521.145211452795278
data-sort-value=491.2749123data-sort-value=489.780449028data-sort-value=495.264952650621data-sort-value=494.2849428data-sort-value=511.1751117
B-S-J-G————51810——————
B-S-J-Z——5901————————
Bakudata-sort-value=380.1438068data-sort-value=397.649639868————————
——47137————————
data-sort-value=490.5849124data-sort-value=498.773149920data-sort-value=502.250220505225071951018
——data-sort-value=398.497739867————————
data-sort-value=40340362data-sort-value=403.62094046640166402554054939049
4464243150————————
421504245644646446434394243440
CABA————data-sort-value=475.3847538data-sort-value=425.4942549————
34781——————————
515851885287525952975343
444434444544745445444474143839
537451610532452311data-sort-value=520.11520115324
data-sort-value=411.1241154data-sort-value=413.32341362data-sort-value=416.641660399564025038850
data-sort-value=410.9941155416604205842947————
4833147236data-sort-value=475.3747537data-sort-value=491.32491324863549325
data-sort-value=410.9411564394743351——————
4981849721data-sort-value=493.294932950820data-sort-value=500.225002251314
data-sort-value=493.8249420data-sort-value=492.63749325data-sort-value=502.2150221498254992449623
360773367833273——————
data-sort-value=373.1437372——————————
52665304534354155288data-sort-value=531.055315
511952265315545455415631
48726data-sort-value=492.977149324data-sort-value=495.2749527499244982549524
3846638373data-sort-value=411.6341163——————
49222data-sort-value=502.988950316data-sort-value=509.165091652410data-sort-value=520.125201251612
441444524445544467404703847337
data-sort-value=372.9637373——————————
520751795239555154925422
486274813247735data-sort-value=494.3494305032050420
data-sort-value=446.93447414753547339478374962649126
383673967040365382603835539348
data-sort-value=503.85504124962250319data-sort-value=522.1352213data-sort-value=508.185081850819
465374624246740470394553945438
47733data-sort-value=468.01174684048134data-sort-value=494.31494314893347535
data-sort-value=402.9340363——————————
54725295538254735394data-sort-value=531.065316
375714295140964409544154742243
423493976945643data-sort-value=425.484254840053——
52855197516115386538552210
35778data-sort-value=364.88243657537871——————
data-sort-value=493.8449419487294903150223data-sort-value=494.294942949027
——38472data-sort-value=386.6838668——————
data-sort-value=484.464842948231data-sort-value=475.3647536data-sort-value=496.284962849131data-sort-value=488.3148831
——4773448333data-sort-value=491.33491334843648633
543354435296data-sort-value=521.155211551116data-sort-value=511.1651116
41652438484434742050————
466364574346541——————
41057data-sort-value=419.204741957data-sort-value=416.6141661415524164641047
417514285242853——————
41253——————————
data-sort-value=403.134036141561data-sort-value=411.624116241053data-sort-value=401.514015141246
3657637774————————
48825data-sort-value=503.383850315data-sort-value=509.1750917data-sort-value=522.1252212522105259
data-sort-value=504.135041150812data-sort-value=513.12513125161653265307
data-sort-value=379.8838069data-sort-value=413.04474136338470——————
47832data-sort-value=490.4131490274982449529data-sort-value=500.235002348732
36974——————————
38865data-sort-value=364.623836576————————
36875——————————
40859data-sort-value=404.215640464397673736136957——
3567935777————————
data-sort-value=499.164991751111data-sort-value=501.22501225268data-sort-value=508.1750817data-sort-value=498.2249822
data-sort-value=484.374843049226data-sort-value=501.2350123489344933047436
data-sort-value=432.443246data-sort-value=419.12724195841859384593795634952
42848data-sort-value=425.761242655data-sort-value=435.543550439464284341845
——4783348732486354783747934
data-sort-value=447.464474044046————————
3906438671————————
56115512556155125423——
4623846441461424713849032data-sort-value=488.2948829
data-sort-value=499.965001450713data-sort-value=513.1351313data-sort-value=514.18514185121551911
data-sort-value=484.534852848330data-sort-value=493.349330data-sort-value=496.274962748834data-sort-value=488.348830
data-sort-value=493.5549421data-sort-value=499.444749919data-sort-value=493.2849328485364952750321
503134952350618515175171351215
40958data-sort-value=425.81344265342157444454254542144
————data-sort-value=425.5642556——41048——
————data-sort-value=386.693866939857data-sort-value=401.524015238651
47634data-sort-value=468.299646839data-sort-value=425.5542555463414544042442
4503946938————————
data-sort-value=431.9843247434494374844842————
data-sort-value=499.675001550514data-sort-value=509.1550915data-sort-value=514.19514195141451513
data-sort-value=499.41499165021849625497265022148928
43545data-sort-value=425.812742654data-sort-value=435.4943549416514274442841
35580——————————
47235——52585287————
Reading
Country20222018201520122009200620032000
data-sort-type=number Scoreclass=unsortable Rankdata-sort-type=number Scoreclass=unsortable Rankdata-sort-type=number Scoreclass=unsortable Rankdata-sort-type=number Scoreclass=unsortable Rankdata-sort-type=number Scoreclass=unsortable Rankdata-sort-type=number Scoreclass=unsortable Rankdata-sort-type=number Scoreclass=unsortable Rankdata-sort-type=number Scoreclass=unsortable Rank
International Average (OECD)476—487—493—496—493—489—494—493—
3587340561405633945838555————34939
————35071——————————
4015840263data-sort-value=425.5642556——————————
49812data-sort-value=502.6350316data-sort-value=503.1650316data-sort-value=512.12512125158513752545284
data-sort-value=480.4148021data-sort-value=484.3948427data-sort-value=485.3348533data-sort-value=490.26490264703749021data-sort-value=491.2249122data-sort-value=492.1949219
B-S-J-G————49427——————————
B-S-J-Z——5551————————————
Bakudata-sort-value=365.213656938968————————————
——data-sort-value=473.7947436————————————
47923data-sort-value=492.8649322data-sort-value=499.249920data-sort-value=509.165091650610data-sort-value=501.1150111data-sort-value=507.1150711data-sort-value=507.1150711
——40362————————————
data-sort-value=410.364105241357407624075241249data-sort-value=393.47393474033639636
4294440859————————————
40457data-sort-value=419.844205443249436474294240243——43032
CABA————4753842948————————
32981——————————————
5078data-sort-value=520.095206data-sort-value=527.035273data-sort-value=523.0752375245527452835342
448374524345942data-sort-value=441.43441434494144237——41035
data-sort-value=515.175155data-sort-value=502.650317data-sort-value=497.2349723data-sort-value=523.0852384952149615————
4095441258data-sort-value=425.5742557403544134838549————
data-sort-value=415.234155042649data-sort-value=427.5242752data-sort-value=441.4544145————————
data-sort-value=475.547526data-sort-value=478.9947929data-sort-value=487.3148731485334763447729————
38163data-sort-value=424.364245044345——————————
data-sort-value=488.64891749025data-sort-value=487.34873049324478324832548924data-sort-value=492.249220
data-sort-value=488.84891550118data-sort-value=500.1850018data-sort-value=496.234962349522data-sort-value=494.1849418data-sort-value=492.194921949716
351743427635869——————————
data-sort-value=364.936570——————————————
5116523551965161050112data-sort-value=501.1250112————
49014data-sort-value=520.085207526452455362547254315461
data-sort-value=473.8547429data-sort-value=492.6149323data-sort-value=499.194991950519496204882249617data-sort-value=505.1450514
data-sort-value=373.86374673807040165——————————
data-sort-value=479.794802249820data-sort-value=509.1150911data-sort-value=508.185081849718data-sort-value=495.1749517data-sort-value=491.214912148422
438414574246741data-sort-value=477.384773848330460354723047425
data-sort-value=374.1237466——————————————
500115244data-sort-value=527.0252725451533353635109data-sort-value=525.065256
47331data-sort-value=475.994763347040data-sort-value=488.284882849424482264822548023
43642data-sort-value=473.974743548235data-sort-value=483.354833550015data-sort-value=484.2348423data-sort-value=492.249220data-sort-value=507.1250712
data-sort-value=358.573597137172397673965740253data-sort-value=393.46393463823837138
data-sort-value=516.01516251885215data-sort-value=523.06523649619517651565275
data-sort-value=473.8347430data-sort-value=470.424703747937486324743543939——45229
48220data-sort-value=476.2847632data-sort-value=485.3448534data-sort-value=490.254902548627469324762948721
data-sort-value=409.6341053——————————————
data-sort-value=515.855163data-sort-value=503.865041551685383520749814data-sort-value=498.14498145229
data-sort-value=342.17342784195540861399554055140144————
3866138769data-sort-value=427.54427543935939054——————
data-sort-value=515.425154514951775364539155615342data-sort-value=525.075257
data-sort-value=342.1934277data-sort-value=353.0735375data-sort-value=347.7234772——————————
data-sort-value=474.5747527data-sort-value=478.747930488294892748428data-sort-value=479.2747927data-sort-value=491.234912345828
——data-sort-value=353.3635374data-sort-value=347.7334773——————————
47232data-sort-value=475.874763447239data-sort-value=477.37477374683847031————
——data-sort-value=469.994703848136data-sort-value=488.34883047236data-sort-value=479.28479284792744130
51075253data-sort-value=509.1250912data-sort-value=509.15509154872649220data-sort-value=498.1549815——
38860415564315039856————————
445394484444744——————————
data-sort-value=415.3641549data-sort-value=420.4742053423584244942544410424003742234
41151data-sort-value=423.994245141659——————————
37865——————————————
4055642152data-sort-value=427.5542755422504085039248————
3397935973————————————
4593548526data-sort-value=503.1550315511135089data-sort-value=507.1507105138——
50110data-sort-value=505.7350612data-sort-value=509.150910data-sort-value=512.11512115216521552255293
data-sort-value=358.5235972data-sort-value=392.673936735270————————37337
data-sort-value=476.52477254991951395042050311data-sort-value=484.244842450012data-sort-value=505.1350513
34975——————————————
3925937771————————————
37368——————————————
4085540164398663846137057————32740
3477634077————————————
data-sort-value=488.7148916512105061351895001450884971647924
data-sort-value=476.594772449224data-sort-value=498.2149821data-sort-value=488.314883148925472304782847026
419474076040264388603725631251————
data-sort-value=428.54284542847data-sort-value=434.4743447438464244539645——42833
——data-sort-value=478.54793149526data-sort-value=475.44754045940440384423246227
4404043945————————————
3836239965————————————
54315492535154225264——————
44738458414534346341477334663346931——
4693349521505144813648329data-sort-value=494.1949419————
data-sort-value=474.3147428——49625data-sort-value=488.2948829481314613448126data-sort-value=493.1849318
48718data-sort-value=505.7950611data-sort-value=500.1750017data-sort-value=483.344833449717data-sort-value=507.095079514751610
48319data-sort-value=483.934842849228data-sort-value=509.145091450113499134991349417
37964data-sort-value=392.893936640960data-sort-value=441.444414442146417404203543131
————data-sort-value=427.5342753——41647——————
————3616840453404523805037539——
45636data-sort-value=465.634664042851data-sort-value=475.3947539464394473644133——
data-sort-value=427.5342846data-sort-value=465.9546639————————————
4174843246data-sort-value=434.484344844242————————
49413data-sort-value=503.9350414data-sort-value=498.22498224992149423data-sort-value=495.1649516data-sort-value=507.1507105238
504950513data-sort-value=497.24497244982250016——4951850415
43043427484374641151426434134143434——
33680——————————————
46234——data-sort-value=487.3248732data-sort-value=508.1750817————————

Previous years

See main article: Programme for International Student Assessment (2000 to 2012).

PeriodFocusOECD countriesPartner countriesParticipating studentsNotes
2000Reading284 + 11265,000The Netherlands disqualified from data analysis. 11 additional non-OECD countries took the test in 2002.
2003Mathematics3011275,000UK disqualified from data analysis, due to its low response rate.[33] Also included test in problem solving.
2006Science3027400,000Reading scores for US disqualified from analysis due to misprint in testing materials.
2009Reading3441 + 10470,00010 additional non-OECD countries took the test in 2010.
2012Mathematics3537510,000
2015Science3431509,000
2018Reading3742600,000
2022Mathematics3744690,000

Reception

China

China's participation in the 2012 test was limited to Shanghai, Hong Kong, and Macau as separate entities. In 2012, Shanghai participated for the second time, again topping the rankings in all three subjects, as well as improving scores in the subjects compared to the 2009 tests. Shanghai's score of 613 in mathematics was 113 points above the average score, putting the performance of Shanghai pupils about 3 school years ahead of pupils in average countries. Educational experts debated to what degree this result reflected the quality of the general educational system in China, pointing out that Shanghai has greater wealth and better-paid teachers than the rest of China.[34] Hong Kong placed second in reading and science and third in maths.

Andreas Schleicher, PISA division head and co-ordinator, stated that PISA tests administered in rural China have produced some results approaching the OECD average. Citing further as-yet-unpublished OECD research, he said, "We have actually done Pisa in 12 of the provinces in China. Even in some of the very poor areas you get performance close to the OECD average." Schleicher believes that China has also expanded school access and has moved away from learning by rote, performing well in both rote-based and broader assessments.

In 2018 the Chinese provinces that participated were Beijing, Shanghai, Jiangsu and Zhejiang. In 2015, the participating provinces were Jiangsu, Guangdong, Beijing, and Shanghai.[35] The 2015 Beijing-Shanghai-Jiangsu-Guangdong cohort scored a median 518 in science in 2015, while the 2012 Shanghai cohort scored a median 580.

Critics of PISA counter that in Shanghai and other Chinese cities, most children of migrant workers can only attend city schools up to the ninth grade, and must return to their parents' hometowns for high school due to hukou restrictions, thus skewing the composition of the city's high school students in favor of wealthier local families. A population chart of Shanghai reproduced in The New York Times shows a steep drop off in the number of 15-year-olds residing there.[36] According to Schleicher, 27% of Shanghai's 15-year-olds are excluded from its school system (and hence from testing). As a result, the percentage of Shanghai's 15-year-olds tested by PISA was 73%, lower than the 89% tested in the US.[37] Following the 2015 testing, OECD published in depth studies on the education systems of a selected few countries including China.[38]

In 2014, Liz Truss, then the British Parliamentary Under-Secretary of State at the Department for Education, led a fact-finding visit to schools and teacher-training centres in Shanghai.[39] Britain increased exchanges with Chinese teachers and schools to find out how to improve quality. In 2014, 60 teachers from Shanghai were invited to the UK to help share their teaching methods, support pupils who are struggling, and help to train other teachers.[40] In 2016, Britain invited 120 Chinese teachers, planning to adopt Chinese styles of teaching in 8,000 aided schools.[41] By 2019, approximately 5,000 of Britain's 16,000 primary schools had adopted the Shanghai's teaching methods.[42] The performance of British schools in PISA improved after adopting China's teaching styles.[43] [44]

Finland

Finland, which received several top positions in the first tests, fell in all three subjects in 2012, but remained the best performing country overall in Europe, achieving their best result in science with 545 points (5th) and worst in mathematics with 519 (12th) in which the country was outperformed by four other European countries. The drop in mathematics was 25 points since 2003, the last time mathematics was the focus of the tests. For the first time Finnish girls outperformed boys in mathematics narrowly. It was also the first time pupils in Finnish-speaking schools did not perform better than pupils in Swedish-speaking schools. Former minister of Education and Science Krista Kiuru expressed concern for the overall drop, as well as the fact that the number of low-performers had increased from 7% to 12%.[45]

India

India participated in the 2009 round of testing but pulled out of the 2012 PISA testing, with the Indian government attributing its action to the unfairness of PISA testing to Indian students.[46] India had ranked 72nd out of 73 countries tested in 2009.[47] The Indian Express reported, "The ministry (of education) has concluded that there was a socio-cultural disconnect between the questions and Indian students. The ministry will write to the OECD and drive home the need to factor in India's "socio-cultural milieu". India's participation in the next PISA cycle will hinge on this".[48] The Indian Express also noted that "Considering that over 70 nations participate in PISA, it is uncertain whether an exception would be made for India".

India did not participate in the 2012, 2015 and 2018 PISA rounds.[49]

A Kendriya Vidyalaya Sangathan (KVS) committee as well as a group of secretaries on education constituted by the Prime Minister of India Narendra Modi recommended that India should participate in PISA. Accordingly, in February 2017, the Ministry of Human Resource Development under Prakash Javadekar decided to end the boycott and participate in PISA from 2020. To address the socio-cultural disconnect between the test questions and students, it was reported that the OECD will update some questions. For example, the word avocado in a question may be replaced with a more popular Indian fruit such as mango.[50]

India did not participate in the 2022 PISA rounds citing due to COVID-19 pandemic disruption.[51]

Malaysia

In 2015, the results from Malaysia were found by the OECD to have not met the maximum response rate.[52] Opposition politician Ong Kian Ming said the education ministry tried to oversample high-performing students in rich schools.[53] [54]

Sweden

Sweden's result dropped in all three subjects in the 2012 test, which was a continuation of a trend from 2006 and 2009. It saw the sharpest fall in mathematics performance with a drop in score from 509 in 2003 to 478 in 2012. The score in reading showed a drop from 516 in 2000 to 483 in 2012. The country performed below the OECD average in all three subjects.[55] The leader of the opposition, Social Democrat Stefan Löfven, described the situation as a national crisis.[56] Along with the party's spokesperson on education, Ibrahim Baylan, he pointed to the downward trend in reading as most severe.[56]

In 2020, Swedish newspaper Expressen revealed that Sweden had inflated their score in PISA 2018 by not conforming to OECD standards. According to professor Magnus Henrekson a large number of foreign-born students had not been tested.[57]

United Kingdom

In the 2012 test, as in 2009, the result was slightly above average for the United Kingdom, with the science ranking being highest (20). England, Wales, Scotland and Northern Ireland also participated as separated entities, showing the worst result for Wales which in mathematics was 43rd of the 65 countries and economies. Minister of Education in Wales Huw Lewis expressed disappointment in the results, said that there were no "quick fixes", but hoped that several educational reforms that have been implemented in the last few years would give better results in the next round of tests.[58] The United Kingdom had a greater gap between high- and low-scoring students than the average. There was little difference between public and private schools when adjusted for socio-economic background of students. The gender difference in favour of girls was less than in most other countries, as was the difference between natives and immigrants.

Writing in the Daily Telegraph, Ambrose Evans-Pritchard warned against putting too much emphasis on the UK's international ranking, arguing that an overfocus on scholarly performances in East Asia might have contributed to the area's low birthrate, which he argued could harm the economic performance in the future more than a good PISA score would outweigh.[59]

In 2013, the Times Educational Supplement (TES) published an article, "Is PISA Fundamentally Flawed?" by William Stewart, detailing serious critiques of PISA's conceptual foundations and methods advanced by statisticians at major universities.[60]

In the article, Professor Harvey Goldstein of the University of Bristol was quoted as saying that when the OECD tries to rule out questions suspected of bias, it can have the effect of "smoothing out" key differences between countries. "That is leaving out many of the important things," he warned. "They simply don't get commented on. What you are looking at is something that happens to be common. But (is it) worth looking at? PISA results are taken at face value as providing some sort of common standard across countries. But as soon as you begin to unpick it, I think that all falls apart."

Queen's University Belfast mathematician Dr. Hugh Morrison stated that he found the statistical model underlying PISA to contain a fundamental, insoluble mathematical error that renders Pisa rankings "valueless".[61] Goldstein remarked that Dr. Morrison's objection highlights "an important technical issue" if not a "profound conceptual error". However, Goldstein cautioned that PISA has been "used inappropriately", contending that some of the blame for this "lies with PISA itself. I think it tends to say too much for what it can do and it tends not to publicise the negative or the weaker aspects." Professors Morrison and Goldstein expressed dismay at the OECD's response to criticism. Morrison said that when he first published his criticisms of PISA in 2004 and also personally queried several of the OECD's "senior people" about them, his points were met with "absolute silence" and have yet to be addressed. "I was amazed at how unforthcoming they were," he told TES. "That makes me suspicious." "Pisa steadfastly ignored many of these issues," he says. "I am still concerned."

Professor Svend Kreiner, of the University of Copenhagen, agreed: "One of the problems that everybody has with PISA is that they don't want to discuss things with people criticising or asking questions concerning the results. They didn't want to talk to me at all. I am sure it is because they can't defend themselves.[60]

United States

Since 2012 a few states have participated in the PISA tests as separate entities. Only the 2012 and 2015 results are available on a state basis. Puerto Rico participated in 2015 as a separate US entity as well.

2012 US State results! style="background:#ceceee;"
MathematicsScienceReading
514
506
US Average481
467
527
521
US Average497
485
527
521
US Average498
492
2015 US State results! style="background:#ceceee;"
MathematicsScienceReading
500
471
US Average470
378
529
502
US Average496
403
527
500
US Average497
410

PISA results for the United States by race and ethnicity

Mathematics
Race2022[62] 201820152012200920062003[63]
Scoredata-sort-type=number Scoredata-sort-type=number Scoredata-sort-type=number Scoredata-sort-type=number Scoredata-sort-type=number Scoredata-sort-type=number Score
Asian543539498549524494506
White498503499506515502512
US Average465478470481487474483
More than one race476474475492487482502
Hispanic439452446455453436443
Other——423436460446446
Black412419419421423404417
Science
Race2022[64] 20182015[65] 201220092006
Scoredata-sort-type="number" Scoredata-sort-type="number" Scoredata-sort-type="number" Scoredata-sort-type="number" Scoredata-sort-type="number" Score
Asian578551525546536499
White537529531528532523
US Average499502496497502489
More than one race513502503511503501
Hispanic471478470462464439
Other——462439465453
Black445440433439435409
Reading
Race2022[66] 2018[67] 201520122009200620032000
Scoredata-sort-type=number Scoredata-sort-type=number Scoredata-sort-type=number Scoredata-sort-type=number Scoredata-sort-type=number Scoredata-sort-type=number Scoredata-sort-type=number Score
Asian579556527550541—513546
White537531526519525—525538
US Average504505497498500—495504
More than one race512501498517502—515—
Hispanic481481478478466—453449
Black459448443443441—430445
Other——440438462—456455

Research on possible causes of PISA disparities in different countries

Although PISA and TIMSS officials and researchers themselves generally refrain from hypothesizing about the large and stable differences in student achievement between countries, since 2000, literature on the differences in PISA and TIMSS results and their possible causes has emerged.[68] Data from PISA have furnished several researchers, notably Eric Hanushek, Ludger Wößmann, Heiner Rindermann, and Stephen J. Ceci, with material for books and articles about the relationship between student achievement and economic development, democratization, and health; as well as the roles of such single educational factors as high-stakes exams,[69] the presence or absence of private schools and the effects and timing of ability tracking.

Critics and comments on accuracy

David Spiegelhalter of Cambridge wrote: "Pisa does present the uncertainty in the scores and ranks - for example the United Kingdom rank in the 65 countries is said to be between 23 and 31. It's unwise for countries to base education policy on their Pisa results, as Germany, Norway and Denmark did after doing badly in 2001."[70]

According to Forbes, an American media outlet, in an opinion article, some countries such as China, Hong Kong, Macau, and Argentina select PISA samples from only the best-educated areas or from their top-performing students, slanting the results.[71]

According to an open letter to Andreas Schleicher, director of PISA, various academics and educators argued that "OECD and Pisa tests are damaging education worldwide".[72]

According to O Estado de São Paulo, Brazil shows a great disparity when classifying the results between public and private schools, where public schools would rank worse than Peru, while private schools would rank better than Finland.[73]

According to a 2023 book, PISA is failing in its mission. It suggests that flatlined student outcomes and policy shortcomings have much to do with PISA's implicit ideological biases, structural impediments such as union advocacy, and conflicts of interest.[74]

See also

External links

Notes and References

  1. Web site: About PISA. OECD PISA. 8 February 2018.
  2. Book: Berger. Kathleen. Invitation to The Life Span. 3 March 2014. worth. 978-1-4641-7205-2. second.
  3. Web site: December 2023 . PISA 2022 Results . live . https://web.archive.org/web/20231205105335/https://www.oecd.org/publication/pisa-2022-results/ . December 5, 2023 . December 15, 2023 . OECD.
  4. The use of external assessments and the impact on education systems. Rey. O. CIDREE Yearbook. 2010. 22 November 2019. https://web.archive.org/web/20170203230616/http://www.cidree.org/publications/yearbook_2010?PHPSESSID=baip221utd9v77b89hov0s3al6. 3 February 2017. dead.
  5. McGaw. B. 2008. The role of the OECD in international comparative studies of achievement. Assessment in Education: Principles, Policy & Practice. 15. 3. 223–243. 10.1080/09695940802417384.
  6. Kijima . Rie . Lipscy . Phillip Y. . 2024-01-01 . The politics of international testing . The Review of International Organizations . en . 19 . 1 . 1–31 . 10.1007/s11558-023-09494-4 . 1559-744X. free .
  7. Ramirez . Francisco O. . Schofer . Evan . Meyer . John W. . 2018 . International Tests, National Assessments, and Educational Development (1970–2012) . Comparative Education Review . en . 62 . 3 . 344–364 . 10.1086/698326 . 0010-4086. subscription .
  8. Kamens . David H.. McNeely . Connie L.. 2010 . Globalization and the Growth of International Educational Testing and National Assessment . Comparative Education Review . en . 54 . 1 . 5–25 . 10.1086/648471 . 0010-4086. subscription .
  9. 40 countries participated back then, and 81 countries and economies participated in the 2022 data collection.
  10. Mons. N. 2008. Évaluation des politiques éducatives et comparaisons internationales. Revue française de pédagogie. fr. 164. July–August–September 2008. 5–13. 10.4000/rfp.1985.
  11. Breakspear . S. . The Policy Impact of PISA: An Exploration of the Normative Effects of International Benchmarking in School System Performance . OECD Education Working Paper . 71 . 2012 . 10.1787/5k9fdfqffr28-en . OECD Education Working Papers . free .
  12. Barroso. J.. de Carvalho. L.M.. 2008. Pisa: Un instrument de régulation pour relier des mondes. Revue française de pédagogie. fr. 164. 164 . 77–80. 10.4000/rfp.2133 .
  13. Martens . Kerstin . Niemann . Dennis . 2013 . When Do Numbers Count? The Differential Impact of the PISA Rating and Ranking on Education Policy in Germany and the US . German Politics . en . 22 . 3 . 314–332 . 10.1080/09644008.2013.794455 . 0964-4008.
  14. Ertl . H. . 2006 . Educational standards and the changing discourse on education: the reception and consequences of the PISA study in Germany . Oxford Review of Education . 32 . 5 . 619–634 . 10.1080/03054980600976320 . 144656964 .
  15. Web site: https://web.archive.org/web/20170202010611/http://www.knowandpol.eu/IMG/pdf/pisa.wp12.hungary.pdf. Bajomi. I.. Berényi. E.. Neumann. E.. Vida. J.. 2009. The Reception of PISA in Hungary' accessed January 2017. Knowledge and Policy. en. 2017-02-02. dead.
  16. Steiner-Khamsi (2003), cited by Breakspear . S. . The Policy Impact of PISA: An Exploration of the Normative Effects of International Benchmarking in School System Performance . OECD Education Working Paper . 71 . 2012 . 10.1787/5k9fdfqffr28-en . OECD Education Working Papers . free .
  17. Mangez . Eric . Cattonar . Branka. The status of PISA in the relationship between civil society and the educational sector in French-speaking Belgium. Sísifo: Educational Sciences Journal. Educational Sciences R&D Unit of the University of Lisbon. 10. September–December 2009. 1646-6500. 15–26. 26 December 2017.
  18. Greger. D.. 2008. Lorsque PISA importe peu. Le cas de la République Tchèque et de l'Allemagne. Revue française de pédagogie. fr. 164. 164 . 91–98. 10.4000/rfp.2138 . cited in
  19. Afonso. Natércio. Costa. Estela. The influence of the Programme for International Student Assessment (PISA) on policy decision in Portugal: the education policies of the 17th Portuguese Constitutional Government. Sísifo: Educational Sciences Journal. Educational Sciences R&D Unit of the University of Lisbon. 10. September–December 2009. 1646-6500. 53–64. 26 December 2017.
  20. Rautalin . M. . Alasuutari . 2009 . The uses of the national PISA results by Finnish officials in central government . Journal of Education Policy . 24 . 5 . 539–556 . 10.1080/02680930903131267 . 154584726 .
  21. Egelund. N.. 2008. The value of international comparative studies of achievement – a Danish perspective. Assessment in Education: Principles, Policy & Practice. en. 15. 3. 245–251. 10.1080/09695940802417400.
  22. Book: Behrens, M.. 2006. Préface. Mons. N.. Pons. X.. Les standards en éducation dans le monde francophone. fr. Neuchâtel. IRDP. cited in
  23. Web site: Hefling. Kimberly. 3 December 2013. Asian nations dominate international test. Yahoo!. https://web.archive.org/web/20131205192442/https://news.yahoo.com/asian-nations-dominate-international-test-100159386.html. 5 December 2013. dead.
  24. Web site: Chapter 2 of the publication 'PISA 2003 Assessment Framework' . Pisa.oecd.org . https://web.archive.org/web/20051217041324/http://www.pisa.oecd.org/dataoecd/38/52/33707212.pdf . 17 December 2005 . dead .
  25. PISA, we have a problem…. Keeley. B.. https://web.archive.org/web/20210617031839/https://oecdinsights.org/2014/04/01/pisa-we-have-a-problem/ . 17 June 2021 . dead . OECD Insights. April 2014.
  26. Web site: Poddiakov. Alexander. Alexander Poddiakov. Complex Problem Solving at PISA 2012 and PISA 2015: Interaction with Complex Reality. SSRN. en. // Translated from Russian. Reference to the original Russian text: Poddiakov. A.. 2012. Reshenie kompleksnykh problem v PISA-2012 i PISA-2015: vzaimodeistvie so slozhnoi real'nost'yu. Obrazovatel'naya Politika. ru. 6. 34–53.
  27. Web site: C.. Füller. Pisa hat einen kleinen, fröhlichen Bruder. taz. de. 5 December 2007.
  28. Web site: Learning Data QEdu Países. . 2024-05-21 . paises.qedu.org.br.
  29. Web site: PISA 2022 Participants . 21 May 2024 . OECD – PISA.
  30. Book: OECD . PISA 2022 Results (Volume I): The State of Learning and Equity in Education . 2023 . Organisation for Economic Co-operation and Development . Paris . en . 10.1787/53f23881-en. 978-92-64-99796-7 .
  31. Web site: PISA 2022 Results. en. OECD. 2023.
  32. PISA 2018 Results. en. OECD. 2019. 10.1787/888934028140.
  33. Jerrim . John . 2021 . PISA 2018 in England, Northern Ireland, Scotland and Wales: Is the data really representative of all four corners of the UK? . Review of Education . en . 9 . 3 . 10.1002/rev3.3270 . 2049-6613. free .
  34. News: Tom. Phillips. 3 December 2013. OECD education report: Shanghai's formula is world-beating. The Telegraph. 8 December 2013.
  35. News: Pisa tests to include many more Chinese pupils. Sean. Coughlan. BBC News. 26 August 2014.
  36. News: Shanghai Test Scores and the Mystery of the Missing Children. Helen. Gao. New York Times. 23 January 2014. For Schleicher's initial response to these criticisms see his post, Web site: Are the Chinese Cheating in PISA Or Are We Cheating Ourselves?. OECD's website blog. Education Today. 10 December 2013. https://web.archive.org/web/20140217073353/http://oecdeducationtoday.blogspot.com/2013/12/are-chinese-cheating-in-pisa-or-are-we.html. 17 February 2014. dead.
  37. Web site: More than a quarter of Shanghai pupils missed by international Pisa rankings. William . Stewart . Times Educational Supplement. 6 March 2014 . 7 March 2014 . https://web.archive.org/web/20140315122619/http://news.tes.co.uk/b/news/2014/03/05/more-than-a-quarter-of-shanghai-pupils-missed-by-pisa.aspx . 15 March 2014 . dead.
  38. Web site: Education in China. A Snapshot. 2016. OECD. https://web.archive.org/web/20161206135204/http://www.oecd.org/china/Education-in-China-a-snapshot.pdf. 6 December 2016. dead.
  39. News: Howse. Patrick. 18 February 2014. Shanghai visit for minister to learn maths lessons. BBC News. 19 July 2014.
  40. News: Coughlan. Sean. 2014-03-12. Shanghai teachers flown in for maths. en-GB. BBC News. 2020-08-11.
  41. News: 20 July 2016. Britain invites 120 Chinese Maths teachers for aided schools. India Today. 12 August 2020.
  42. Web site: Scores bolster case for Shanghai math in British schools The Star. 2020-08-11. www.thestar.com.my. 10 December 2019 .
  43. News: Turner. Camilla. 2019-12-03. Britain jumps up international maths rankings following Chinese-style teaching. en-GB. The Telegraph. 2020-08-11. 0307-1235.
  44. Web site: Starkey. Hannah. 2019-12-05. UK Boost International Maths Ranking After Adopting Chinese-Style Teaching. 2020-08-11. True Education Partnerships. en-GB. https://web.archive.org/web/20200803115542/https://www.trueeducationpartnerships.com/schools/uk-improves-international-maths-ranking-adopting-chinese-style-teaching/. 3 August 2020.
  45. Web site: PISA 2012: Proficiency of Finnish youth declining. University of Jyväskylä. en. 9 December 2013. https://web.archive.org/web/20131213093458/https://www.jyu.fi/en/news/archive/2013/12/tiedote-2013-12-03-13-00-33-394036. 13 December 2013. dead.
  46. Web site: Hemali Chhapia, TNN . India backs out of global education test for 15-year-olds . https://web.archive.org/web/20130429183202/http://articles.timesofindia.indiatimes.com/2012-08-03/mumbai/33019239_1_india-backs-global-stage-math-and-science . dead . 29 April 2013 . . 3 August 2012.
  47. Web site: PISA (Program for International Student Assessment): OECD. Drishti. 1 Sep 2021.
  48. Web site: Poor PISA score: Govt blames 'disconnect' with India . The Indian Express . 3 September 2012.
  49. Web site: India chickens out of international students assessment programme again . The Times of India . 1 June 2013.
  50. News: PISA Tests: India to take part in global teen learning test in 2021. 19 May 2018. The Indian Express. 22 February 2017.
  51. Web site: 2024-01-10 . India opts out of PISA 2022: Prudence or Cowardice? . 2024-07-27 . EducationWorld . en-US.
  52. Web site: Ong: Did ministry try to rig results for Pisa 2015 report?. 8 December 2016.
  53. Web site: Who's telling the truth about M'sia's Pisa 2015 scores?. 9 December 2016.
  54. Web site: Malaysian PISA results under scrutiny for lack of evidence. School Advisor. 8 December 2016. 2024-12-06. 2025-01-07. https://web.archive.org/web/20241206123515/https://schooladvisor.my/news/malaysian-pisa-results-scrutiny-lack-evidence. dead.
  55. Web site: Lars. Näslund. 3 December 2013. Svenska skolan rasar i stor jämförelse. Expressen. 4 December 2013. sv.
  56. Web site: Jens. Kärrman. 3 December 2013. Löfven om Pisa: Nationell kris. Dagens Nyheter. 8 December 2013. sv.
  57. Web site: Sveriges PISA-framgång bygger på falska siffror. 2 June 2020. sv .
  58. Web site: Pisa ranks Wales' education the worst in the UK. BBC. 3 December 2013. 4 December 2013.
  59. Web site: Ambrose. Evans-Pritchard. 3 December 2013. OECD educational report: Pisa fever is causing east Asia's demographic collapse. Telegraph.co.uk. https://web.archive.org/web/20131203212440/http://blogs.telegraph.co.uk/finance/ambroseevans-pritchard/100026127/oecd-educational-report-pisa-fever-is-causing-east-asias-demographic-collapse/ . 4 December 2013. 3 December 2013 .
  60. Web site: Is Pisa fundamentally flawed? . William . Stewart . Times Educational Supplement . 26 July 2013 . 26 July 2013 . https://web.archive.org/web/20130823053048/http://www.tes.co.uk/article.aspx?storycode=6344672 . 23 August 2013 . dead.
  61. Web site: Morrison. Hugh. A fundamental conundrum in psychology's standard model of measurement and its consequences for PISA global rankings. 2013. 13 July 2017. dead. https://web.archive.org/web/20130605225916/http://www.qub.ac.uk/schools/SchoolofEducation/AboutUs/Staff/Academic/DrHughMorrison/Filestore/Filetoupload,387514,en.pdf. 5 June 2013.
  62. Web site: Average scores of U.S. 15-year-old students on the PISA mathematics literacy scale by race/ethnicity: 2022.
  63. Web site: Average scores among 15-year-olds on the Program for International Student Assessment (PISA) mathematics literacy assessment, by participating country and race/ethnicity in the United States: 2003.
  64. Web site: Average scores of U.S. 15-year-old students on the PISA science literacy scale by race/ethnicity: 2022.
  65. Web site: Average scores of U.S. 15-year-old students on the PISA science literacy scale, by race/ethnicity: 2015.
  66. Web site: Average scores of U.S. 15-year-old students on the PISA reading literacy scale by race/ethnicity: 2022.
  67. Web site: Highlights of U.S. PISA 2018 Results Web Report.
  68. Book: Hanushek. Eric A.. Ludger. Woessmann. 2011. The economics of international differences in educational achievement. Handbook of the Economics of Education. 3. Eric A.. Hanushek. Stephen. Machin. Ludger. Woessmann. Amsterdam. North Holland. 89–200.
  69. John H. Bishop. 1997. The effect of national standards and curriculum-based exams on achievement . . Papers and Proceedings . 87. 2. 260–264 . 2950928 .
  70. News: How accurate is the Pisa test?. Ruth. Alexander. BBC News. 10 December 2013. 22 November 2019.
  71. Web site: Are The PISA Education Results Rigged?. Capital. Flows. Forbes. 22 November 2019.
  72. News: OECD and Pisa tests are damaging education worldwide – academics. Guardian Staff. The Guardian . 6 May 2014. 22 November 2019. www.theguardian.com.
  73. Web site: Escolas privadas de elite do Brasil superam Finlândia no Pisa, rede pública vai pior do que o Peru.. Rafael. Cafardo. 4 December 2019. 4 December 2019. www.estadao.com.br.
  74. Book: Dire Straits: Education Reforms, Ideology, Vested Interests and Evidence. Montserrat Gomendio . José Ignacio Wert . 10.11647/OBP.0332. 2023. 978-1-80064-930-9 . 256890161 . free .

This article is licensed under the GNU Free Documentation License. It uses material from the Wikipedia article "Programme for International Student Assessment".

Except where otherwise indicated, Everything.Explained.Today is © Copyright 2009-2026, A B Cryer, All Rights Reserved. Cookie policy.