Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Kan man räkna med PISA och TIMSS?: Relevansen hos internationella storskaliga mätningar i matematik i en nationell kontext
Stockholm University, Faculty of Science, Department of Mathematics and Science Education. (PRIM-gruppen)ORCID iD: 0000-0002-9676-9521
2019 (Swedish)Doctoral thesis, monograph (Other academic)Alternative title
Can we count on PISA and TIMSS? : The relevance of international large-scale assessments in mathematics in a national context (English)
Abstract [en]

The overall purpose of the thesis is to contribute to the knowledge of relevance of international large-scale assessments (ILSAs) in mathematics, when these are to be used and interpreted in a national context. If a nation is to engage in ILSAs, draw conclusions from them and act on them, one should be aware of what they are measuring and how well it fits in with the national mathematics education and the mathematics they are trying to teach their students.

The relevance is linked to the validity of the ILSA, which means that the assessment should measure the right things and do that in such a way that the results are as informative and useful as possible. In this thesis, the Swedish context is used as an example of a national context, against which the ILSAs PISA and TIMSS are contrasted.

One way to study validation is to use an argumentation-based validation method, Assessment Utilization Argument. In this model, an argument consists of making claims on the basis of data and warrants. The claim is an interpretation of assessment results and the assertion of a claim carries with it the duty to support the claim and, if challenged, to defend it. Warrants are created and functions as propositions to justify the inferences from the data that lead to the claim.

The ILSAs have been contrasted with the Swedish context through studies in three areas; content of the assessments, implementation of the assessments and results from the assessments. Based on these areas, the frameworks and tests from ILSAs were analyzed and compared with policy document and national tests from the Swedish context. Warrants were created based on these three areas.

The analysis of the warrants showed that the ILSAs had a high level of conformity with the Swedish context and the ILSAs coincide in such a way that the results from these are relevant for studying the development of performance in a Swedish context. The analysis also showed that certain content and abilities in the Swedish context were not covered by the ILSAs. The Swedish students do not have the opportunity to show all those skills that the Swedish mathematical context covers and there were also indications that they do not make full efforts to show their skills. In order to create a more complete picture of Swedish students' mathematical skills, the assessment of students’ skills in mathematics should be complemented with other assessments.

The results are discussed in relation to the development of national policy documents, including the risk if a nation decides to adapt their policy document to the ILSAs. In the case of Sweden there are indications that policy document develops in the same direction and closer to the frameworks of ILSAs. It becomes important to thoroughly examine the relationship between the ILSAs and a national context so that one can be aware of how, if and it what way the large-scale assessment impact a national context.

This thesis contributes to a holistic approach based on a national context, with an overall method and covers the areas content, implementation and results of the ILSAs. It shows that opportunities and limitations can be found in all of these three areas. When the results of ILSAs are to be used in a national context, it is important to thoroughly examine what is meant to be assessed and what is really being assessed in these studies and to compare it with the purposes and content of the national context, so that suitable and valid conclusions could be drawn.

Place, publisher, year, edition, pages
Stockholm: Institutionen för matematikämnets och naturvetenskapsämnenas didaktik, Stockholms universitet , 2019. , p. 213
Series
Doctoral thesis from the department of mathematics and science education ; 21
Keywords [en]
International large-scale assessment, Mathematics, Validity, Validation, Relevance, Assessment, PISA, TIMSS, Mathematics education
National Category
Didactics
Research subject
Mathematics Education
Identifiers
URN: urn:nbn:se:su:diva-167442ISBN: 978-91-7797-731-5 (print)ISBN: 978-91-7797-732-2 (electronic)OAI: oai:DiVA.org:su-167442DiVA, id: diva2:1304859
Public defence
2019-06-10, Vivi Täckholmsalen (Q-salen) NPQ-huset, Svante Arrhenius väg 20 A, Stockholm, 10:00 (Swedish)
Opponent
Supervisors
Available from: 2019-05-16 Created: 2019-04-15 Last updated: 2019-05-06Bibliographically approved

Open Access in DiVA

Kan man räkna med PISA och TIMSS?(4850 kB)240 downloads
File information
File name FULLTEXT01.pdfFile size 4850 kBChecksum SHA-512
d646607acedaf794cee173de00d4b2063cd3e4007ea6de45a7343cf004c325ff257ef56f565e0fa6b04b36de83911c74caf44775995b48b9a2bb7dca7f45e2c8
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Sollerman, Samuel
By organisation
Department of Mathematics and Science Education
Didactics

Search outside of DiVA

GoogleGoogle Scholar
Total: 240 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 1383 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf