Wolfram Schulz & Julian Fraillon

What is ICILS 2018 about?

ICILS is a large-scale, international assessment of grade 8 students’ computer and information literacy and computational thinking skills. It addresses a question of critical importance: how well are students prepared for study, work, and life in a digital world? 46,000 students and 26,000 teachers from more than 2,200 schools in 12 countries and two sub-regions took part in ICILS 2018.

ICILS assesses the core knowledge, skills and understanding students need to succeed in our dynamic information environment using authentic tasks in a computer-based environment. ICILS provides countries with reliable, comparable data about young people’s development of 21st century computer and information literacy (CIL) skills. In addition, ICILS is unique in offering participating countries the option of directly assessing computational thinking (CT) skills of students. ICILS further collects data from schools, teachers and students about students’ use of and opportunities to use ICT.

What does ICILS 2018 say about students’ CIL?

ICILS data and test content were used to describe four levels of student CIL proficiciency. The first proficiency level reflects only very basic familiarity and functional working knowledge, while subsequent levels (Level 2 and above) indicate more complete knowledge and skills ranging from basic and explicit information-gathering and management tasks to high-level capacity such as creating sophisticated information products.

Figure 1. Percentages of students with CIL below Level 2 and at Level 2 and above.
Notes. ¹ National defined population covers 90% to 95% of the national target population; † Met guidelines for sampling participation rates only after replacement schools were included; †† Nearly met guidelines for sampling participation rates after replacement schools were included.

Figure 1 shows the percentages of grade 8 students in participating countries who demonstrated only basic familiarity with computer and information technology or even less knowledge and understanding (Below Level 2) and those who were able to show more complete skills in this learning area (Level 2 and above). Across participating countries more than 40% had only basic familiarity with computer and information technology and there were large differences between countries with national percentages of grade 8 students with more complete CIL skills ranging from over 80% to only about 20%.

While these figures show large differences between countries, it is also important to highlight the large gaps within countries: The difference between the highest and lowest average CIL scores across countries was 157 scale points. Within countries, the gap separating the average CIL scores of the top and bottom 5% of students ranged from 216 (Denmark) to 347 scale points (Kazakhstan). The results of this second cycle of the study call into question the generalization that young people are “digital natives” who through exposure to the use of digital devices develop expertise in their use. Data collected by this study demonstrate that providing students and their teachers with information and communications technology (ICT) equipment alone does not automatically result in the development of sophisticated digital literacy skills. Students need to be taught how to use computers effectively, and their teachers need to be supported in their use of ICT in teaching.

More information about ICILS 2018:

Fraillon, J., Ainley, J., Schulz, W., Friedman, T., & Duckworth, D. (2019). Preparing for Life in a Digital Word. IEA International Computer and Information Literacy Study 2018 International Report. Amsterdam, the Netherlands: International Association for the Evaluation of Educational Achievement (IEA). [https://www.iea.nl/studies/iea/icils/2018]

About the author(s)

Wolfram Schulz

Dr Wolfram Schulz is Principal Research Fellow at the Australian Council for Educational Research (ACER) and since 2006 he has been International Study Director for the IEA International Civic and Citizenship Education Study (ICCS). Furthermore, Wolfram is Assessment Coordinator for the IEA International Computer and Information Literacy Study (ICILS) and a senior survey advisor for a number of other international and national studies conducted by ACER.

Julian Fraillon

Julian Fraillon is Research Director of the Assessment and Reporting (Mathematics and Science) research program at the Australian Council for Educational Research (ACER) and is the International Study Director of the IEA Computer and Information Literacy Study (ICILS). Julian is also Assessment Coordinator for the IEA International Civic and Citizenship Education Study (ICCS) and directs other large-scale assessment projects conducted by ACER with a focus on digital literacy and civics and citizenship education.