How PISA measures students’ ability to collaborate

-
by Andreas Schleicher
Director, Directorate for Education and Skills

Late next month (21 November, to be exact) we’ll be releasing the results PISA’s first-ever assessment of students’ ability to solve problems collaboratively. Why has PISA focused on this particular set of skills? Because in today’s increasingly interconnected world, people are often required to collaborate in order to achieve their objectives, both in the workplace and in their personal lives. Working with others is not as easy as it sounds. One person might end up reproducing another’s work; poor communication and personal tensions between people might prevent a team from reaching its goal. So it’s worth finding out whether students today know what it takes to work (and play) well with others.

This month’s PISA in Focus describes what it means, according to PISA, to be competent in collaborative problem solving. Along with the skills needed to solve problems individually, a good team member also has to develop and maintain a shared understanding of the problem with his or her teammates, take the actions needed to solve the problem, and establish and maintain team organisation. These skills can help determine how students learn, teachers teach and how we judge the performance of schools.

PISA in Focus also explains how PISA is able to measure students’ collaboration skills – not, as you might expect, by observing students as they work with other students, but by following their interactions with team members who are actually computer simulations of humans (known as computer agents). Today’s technology allows us to assess students’ 21st century skills. Not only can the behaviour of these computer agents be controlled, but they can also be programmed so that some are more co-operative than others, and some may be more focused on solving the problem than others. Sound familiar? Yes: they’re programmed to be just like you and me.

Several “screen shots” from a part of the assessment that was released to the public are also presented so you can get a better idea of the kinds of tasks PISA students were asked to perform, and how the students’ responses express the skills they need to collaborate with others. In short, this month’s PISA in Focus gives you both a behind-the-scenes look at the thinking that went into the design of the assessment, and a front-row seat for when the results of the assessment are released next month.

Links 
PISA in Focus No. 77: How does PISA measure students’ ability to collaborate?
The Programme for International Student Assessment (PISA)


Comments

Post a Comment

Popular posts from this blog

What should students learn in the 21st century?

-
Image
By Charles Fadel
Founder & chairman, Center for Curriculum Redesign
Vice-chair of the Education committee of the Business and Industry Advisory Committee(BIAC) to the Organization for Economic Co-operation and Development (OECD)
Visiting scholar, Harvard GSE, MIT ESG/IAP and Wharton/Penn CLO

It has become clear that teaching skills requires answering “What should students learn in the 21st century?” on a deep and broad basis. Teachers need to have the time and flexibility to develop knowledge, skills, and character, while also considering the meta-layer/fourth dimension that includes learning how to learn, interdisciplinarity, and personalisation. Adapting to 21st century needs means revisiting each dimension and how they interact:

Knowledge - relevance required: Students’ lack of motivation, and often disengagement, reflects the inability of education systems to connect content to real-world experience. This is also critically important to economic and social needs, not only students…
Read more

Students need good career guidance, and here’s how schools can give it

-
Image
By Pauline Musset
Analyst, Directorate for Education and Skills



Choosing anything is hard, especially when your decision might have long-term consequences for your life. A new OECD research paper looks at career decisions and career guidance. Based on 2015 PISA data, it shows that most 15-year-olds already have career plans: only around 15% of them have not decided what they want to do. But the data show that today’s teenagers aren’t very imaginative when it comes to their expected working life. Almost one in ten wants to be a medical doctor; one in three cited one of just ten jobs.

The ways in which young people think about jobs and careers, the study shows, are highly shaped by parental influence, social background and sense of identity. The paper highlights new analysis which shows, for example, that disadvantaged students are significantly less likely to want to work as professionals than their more advantaged peers – even after statistical controls are put in place for academic ab…
Read more

Key publications on education and skills coming up in 2019

-
Image
By Andreas Schleicher
Director, OECD Directorate for Education and Skills



Revolution. Contained within that often frightening word is another, less destabilising one: evolution. If we look at the future as the result of a series of advances propelled by megatrends, then we have a better chance of meeting the challenges it presents, rather than being ambushed by them. We will also be better equipped to prepare tomorrow’s learners. So we will start the year in January with our tri-annual report Trends Shaping Education, which scans the horizon for megatrends that will shape the demand and supply of educational opportunities, and outlines the most significant challenges facing education over the years to come.

But how will education reinvent itself to respond to these megatrends and educate learners for their future? Governments cannot innovate in the classroom, but they can help build and communicate the case for change. Government can also play a key role as platform and broker, as stim…
Read more