Expert article
Modifier 15 June 2022
by Ronald Lievens, UIA Expert

Passport for Work’s scientific impact study kicks off

social innovation P4W
social innovation process P4W

Figure 1. The social innovation process underlying Passport4Work

Ever since the Passport for Work project started, it has been a key objective to support its social innovation process with a scientific impact analysis. In this web article, the methodology, the hypotheses as well as a few preliminary insights are presented.

Partager

As can be seen in the above figure, the project has gone through several social innovation “phases”, which were often taking place in parallel. For instance, the technical development, testing and scaled delivery of the online platform (and its underlying assessment modules and matching engine), corresponded with phases 3 (“prototyping”), 4 (“sustaining”) and 5 (“scaling”). This was not a linear process: the skills assessment, for example, progressed through these stages at a faster pace than the matching algorithm. Different levels of complexity and unforeseen hurdles account for these differences. To illustrate the latter, the matching algorithm is highly sensitive in terms of GDPR legislation: for it to mature into the scaling and systemic change phases, it has to be ensured that the resulting matches are both accurate and non-discriminatory.

Another core activity of the project, technical development aside, is its contribution to a national skills language. Most of the relevant activities take place in the systemic change phase, with matters of institutional governance and a culture shift towards the skill based economy being central to the project activities.

With the project nearing its final stages, a key research activity of Tilburg University has kicked off in April. In the beginning of the project, the university assigned KPI’s to each of the above-mentioned phases of the project. A lot of these KPI’s are related to the added value of the Passport for Work platform for job seekers, job coaches and employers and are tested during the last six months of the project.

For the impact analysis, a longitudinal study is conducted on the impact of the Passport for Work platform on labour market outcomes in the Eindhoven region. Study participants engage in job search under the supervision of the Eindhoven municipality while using the Passport4Work platform (serving as an intervention) for skill assessments and job matching.

 With a control-group design (with 200 to 300 participants), this study will allow the project team to provide evidence-based support for the following hypotheses:

1. P4W use increases jobseeker self-awareness in terms of skills and opportunities

2. P4W contributes to enhanced quality of the recruitment process in the (pre-)selection phase and hiring phase.

Match quality will be established through person-job fit: does the matching vacancy suit the job seekers educational level, domain and/or competences

3. P4W increases efficiency of the recruitment process

4. The use of P4W tools increases the probability of a sustainable match with an employer.

While the study is in its early stages, a few anecdotal observations have been made. While these are not generalizable and conclusive, they are worth sharing at this stage.

  • Self-perceived employability and self-efficacy levels have seemingly risen for several jobseekers using the P4W tool (ascertained by the job coaches facilitating workshops).
  • HR representatives among employer organizations have reported recognizing the added value of P4W for their recruitment processes, by providing an evidence-based (through the national survey) blueprint of skills related to a specific occupation.
  • HR representatives indicate that while the blueprint of skills is a valuable starting point, incorporating organization-specific needs, which might deviate from the national survey’s findings, is found to be complex.
  • HR representatives report that incorporating skills based matching in their recruitment processes requires a significant behavioral change among recruitment staff, one that is contingent on the realization of sustainable matches throughout the experiment (and beyond).

 

At this stage of the research, job matching has not yet commenced, and as such, it is too early to call whether P4W results in sustainable job matches. The final results (on each of the above hypotheses) will be published in October 2022.

Other news from this project

Passport for Work Journal 4

Passport for Work's Legacy: Journal 4

Passport for Work's fourth and final journal, reflecting on its legacy and its activities after the formal project period....

P4W - Passport4Work an intersectoral skills passport with gamified skills assessment and improvement

Jobs and skills in the local economy

Eindhoven - The Netherlands

Jobs and skills in the local economy
PfW impact study

Passport for Work: first results of the impact study & invitation to final event

P4W - Passport4Work an intersectoral skills passport with gamified skills assessment and improvement

Jobs and skills in the local economy

Eindhoven - The Netherlands

Emplois et compétences dans l'économie locale
Passport for Work refugee workshop

Passport for Work supports refugee integration into the labour market

P4W - Passport4Work an intersectoral skills passport with gamified skills assessment and improvement

Jobs and skills in the local economy

Eindhoven - The Netherlands

Emplois et compétences dans l'économie locale
Zoom-in video podcast

Passport for Work Zoom-in: The Skill Based Economy

The Dutch labour market is facing unprecedented shortages, calling for a skill based economy in which skill based matching, reskilling and upskilling ...

P4W - Passport4Work an intersectoral skills passport with gamified skills assessment and improvement

Jobs and skills in the local economy

Eindhoven - The Netherlands

Emplois et compétences dans l'économie locale
Dutch Skills Survey

Major milestone for P4W: national skills survey complete

In October 2020, Passport4Work started an ambitious national research endeavour: replicating the survey of the leading skills taxonomy O*NET in the Du...

P4W - Passport4Work an intersectoral skills passport with gamified skills assessment and improvement

Jobs and skills in the local economy

Eindhoven - The Netherlands

Emplois et compétences dans l'économie locale
P4W focus groups in HE

Passport4Work expands target group: focus groups with University students

Striving for an inclusive labour market instrument, Passport4Work organized 2 focus group sessions with University students to establish its utility b...

P4W - Passport4Work an intersectoral skills passport with gamified skills assessment and improvement

Jobs and skills in the local economy

Eindhoven - The Netherlands

Emplois et compétences dans l'économie locale
P4W Journal 3

Passport4Work Journal 3

Passport4Work is nearing the product delivery phase. Learn more about the state of play of the project and its contributions to a skills-based economy...

P4W - Passport4Work an intersectoral skills passport with gamified skills assessment and improvement

Jobs and skills in the local economy

Eindhoven - The Netherlands

Emplois et compétences dans l'économie locale
P4W at HR Live

Passport4Work launches employer prototype at HR Live

Passport4Work reached a major milestone in its project, by recently finishing the first prototype of the employer interface of the tool. This prototyp...

P4W - Passport4Work an intersectoral skills passport with gamified skills assessment and improvement

Jobs and skills in the local economy

Eindhoven - The Netherlands

Emplois et compétences dans l'économie locale
P4W zoom in 2

Passport for Work Zoom-in: Skills based matching

In the second Passport for Work zoom-in, the implications of skills based matching are explored among employers. We visited employers in three differe...

P4W - Passport4Work an intersectoral skills passport with gamified skills assessment and improvement

Jobs and skills in the local economy

Eindhoven - The Netherlands

Jobs and skills in the local economy
P4W Journal 2: A phase of intensive technical development and prototyping!

P4W Journal 2: A phase of intensive technical development and prototyping!

In his 2nd journal, UIA Expert Ronald Lievens reflects on the current state of affairs in the Passport4Work (P4W) project, its developments, and the d...

P4W - Passport4Work an intersectoral skills passport with gamified skills assessment and improvement

Jobs and skills in the local economy

Eindhoven - The Netherlands

Cover

Passport4Work completes series of tests of first prototype (video)

In his 1st zoom-in, P4W expert Ronald Lievens, explores why soft skills are a key part of the Passport4Work project. Especially in these times, with c...

P4W - Passport4Work an intersectoral skills passport with gamified skills assessment and improvement

Jobs and skills in the local economy

Eindhoven - The Netherlands

Emplois et compétences dans l'économie locale
image p4w zoom in 1

Passport for Work Zoom-in: soft skills to sustain employability

In his 1st zoom-in, P4W expert Ronald Lievens, explores why soft skills are a key part of the Passport4Work project. Especially in these times, with c...

P4W - Passport4Work an intersectoral skills passport with gamified skills assessment and improvement

Jobs and skills in the local economy

Eindhoven - The Netherlands

Jobs and skills in the local economy
Re-skilling
Smarter Europe
Talent management
P4W Web Article 3

Passport4Work starts ambitious Dutch validation of US-based O*NET framework

Passport4Work has started a widespread, ambitious national study among Dutch employers, job seekers and intermediaries to contextualize and validate t...

P4W - Passport4Work an intersectoral skills passport with gamified skills assessment and improvement

Jobs and skills in the local economy

Eindhoven - The Netherlands

Jobs and skills in the local economy
P4W_zoom in

How and why soft skills are important to the Passport4Work?

In his 1st zoom-in, P4W expert Ronald Lievens, explores why soft skills are a key part of the Passport4Work project. Especially in these times, with c...

P4W - Passport4Work an intersectoral skills passport with gamified skills assessment and improvement

Jobs and skills in the local economy

Eindhoven - The Netherlands

P4W Web Article 2

Passport4Work update: abstract skills in layman's terms

As described in the previous web article, P4W is developing tools for skills assessment, eLearnings and job matching....

P4W - Passport4Work an intersectoral skills passport with gamified skills assessment and improvement

Jobs and skills in the local economy

Eindhoven - The Netherlands

Jobs and skills in the local economy
Eindhoven

P4W Expert Journal 1: Get to know the project and what happened in the first 6 months!

In his 1st Journal, Ronald Lievens, UIA expert of the P4W project, discusses all key activities that you need to know about it, what the project is ab...

P4W - Passport4Work an intersectoral skills passport with gamified skills assessment and improvement

Jobs and skills in the local economy

Eindhoven - The Netherlands

Emplois et compétences dans l'économie locale
P4W Web Article 1

Passport4Work: Towards a common understanding of skills

P4W - Passport4Work an intersectoral skills passport with gamified skills assessment and improvement

Jobs and skills in the local economy

Eindhoven - The Netherlands

Jobs and skills in the local economy
An update on Passport4Work

An update on Passport4Work

2020 is already well underway; time for an update on Passport4Work. The project team has not been idle in recent months and a lot has happened. In Jan...

P4W - Passport4Work an intersectoral skills passport with gamified skills assessment and improvement

Jobs and skills in the local economy

Eindhoven - The Netherlands

All partners of the P4W project

Kick-off of the project Passport4Work

To officially inform our local and national stakeholders, a kick-off for the project was held on Thursday June 13th. This coincided with a national da...

P4W - Passport4Work an intersectoral skills passport with gamified skills assessment and improvement

Jobs and skills in the local economy

Eindhoven - The Netherlands