People and organisationAI RADAR · STUDY ·

01

The key finding

What share of points do IT apprentices achieve on architecture tasks?

65%

With AI (compared with: Without AI 39%)

AI improves performance on more demanding IT tasks

The experiment shows better solutions on tasks beyond the curriculum.

Limitation: Immediate comprehension did not decline. Whether the capability lasts was not tested.

02

The study

What share of points do IT apprentices achieve on architecture tasks?

Without AINo internet access39%
With AIChatGPT and internet access65%

Average share of available points on tasks beyond the curriculum. Depending on apprenticeship: software architecture or a security concept.

What the study shows

  • On software or security architecture tasks beyond the curriculum, IT apprentices with ChatGPT achieved about 65 percent of available points on average, versus about 39 percent without AI or internet.
  • This measures task scores, not the share of people succeeding.
  • The experiment shows better solutions on tasks beyond the curriculum.

How solid is this?

Method

Preregistered field experiment: 673 final-year apprentices at twelve German vocational schools, randomly assigned within schools. Data collected October 2025–January 2026.

Limitations

  • Control group without internet; not a comparison with normal work including web search.
  • Two IT apprenticeships, mostly men.
  • Immediate comprehension assessed, long-term learning not tested.
03

What we take from it

Trial more demanding tasks with AI. Check the results and ask employees to explain their solution. After a few weeks, test again what they can do without AI.

Your 10-minute check

Tick the boxes and go through them with your team. Fewer than three ticks? Then it is worth a closer look.

Our interpretation: AI can make more demanding tasks accessible. Good AI-assisted solutions do not establish durable skills.

What does this mean for your company? Book a conversation ↗