AI Research & Speaking

Karl Hartley

Researching and designing AI powered assessments for vocational education, and helping organisations adopt AI safely and at human speed.

Hamilton, New Zealand

About

Transforming how people learn

I am a Tairāwhiti (Gisborne) born learning and technology specialist who now calls Kirikiriroa (Hamilton) home. For more than 20 years I have designed digital learning and assessment for organisations across Aotearoa and beyond.

In 2017 I founded Epic Learning, a fully remote learning and development team that now supports clients across New Zealand and Australia. I also co-founded Epic Sharing, a platform for sharing and discovering learning resources. I still work closely with the Epic crew while focusing my own time on AI research and my new venture, hotloop.ai.

As Principal Investigator for ConCOVE Tūhura I have led New Zealand's largest study into whether AI can create NZQA aligned assessments that pass national moderation. Our 114 page report established an ethical framework for AI assisted assessment design that responds to Te Tiriti o Waitangi, including data sovereignty and cultural responsiveness, and sets out a five phase methodology that others can reuse.

A key finding from this work is simple but important. When we built strong assessment designs, grounded them in quality content, and used subject matter expertise to guide and check the AI, personalised variants were consistently approved by independent experts. That result is reshaping how the VET sector thinks about AI adoption.

I believe the future of learning sits where human expertise and AI systems work together. My job is to help assessment teams, teachers and leaders build that future without losing what matters most for learners.

Founder

hotloop.ai

Experience

Quality and regulatory experience

Research

AI generated assessments

Leading New Zealand's largest study on AI in vocational education

ConCOVE Tūhura research project

I am Principal Investigator for a comprehensive study examining whether AI can create assessments that pass New Zealand's national moderation system. The project was commissioned by ConCOVE Tūhura in partnership with Epic Learning and George Angus Consulting.

  • Established an ethical framework for AI assisted assessment that responds to Te Tiriti o Waitangi
  • Developed a five phase methodology for NZQA compliant AI generated assessments
  • Demonstrated that personalised AI assessments can achieve universal expert approval when guided by subject matter expertise
  • Produced a 114 page research report with practical guidelines for human over the loop collaboration between assessors and AI tools

This work sits alongside wider sector conversations on inclusive VET systems and micro credentials, and has been shared through national and international conferences, webinars and podcasts.

View research report

Speaking

Presentations and panels

2025

NZVETRF 2025

AI generated assessments for vocational education (with Eve Price)

Te Papa, Wellington

2025

AVETRA Conference

AI generated assessments for VET

Melbourne, Australia

2025

ConCOVE Tūhura Conference

Future proofing assessment: AI generated design

Te Papa, Wellington

2025

No Frills National VET Research Conference

AI generated assessments and inclusive VET pathways (with Eve Price and colleagues)

Gold Coast, Australia

2025

EPIT Community of Practice

Adapting AI generated assessment practices for secondary teachers

New Zealand

2025

NZATD Webinar

AI in 2025: Connected tools and emerging L&D workflows

Virtual

2025

Teacher Transformation Project

Advanced AI practice for educators

Waikato

2024

NZATD Digital Learning Showcase – L&D Week

Shadow AI: the secret power shaping learning and development

Auckland

2024

NZATD Webinar

Getting even more out of ChatGPT in 2024 (with Nat Gunn)

Virtual

2019

TEDxRuakura

Digital learning innovation

Hamilton

Media

Media and writing

Vocational Voices podcast, NCVER

Building inclusive VET systems and pathways, discussing AI generated assessments and diverse learner needs

Test Community Network

Featured in AI item authoring research sprint and report launch, sharing findings from the ConCOVE Tūhura project

Shadow AI article

Writing on how people quietly adopt AI tools at work, based on a story from the NZATD Digital Learning Showcase, translated into multiple languages

Regular LinkedIn writing

Sharing practical insights on AI in assessment, shadow AI, meta prompting and connected AI workflows for L&D teams

Projects

Selected work

New Zealand

New Zealand Football

NZF Learn Platform

Developed learning dashboard and e-learning content for national coach and referee education.

  • 4,000+ coaches and referees on platform
  • NZATD Award: Best Skills-Based Learning 2024

Callaghan Innovation

AI Activator E-Learning

Developed Introduction to AI module for the national AI Activator programme, empowering NZ businesses to harness AI.

Te Pūkenga

Mechanical Engineering Standards

Directed curriculum development modernising 135 unit standards in the Mechanical Engineering sector.

Australia

Construction sector

AI generated assessment with state specific compliance

Led design of a generative AI assessment engine that overlays state based construction legislation and compliance requirements onto assessment questions, ensuring that each version aligns with local regulatory frameworks while keeping a consistent core design.

  • Used sector specific content and legislation as the base for AI generated questions
  • Enabled providers to generate legally relevant variants without starting from scratch each time
  • Featured as an Oceania case study on AI education projects

Connect

Let's talk

For speaking, research collaboration, assessment design support or AI strategy for your organisation, get in touch.