Appropriate education performance indicators for ODL organisations

This was the first keynote to open the second day of the DEANZ conference 2012, in Wellington, NZ. Caroline Seelig is Chief Executive of the Open Polytechnic of NZ.

Not everything that can be counted counts, not everything that counts can be counted (Einstein)
Albert Einstein Français : Portrait d'Albert E...Albert Einstein Français : Portrait d’Albert Einstein (Photo credit: Wikipedia)
The presentation focussed on why ODL is different, and how the unique student base of ODLs impacts Education Performance Indicators (EPIs). The conception of EPIs was introduced in 2010, and the primary intent was to measure and improve the performance of the tertiary education systems. They also determine government funding.
Caroline indicated that the Open Polytechnic is ‘different’. It has a nationwide mandate for delivery (dispersed, consistent provision), and offers single-mode, flexible, specialist, distance delivery (no students on campus). It has a completely different business model, with different cost structures. the curriculum development requires upfront portfolio and courseware development costs, and low ongoing delivery costs. It is neither metropolitan nor regional, which means there is limited community support and advocacy. The student body is quite distinct, with the majority of the 41,000 student as part-timers,, older (76% over 25, and 33% 40+ years), and are in the workforce (70%).
Vanessa gonerilla gonerilla English: NZ Red Ad...Vanessa gonerilla gonerilla English: NZ Red Admiral Butterfly in Wellington, New Zealand Māori: Kahukura (Photo credit: Wikipedia)Some common false perceptions include:
  • ODL is a cheaper mode of delivery – not necessarily, but is cost effective
  • All other providers can easily create dual mode delivery systems that are as effective
  • No role for ODL in Youth Guarantee of NEET initiatives
  • OP student cohort could easily switch to network of F2F providers
  • Part time learners in work force should achieve the same results, at the same pace, as full time F2F learners
  • It should be simple to benchmark all ITPs against each other
Caroline indicated that the government values the part-time learner, but the QC is adjusted according to part-time provision. BUT a student that studies full-time for 6 months gets the same adjustment as a student that studies part-time for 12 months. The ODL model impacts EPIs by providing a ‘safety net’ role as a national provider for courses other TEOs can’t provide (but who get the final qualification credit).
Are EPIs a target to aspire to or just another funding game? And where could EPIs go? There is huge diversity within in NZ around provision, but what is happening is that the TEC are using the same ruler to measure these fundamentally different providers. The students are very different too, and, in secondary school deciles are applied to schools, but in tertiary the opposite is true. In tertiary those students from lower socio-economic backgrounds often have less robust support systems in place; therefore those tertiary institutions working with these students should be recognised. There are indications that the focus is on students who are not in employment and then looking at their pay rates and employment filed at 2 and 5 year milestones after graduation.
This presentation was an interesting insight into the way EPIs can skew the way governments…and students…measure an institution’s success. It was also a call for considering the student holistically, rather than a statistic performing to a benchmark – it’s not just about the EFT funding that go in and the EPIs that come out. There are many associated benefits to ODL, including, for example, freeing up families to provide homecare for children rather than putting them into childcare while they study, thus providing way more culturally responsive, flexible learning opportunities.

About ictenhancedlearningandteaching

I am a director and consultant at Ethos Consultancy NZ ( I have a keen interest in all aspects of ICT Enhanced Learning and Teaching (ICTELT) where the focus lies on ways of scaffolding and empowering learners. In particular, I am interested in the way that creative, blended approached to Academic Professional Development can create trust, rapport and encourage reflective practice. As such, ICTELT is approached from facilitation, design, evaluation and assessment as opposed to the tools and what they can offer. I am a strong advocate of the potential of Web 2.0 to empower learners from all walks of life and cultures, especially after my experiences working for 6 years in the Middle East. In particular, I am interested how ePortfolios can be used in the VET sector (especially where Literacy and Language challenges are faced), in Recognition of Prior Learning, and in authentic, applied assessment. I have been involved with designing and developing ICTELT approaches and programmes for ten years. Following research informed approaches and design, I apply a qualitative, iterative process to evaluate the effectiveness of interventions, programmes and tools, encouraging learners' voices and input from all stakeholders.
This entry was posted in All, Cultural inclusiveness, Engagement, Vocation Education and Training (VET) and tagged , , , , , , , , , , , , . Bookmark the permalink.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s