In review: Measuring Success? blog series, 2015

At the end of 2015 the Measuring Success? blog series has begun to pick up pace. Four contributions have been posted so far, with several more agreed with authors for early next year. So far we have examined:

Geographical mobility and the Rhodes Scholarships across the 20th century
Authored by Dr Tamson Pietsch, published on 16/10/2015
The Rhodes Scholarships scheme is one of the longest running programmes of scholarly exchange, and as such it offers a century’s worth of invaluable data for examining patterns in the geographical mobility of awardees post-scholarship. The author’s analysis has revealed some striking patterns. Read more

International scholarships and the SDGs
Authored by Dr John Kirkland, published on 06/11/2015
Half a cheer for the new Sustainable Development Goals (SDGs). On the one hand it’s good to see increased prominence given to tertiary education, including a welcome reference to scholarships. But problems will emerge from the targets in themselves. Read more

Methodologies for evaluating short fellowship programmes
Authored by Dr Caroline Cage and Shireen Quraishi, published on 30/11/2015
Short fellowship programmes offer academics a tailored opportunity to develop professional skills. Given the individual nature of the fellowships, evaluation presents some challenges. Here, the authors outline the methodologies in place to assess impact of two specific schemes administered by the ACU. Read more

Defining success in light of student experiences
Authored by Aryn Baxter, published on 18/12/2015
A reflection on how the experiences of international scholarship recipients from low-income contexts might inform the ways we choose to define and measure success. Read more

If one can judge by the positive feedback received on the initiative, it seems that a space for short, critical pieces on topics highly salient to scholarship programmes is a welcome addition to the research, programme administration, and policymaking landscape.

‘Measuring Success?’ blog launches

Last week we launched a new blog series called ‘Measuring Success?’, co-curated by The Association of Commonwealth Universities (ACU) and the Commonwealth Scholarship Commission (CSC).

Measuring success banner v1 plain blue text updated cropped

The first contribution to the series is now live on the ACU Voice blog:

Geographical mobility and the Rhodes Scholarships across the 20th centuryDr Tamson Pietsch, University of Sydney

You can also follow the series using its tag on the ACU website, just click on the banner above or in the sidebar. Continue reading

Tracing scholarship outcomes at EAIE Glasgow 2015

The week of 15-18 September 2015 saw the 27th annual conference of the European Association for International Education (EAIE) held in Glasgow, UK. I joined a panel of colleagues from EP-Nuffic and DAAD to discuss ‘Tracing the outcomes of study abroad scholarships’ and the potential for deeper collaboration between agencies in future.

Evaluation timeline

A potted version of the paper is available here on the CSCUK website.

Debating the future of international scholarships at NAFSA 2015

How can we understand the outcomes of international scholarship programmes? And what shapes the long-term impact of programmes on their alumni and society? These were the central questions posed to a panel of experts at the NAFSA Association of International Educators annual conference in Boston, last month.

After the conference I published a few thoughts on the ACU’s website.

Interim analysis of Commonwealth Scholarships published

“Trajectories and impact of UK Commonwealth Scholarship and Fellowship Programme alumni: Interim quantitative analysis”

A major facet of the CSC Evaluation Team’s work over the past year has been the collation and analysis of data from a four-year alumni survey exercise, running 2012-2015. The research aims to chart the trajectories and impact of Commonwealth Scholars and Fellows since the inception of the programme in the late-1950s. Although data collection continues, the current data corpus is sufficient for interim quantitative analysis and a report has been produced.

The interim report is now available on the CSCUK website.

Continue reading

Article published on observation in virtual worlds

After some time in the publishing mill my paper on observational research in virtual worlds (such as Second Life) is now available in the International Journal of Social Research Methodology.

The paper tackles some technical issues relating to conducting field observations in virtual worlds and might be of interest to those who (like me) have used, or are considering using, the approach as part of their research.

Continue reading

Evaluation at the Donor Harmonisation Group

Each year a network of organisations administrating higher education, research, and capacity building development cooperation programmes meets in Europe to share insight, collaborate, and, where possible, align objectives. The ‘Donor Harmonisation Group’ this year met on June 11-13 in Helsinki for their annual forum, hosted by the Finnish Centre for International Mobility (CIMO).

Donor Harmonisation Group, Helsinki, June 2014

Donor Harmonisation Group, Helsinki, June 2014

Continue reading

Evaluation methodology study published

‘A study of research methodology used in evaluations of international scholarship schemes for higher education’

Over the last six months we have been working on a scoping study examining the state of research practice in the sector: trends, ambiguities, and omissions. The aim has been both to inform our own evaluation practice and to update our colleagues around the world on how evaluation is being conducted.

The final report is now available on the CSCUK website.

Continue reading