Year 2: Testing the model

This second year employed many of the same methods as before – observations, focus groups, etc. The critical difference was that now we had a basic model and themes gleaned from Year 1 and we looked to test them out. “Testing” might sound big and scary but really it was looking to see if the themes and interactions were, in fact, present in the TA and participant interactions. Additionally, we used a pre- and post-residency survey to further explore these themes. In doing so, one theme in particular seemed to play a critical role – mindfulness – and that, in turn, helps to inform Year 3. Take a look at the Year 2 final report for a great deal more information

Key lessons for readers:

• The ongoing iterative process involved in evaluation – As you read the final report, be sure to look for the reality of evaluation work – it is rarely a straight line and, in fact, it involves a great deal of back and forth and even ups and downs. That can seem like a waste of time sometimes but it actually produces a better, richer product.

• It takes time and reflection to better understand models – The whole of Year 2 can look a lot like Year 1 in terms of methods and topics. In reality, though, we needed this year to really begin to explore the themes from Year 1 in-depth. So, don’t always feel the need to rush through the process!

• Patience – It will come as no surprise to anyone that sometimes plans don’t work out as we had hoped. In reading the Year 2 report, you might note that some of the sites weren’t able to fully participate as we had planned. That neither stopped 5HE programming nor did it “ruin” the evaluation effort. “Adaptability” and patience is a key theme for programming AND evaluation.