Data Visualisation and Portfolio Analysis

I watched a great TED talk this week, all about how data visualisation an be used to show clearly what is happening in complex systems. As we all know – a picture is worth a thousand words, so I thought I’d play around with the graph plotting options in Google drive together with some of our full time undergraduate portfolio performance data.

Two things are immediately apparent – firstly the University implementation of the WordPress blogging software does not allow for interactive chats to be embedded, whereas I can do this on my other site. Secondly, I was surprised that Google provided a couple fo graphing options that were not available in Excel

And finally, here’s a couple of visualisations. The first takes two differences and unrelated performance measures, and plots a scatter graph of these, with bubbles representing each award. The size of the bubble represents the cohort size. This might be useful to identify quickly how awards in a faculty are performing, and which ones deserve intervention based on their size.

The second graph is a tree diagram, which shows the relative size of each of the awards in a faculty. Again this might be useful to provide a quick visual idea of relative sizes of awards.

Completion of the first UK MOOCs via Coursera

The first MOOCs offered by a British university through Coursera were from Edinburgh, and I completed the one on “E’-learning and digital cultures”. In this week’s Higher, an article provides analysis of the operation and the experiences of instructors and students.

I’ve written previously about my own experiences, so I won’t repeat that. I see some fellow students who became part of my personal learning network are quoted in the article.

Some key facts:

  • 308,000 students enrolled on 6 courses
  • one instructor reckoned he spent 8 hours a week from August to January on MOOC related activity prior to the course starting
  •  in the course I took, 42,000 enrolled, 4500 joined the Facebook group, there were 700 tweets per day using the hashtag #edcmooc and 2000 students joined a Google+ group
  • of the 42, 000 who enrolled, about 17,000 logged in at least once
  • about 2,000 students completed the final assessment
  • cost estimate from development to delivery – about £30,000

And I presume the income was zero, although instructors learnt an awful lot in the process.

 

Another Avalanche is Coming

After the apocalyptic prophecies of the recent IPPR report, where MOOCs were going to sweep away everything in their path, Steve Smith, formerly of Universities UK and now VC of Exeter writes in this week’s Higher about what the other  and possibly more pressing challenges are which threaten UK higher education.

He does provide a bit of criticism of the IPPR report – there’s much on it that could be criticised  but at least it provoked significant debate – and then describes what he feels are the main threats.

  • austerity
  • the student finance system
  • research
  • admissions
  • visas

Under austerity:

“The IFS estimates that there will be a further cut of about 2.8 per cent to unprotected departmental expenditure limits in the 2013 spending review, which is expected in June and will cover 2015-16. Many estimate that this will lead to a 6-8 per cent cut in the BIS budget.

But the IFS notes that the real problem will arise after this, when whoever is in government will have to reduce departmental spending by 12.7 per cent by 2017-18, which means that the likely cuts for BIS will be considerable. By 2017-18, those cuts could total 43 per cent.”

The student finance system:

“an avalanche really is coming in terms of the costs of student support.

I cannot see that system surviving, and expect any incoming government in 2015 to look again at the student finance system and to try to reduce its costs. Think for a moment about how it might do that, and how that might influence student demand for different types of institutions. To mention just one controversial way to reduce costs, what would be the effect of re-examining the Browne review’s notion of requiring minimum qualifications before students gain access to the loan system?”

Research:

“Another area facing avalanche-like upheaval is research selectivity. Even a cash ring-fenced science and research budget entails no adjustment for inflation for eight years.

That looks to me like a real-terms reduction of about 20 per cent in research funding by 2017-18. The only options for dealing with that are to reduce all funding by the same amount in real terms, or further increase research selectivity.

I suspect that the latter is the only way to balance this financial constraint with the need to compete internationally. One obvious indication of this thinking is the near universal move by the research councils to concentrate funding for PhD training into a small number of doctoral training centres.”

Admissions:

“the end-of-cycle report published by the Universities and Colleges Admissions Service in January showed that a growing proportion of the higher-performing students are applying to a smaller subset of universities. There also seems to be a trend towards increased competition for the highest-performing students”

And visas:

“I remain worried about the inability of all of us to win the political battle to get student numbers removed from the net migration figures…..But if we do not win this battle, and more importantly soil the perception of UK higher education overseas (especially in India, Pakistan and Saudi Arabia), then we could see significant reductions in international recruitment. I think that as a sector we win all the economic arguments, but it seems that the politics of immigration trumps that.”

 

And for us? All of these are worrying, and considerably more of a threat than the emergence of one form of online learning. There will be less and less money available for the sector, and although we rely in student income increasingly, further changes to the student finance system could reduce the numbers wanting to attend full time courses. Research is not a huge income earner for us, but crucial for our academic reputation, to support learning and teaching at a leading edge, and to build relationships, business opportunities and change for our commercial partners.

Further polarisation of student admissions will not benefit us and as David Willets said earlier today at the HEFCE annual meeting, “We want greater freedoms and flexibilities for all institutions, not just those with high-tariff students. 2014-15 will be a step towards that. Where student demand is low and institutions significantly under-recruit then unfilled places will be moved to those with stronger recruitment patterns.” This has to be a worry for many universities in the newer part of the sector. Finally  I know that we are well aware of the importance of portraying the UK HE sector as being one which is open for business to students from India, China etc – the tension between the Home Office and BIS does nothing to help us.

 

We’ve got a Facebook App

As well as the Twitter stream and pre-existing pages on Facebook, Staffordshire University have now launched their own Facebook app, which is designed to provide information about the broader benefits of university study, rather than just as an advert for this university. We also provide drop in sessions for people to come an talk to us, and online discussions.

Staffs_FB_app

Two items of league table news

We are moving inexorably towards the start of the league table season, and much hand wringing is to be expected if table positions do not reflect what universities believe about themselves.

Firstly the THE World University Rankings for Asia was published last week. Staffordshire University has had a long running partnership with City University Hong Kong, through their School of Continuing and Professional Education., so it is interesting to see that City U makes it into the top 20 of universities in Asia.

Secondly, an article I originally missed in the Guardian, reports on the relationship between league table position and student recruitment.

“Prospective students are increasingly influenced by university league tables when deciding where to study, according to research that found rises and falls within league standings provoking sharp changes in numbers of applications.

The research by economists at Royal Holloway, University of London, found that individual departments moving up a subject-level league table experienced a rise in applications of almost 5%, with the increase most pronounced among overseas applicants.

They also found that the influence of league table standings has increased since the introduction of tuition fees, suggesting that students are now more aware of the reputation and relative standings of university departments.”

So far, so much like announcing the Pope’s Catholicism, however the study found that the impact was not the same for all universities:

“the boost in applications only applied to university departments sitting towards the upper end of the tables, and especially those within the top 10%. The economists found students to be “more or less indifferent” to changes for departments in the bottom half of the tables.”

Which provides an interesting conundrum – the higher you get in the table, the more significant it might become.

Surviving Disruptive Technologies- week 3 Newspapers

Into the third week of this MOOC and it’s becoming significantly more interesting. The initial weeks have provided examples of companies or industries that have already been disrupted and massively changed by technological changes. Now we’re looking at those currently undergoing change.

The sessions on newspapers are particularly interesting- parallels could be drawn here between this industry and that of higher education( which we will be looking at later in the course).

Prof Lucas makes an impassioned plea for the continuing existence of newspapers, by highlighting activities they carry out that might not be done so well by other news organisations. In particular he highlights the importance of investigative journalism,citing the Watergate affair, to which for the UK we could add investigations over MPS expenses and phone hacking. The other key function is the provision of analysis of the news.

Looking at the parameters of the model for disruption:
Denial
History
Resistance to change
Mind set
Brand
Sunk costs
Profitability
Lack of imagination

I would suggest that many remaining newspapers might not score too badly, particularly when we regard how they are using new technologies to distribute their content (websites, Kindle, iPad editions). However, there is still the difficulty of monetization and loss of advertising revenue to deal with. In addition as indicated in a New York Times article, many businesses have other structural problems such as underfunded pension schemes, unserviceable levels of debt, legacy manufacturing processes and legacy union and labour agreements.

The key thing for newspapers will be to identify what business they are in and how to use technology to support them.

They are clearly not just in the business of reporting news. They are in the business of investigation and provision of analysis and commentary. (The tabloids in the UK are probably in the business of providing something to read at lunch for those in jobs where Internet connectivity is not available).

The next week of the course will look at education, but there are parallels between the newspaper industry and HE that we can start to consider.

Like newspapers we will cease to be in the business of transmission of information ( although attendance at many of our lectures wouldn’t convince you of that).

Like newspapers we need to identify what is the added value that we can provide to readily available information.

I would suggest that from a teaching and learning perspective, the role of the university is about: curation of resources; identification of suitable packages of information; provision of support for learning; accreditation of learning. In addition there is our role in research, generation of new knowledge and support for business and per organisations.

It’ll be interesting to see how the next week’s sessions on education pan out.

Finally,as part of an undergraduate education, there is still a part of me at thinks that all students should read a daily broadsheet newspaper!

NMC Horizon Report: 2013 Higher Education Edition

A useful report from the New Media Consortium that many of you will have already seen, but notable that our own Dave Parkes is on the advisory board.

This  report details: key trends; significant challenges and what are perceived to be 6 technologies that are to be watched as they might be expected to have an impact in higher education over  a range of different timescales.

Key Trends

The key trends are identified as:

1. Openness — concepts like open content, open data, and open resources, along with notions of transparency and easy access to data and information — is becoming a value.

2.  Massively open online courses are being widely explored as alternatives and supplements to traditional university courses.

3. The workforce demands skills from college graduates that are more often acquired from informal learning experiences than in universities.

4. There is an increasing interest in using new sources of data for personalizing the learning experience and for performance measurement.

5. The role of educators continues to change due to the vast resources that are accessible to students via the Internet.

6. Education paradigms are shifting to include online learning, hybrid learning, and collaborative models.

Significant Challenges

1. Faculty training still does not acknowledge the fact that digital media literacy continues its rise in importance as a key skill in every discipline and profession.

2. The emergence of new scholarly forms of authoring, publishing, and researching outpace sufficient and scalable modes of assessment.

3. Too often it is education’s own processes and practices that limit broader uptake of new technologies.

4. The demand for personalized learning is not adequately supported by current technology or practices.

5 New models of education are bringing unprecedented competition to the traditional models of higher education.

6 Most academics are not using new technologies for learning and teaching, nor for organizing their own research.

New Technologies – Time to Adoption 1 Year or Less

Massively Open Online Courses (MOOCs)

Tablet Computing

New Technologies – Time to Adoption 2-3 Years

Games and Gamification

Learning Analytics

New Technologies – Time to Adoption 4-5 Years

3D Printing

Wearable Technology

 

 

Surviving Disruptive Technologies – week 2 experiences

So, I’m at the end of week 2 of my Coursera MOOC on Surviving Disruptive Technologies.

As I wrote before – the content is fine: this week we have looked at what happened to Blockbuster, and compared it with Netflix, with what happened to Borders and compared to Amazon. I guess for me it was interesting to realise that the failure of organisations was not just the disruption caused by the advance of technology, but about how organisations themselves were able to behave and develop (or not, as the case may be).

I’m still shocked at the amount (or rather lack) of use that the discussion boards are getting. Each pair of mini lectures leads to the expectation that participants will engage in online discussion. Maybe it’s the nature of the participants  maybe it’s the subject matter, maybe it’s even the number enrolled, but the biggest discussion thread for this week had 54 posts. Compare that with #edcmooc, where in week 2 the biggest thread had 240!

There’s also very little happening outside of the course – there was a Google hangout, but there is little evidence of a strident community developing as happened in #edcmooc. This may not be surprising – that course attracted a lot of education professionals, who (and I include myself here) found it a really useful way of developing personal networks.

Anyway -sticking with it for the moment as the subject matter is interesting. Though I might just give in and buy the book.

Book Review – “To Save Everything, Click Here”

Over Easter I’ve been reading “To Save Everything, Click Here – Technology, solutionism and the urge to fix problems that don’t exist” by Evgeny Morozov, with an eye on how his views on internet solutionism could so easily be applied to the current discussions around MOOCs, learning analytics, electronic assessment and feedback etc. Two more lengthy and much better informed reviews can be found at:
http://hackeducation.com/2013/03/26/ed-tech-solutionism-morozov/
http://mikecaulfield.com/2013/03/29/thoughts-on-to-save-everything-click-here/

Tara Brabazon also provided an excellent review in the Times Higher a few weeks ago.

In this post, I’ll just highlight some areas that resonated with me, and which can be related to the HE context.

Solutionism

This book is a required read for anyone interested in the internet, and the promise of solutions to everything which are peddled by Silicon Valley entrepreneurs, and parroted by those how haven’t taken the time to really understand what might be happening, but just see  a new shiny toy, and think that they need one too.

This isn’t to say that all internet innovation is wrong – just that we need to think a little more about it.

Morozov frequently criticises Jeff Jarvis, Clay Shirky et al in his book – and possibly rightly so, as the way in which he describes their polemical arguments is that they feel they cannot be criticised, because “the internet” is beyond criticism –  it just is.

Moving through the book, Morozov explains his key theme of technological solutionism – essentially, someone identifies that something is broken, and that there is a technological solution to fix it. He then identifies the limitations in this way of thinking.

Education

At the moment, higher education (indeed all education) is being portrayed as broken, with for examples, MOOCs or the work of Sugata Mitra being proposed as solutions.

As Morozov states early in the book:

The ballyhoo over the potential of new technologies to disrupt education – especially now that several start-ups offer online courses to hundreds of thousands of students, who grade each other’s work and get no face time with instructors is a case in point. Digital technologies may be a perfect solution to some problems, bit those problems don;t include education – not if by education we mean the development of skills to think critically about any given issue. Online resources may help students learn plenty of new facts….but such cramming is a far cry from what universities aspire to teach their students.

Are our students different?

..”the Internet” has produced an entirely new generation – the so called digital natives………They are a generation of scrutinizers who are more sceptical of authority as they sift through information at the speed of light by themselves or with their network of peers. Best of all today’s young people are authorities on the digital revolution that is changing every institution in society

Are we sure that this is the case? Do we really think that our students are a homogenous group who are all authorities n a digital revolution?  We know that we still need to help students to develop skills in information and digital literacy, that they don’t all have the highly developed critical skills to think about an issue and develop their own learning.

Transparency and Openness

This chapter of the book is interesting, particularly in the context of an article in the Times Higher this week, which is also about openness.

In terms of education, we are being bombarded by the idea that MOOCs are a salvation for us. Let’s not forget that “open” in this case, doesn’t mean open. Only enrolled students can access the learning materials, they’re not there to be re-used or re-purposed as we might expect from truly open educational resources.

Internet –centrism and solutionism feeds on Enlightenment-era attitudes towards the liberating power of information. More information is always presumed to be better than less; having more ways to analyse the same piece of information is always preferable to having fewer ways……..this gives rise to a mindset that equates information gathering with a “single inevitable trajectory of forward progress”.

Just having access to information is not always a good thing, and Morozov questions whether we understand what our consensus might be around an understanding of openness.

Our internet debates, in contrast, tend to be dominated by a form of openness fundamentalism, whereby “openness” is seen as a fail-safe solution to virtually any problem. Instead of debating how openness may be fostering or harming innovation, promoting or demoting justice, facilitating or complicating deliberation – the kinds of debates we are likely to have about the uses of openness in the messy world that we live in – “openness” in networks and technological systems is presumed to always be good and its opposite – it’s quite telling that we can’t quite define what that is – always bad.

While internet-centrists believe that “openness” is good in itself, internet realists investigate what the rhetoric of “openness” does for governments and companies – and what they do for it.

Here, for  a university, the data that we do or do not provide on our provision , eg through KIS, or through the information that UCAS hold (and currently withhold) on attractiveness of courses for 2013 entry are aspects of data that we are urged to make open and transparent. There is a question to discuss about the real usefulness of making everything available. If for example UCAS did publish data at this stage of the cycle on current attractiveness of undergraduate awards at institutions  it could send a negative signal to the student recruitment market, which might be based purely on one data point  but could have significant effects on the viability of  a subject at a particular university. The data alone is not enough for rational decisions to be made.

The perils of algorithmic gate keeping

In this chapter Morozov looks particularly at how big data in combination with an algorithm can be used to predict behaviours. Parallel lessons could be learned from this, particularly in the discussions developing around the use of learning analytics to identify learner behaviour, to identify the student who is likely to fall by the wayside. It may of use to note the following quotation:

But how do we know that the algorithms used for prediction do not reflect the biases of their authors? 

It is useful to reflect at this point on how we in the UK Higher Education sector use data to describe our institutions to potential and existing students.

The drive to provide data through Key Information Sets might mean that all institutions are providing information that is thought to be of use to students. However, the actual measures used (for  instance contact hours) are not necessarily a measure of quality or a guarantee of student outcomes.

In addition, much of the data that we provide to KIS and to Higher Education Statistics Agency is then re-used in various league tables. Here, institutions do not know the algorithms being used by the compilers (at least not in detail) and so there is a danger that institutions now start to try and game the system, to improve a rating, rather than to truly identify areas that need improving.

Conclusion

Evgeny Morozov has produced a thought provoking book, which takes pot-shots at the some of the internet gurus of our age – and hits bull’s-eyes with remarkable frequency.

While the book is not specifically about technology in education, parallels can easily be drawn. Plenty of debate has been appearing online, and for further reading I’d recommend this series of letters between Morozov and Farhad Manjoo on slate.com.

My first week experiences of Surviving Disruptive Technologies MOOC

I’ve started my second MOOC through Coursera, herein labelled as #sdtmooc, which is its putative Twitter hashtag.
This is a significantly different experience from #edcmooc, the University of Edinburgh course I took previously. That was a constructivist learning experience, with a core of highly engaged participants who met and discussed virtually outside of the Coursera discussion forum ecosystem. This isn’t.
What follows now will appear critical – let me be clear, any criticisms are not of the course leader, or indeed of the content, more about the way in which the course is set up to run.

Content

The course is written by Henry Lucas of University of Maryland, and would appear to be based on his textbook on the subject “The Search for Survival”.

Topics covered so far include the survivor model, the innovator’s dilemma, sustaining and disruptive technologies, the box score, organisations, and the demise of Kodak. This will be followed by lectures on the demise of Blockbuster and Borders. The minute that Clay Shirky’s phrase “Napster moment” is used is the time I will quit the course.

Structure and delivery

For #sdtmooc each week is divided into two classes, each of which has 4 short video lectures associated with it. Which when you join then together ,make 2 individual 1 hour lectures, so this doesn’t seem to be doing anything to challenge any educational paradigm. Each video lecture has a single multiple choice question embedded into it to check understanding. Or at least to check if you have been listening for the previous 8 minutes.

The video lectures consist of PowerPoint slides, with a talking head in the bottom corner, and some annotations made to slides as they are delivered. Not wildly exciting.

At the end of each class, participants are asked to use the discussion forums, to both start discussions and comment on those of others. One activity was to list your top 3 technical innovations of the last 25 years, with the reasons why chosen, and then to comment on the suggestions of others. A lot of participants identified the internet. This clearly ignores the fact it is over 25 years old, and their view of it was wholly utopian (shades of #edcmooc creeping in!).

As so often, I found the level of discussion disappointing and intellectually naive. But I accept that this is criticism of myself – I have no way of knowing the previous experience or expertise of other participants.

Initial Impressions

Honestly? The subject matter is interesting, and when we are hearing all the time that MOOCs are a disruptive technology that will affect Higher Education, this would seem to be a relevant course to take.

But I could have learned as much by reading the book. The course so far offers no more than a distributed version of a slightly dull traditional lecture course. The discussion forums have yet to take off with any detailed critique or analysis. And Twitter – well maybe I was spoiled with the way in which participants in #edcmooc used it, but so far there appears to be little happening to excite the twitterati!

I’ll carry on for another week, downloading the PowerPoint files for later reference.