This was a great conference.  I so enjoyed being back in Australia, meeting up with colleagues and friends again, and hearing what they were doing.  I wanted it to go on for days.  The programme is a tribute to the typical creativity and energy that legal educators in Australian law schools are putting into legal education, and into legal education research.  You know it’s high quality when you look at the programme and can’t decide which of the streams you want to attend.  Of the ones I attended the writing skills session stayed with me (see below).  And oddly enough Jenny Buchan et al’s MOOC session, described here, also stayed in mind.  I’m surprised at that because I’ve generally thought of MOOCs as being rather conventional in their methods, and I’ve been uninterested in them for the most part, while acknowledging everything that Stephen Downes, one of my digital ed heroes, has written about them.[1]  I should really rethink.  I think it was way the whole course was well designed, for flexibility and re-use, that I was impressed with.

But three other things remained with me.  First, the conversation I had afterwards with Jenny about her MOOC, where I asked her what platform she had used.  I’d only seen the bits from the presentation but I kind of guessed it was Futurelearn (that’s the UK OU’s platform).  Jenny said they started with Coursera but for a variety of reasons switched to Futurelearn.  I think that there’s a significant difference now between the functionality of Futurelearn and some of the other platforms.  Second, and thinking about what Jenny said, I was struck by the pacing and tempo of the course.  They seemed to have got that just right.  Pacing on something as large as a MOOC might not appear to be one of the critical features of design, but actually I think it’s one of the unregarded skills of legal educational design no matter what form the educational intervention takes.  On a MOOC there’s a balance to be struck between going too slow, and boring/irritating students, and rushing the course, and confusing/irritating students.  I’ve never designed one, but I did study in one, described on this blog post here.  and reflected further on the subsequent post.  Added to that is the extra difficulty of the much wider range of students’ mixed abilities on a MOOC than you would find on, eg, a third year elective on international franchise law.  Jenny and her team seemed to be managing that well – kudos to them.

Third, there’s the problem, that I referred to at questions, of open resources.  Jenny noted that students came up against paywall problems.  A MOOC is wide open to the world.  Perhaps only a small proportion of the student body will have privileged access via a university library to online books and articles, and if the others try to read them without such access, particularly articles, they are asked to pay exorbitant amounts.  I’ve written about this before – here, and here, and especially here – and here’s an extract from the last post to illustrate how serious the situation is:

Research should be open.  Plain and simple.  […]  Publishers don’t contribute at all financially to the massive effort of producing research: our universities, ultimately the public in a variety of ways, pay for that.  But Elsevier and others cream off grotesque profits through their journal publications divisions from already hard-pressed libraries, profit that goes straight into shareholders’ pockets.  They close down research from the general public who have paid for that research, in order to maximise shareholder profit — the public pay to have research produced, then have to pay again to read it.  And pay a third time if they want to read it for free.  The Dutch government put pressure on Elsevier to open access, but in the end settled for what’s really a highly compromised deal.  Back in 2013 the New Yorker summed up Elsevier’s general approach, and it’s only got worse since then:

Elsevier […] is infamous for restricting the flow of scientific information so it can sell research papers for as much as fifty dollars a piece, generating profit margins of thirty-six per cent and netting the company billions of dollars in revenue annually. The company has fought legislation designed to open up academic research, offered scholars money to file positive reviews, sued libraries for oversharing, and allegedly published fake journals on behalf of the pharmaceuticals industry.

MOOCs simply shine a brighter light on a situation that our institutional subscription services allow us to safely ignore.  But if your course is flung open to the world, how is the world going to read the research you want it to read?  As a designer you pour effort and institutional funds into creating a MOOC that will be free at point of access, only for publishers to be charging 50 bucks or whatever per article.  Mitigatory tweaking of the system won’t work for MOOCs (and remember what MOOC stands for – Massive Open Online Course).  Research, like law itself, should be open and free.  Nothing less.  And being in UNSW, the home, jointly with UTS, of that stunning example of open source, namely AUSTLII, only made the issue more pointed.

Another session I thought about later was the one on writing skills.  This blog is about rhetoric amongst other things, largely because that was a large part of my Arts education, and I’ve always been interested in it, not least because it’s been a core of western and northern education for well over two millennia.  The work of Pippa Ryan on the use of discourse markers to help students understand good writing practices, and Sandra Noakes on locating good practice pedagogy to support law student writing was both innovative and exhibited a strong sense of the research work in the field, which was elegantly and economically folded into their work.  Listening to them, and summarising their presentations for the blog I was carried back to my home disciplines, and revisiting the tough challenges that that research presented legal education, all the more poignant because for many centuries the two disciplines of rhetoric and law were so close and intermingled.

So – with reference to Pippa’s work on discourse markers, and to take that work to another stage, I wondered whether an improved structural or rhetorical skill enables students to better memorise, recall, manipulate legal argument? I recalled Kintsch’s work on what he called ‘textbase’ and ‘situation model’. Readers who formed an adequate textbase performed well on memory tasks. They were able to reproduce the text, even to summarise it. But readers whose situation model – that is, their knowledge of the external context of the remembered text—remained deficient, were unable to use the recalled text in tasks requiring inferential acts. As Kintsch says, ‘there is an important difference between just remembering a text and learning from it to perform some kind of action’.[2]  In her description of sophisticated models of support for students’ writing Sandra described much of what we were doing back in the 1980s on The University and Its Ways programme I described in my plenary.

The conference showcased so much good work across the field of legal education, and research coming out of that work – it was so heartening to be there and listen to the intellectual work, the ingenuity, the wit and sheer hard perseverance that went into it all.  And yet there are significant problems that remain for our research in legal education, and they don’t get any better.  Here’s part of my abstract, where I describe the situation:

In almost every common law jurisdiction the review of legal education has become more sophisticated and more complex.  It has not been matched by concomitant increase in the sophistication and complexity of the empirical research base, nor in the organisation of that research.  As we pointed out in the LETR Report (2013), there are significant gaps in legal educational research.  There is little co-ordination of research initiatives between academy and regulators on a sustained basis.  There is little organisation by the academy of the increasing volume of research that it produces on legal education: a significant lack of longitudinal studies, very few ongoing and sustained data studies, no meta-reviews, almost no systematic reviews of literature, almost no policy paper series, little in the way of a stream of historical literature on legal education that feeds into current developments and future innovation.  Such lack of organisation and the thin historical awareness that it gives rise to, I argue, constitutes a bar to the development of a rich legal educational research paradigm, and seriously affects our ability to generate, curate and argue from evidence-based data.

I’ll be writing up my plenary later, and I’ll support these claims and demonstrate the effects that they have on our discipline.  For now, though, I should say that the Themis initiative, jointly with Julian and Alex and others in due course, is designed to help remedy the situation; and I’ll be writing more about that on this blog and elsewhere.

Finally, the conference was a tribute to the creativity and energy of the conference team at UNSW.  A huge thanks to Alex Steel, Ben Golding, Rebecca Crosby and the rest of the team for inviting me, and for putting on a great event.  It was a privilege to be there.  There was mention of publication, and another conference in the future (once the team has recovered…).  Don’t miss it.

{ 0 comments }

Sally Kift first, talking on regulatory pressures.  She summarised the pressures.  She mentioned working with the profession to bring them with us, and the importance of ethical judgment as well as strategy, creativity, empathy, reasoning, social intelligence.  Sally argued that we need to be more active on the issue.  She argued as I did for digital capabilities being developed.  Sally outlined dangerous (my word) directions of LACC – is it setting the scene for an Australian SQE? She also outlined the Productivity Commission Report, and its very discouraging (my word) approach to student numbers.  Student voice, she emphasised, was essential, and we need to enhance it.

Kate Galloway (Bond) next, on ‘Publishing legal education research – challenges, rationales, futures’.  Research metrics dominate to the exclusion of legal ed research.  Research needs validated; we need to be more interdisciplinary; we need to educate the regulators.  As academics we need a progressive approach to legal education, and research to analyse the outcomes.  Beyond that, should we be training lawyers, or teaching graduates to solve legal problems?

Prue Vines (UNSW) next, on the importance of validity and how we think about it.  Why is this important?  Because it marks our research as being authoritative, if our research is valid.  With validity comes reliability.  Sufficient evidence is required to support our claims.  Two groups need to believe us.  First, we need to explain to the profession why we want to do what we do, and maybe not what it wants us to do.  Second, we need to explain to our university what we do and why, and we need to stand up for that.  Longitudinal research is valuable as evidence for both audiences.

Finally, Sarah O’Shea (Wollongong).  Her field is educational equity, and she focused on the first generation students, her research, and she told us about that.  She works within narrative, biographical frameworks, getting students to tell their stories.  She advised thinking about theoretical frames for legal educational research.  She experiments with unusual output formats and dissemination outlets – eg her First-in-Family website, videotape, tweeting, LinkedIn, blog, YouTube, etc.  Funding? Global Challenges Research Fund and similar.  Creative intersections include first in family student identity work in professional degrees, how students form diver backgrounds translate disciplinary language and terminology used in specific fields of study.

Great slides, great overviews of the issues from all speakers. Final thoughts later…

{ 0 comments }

This session is called ‘Writing for Law’.  First up, Philippa Ryan (UTS), on ‘Teaching law students the role of discourse markers’.  To improve their self assessment skills, their academic legal writing and how technology works.  Use natural language processing (NLP) to create an app to show the features of good academic writing. Why teach students about NLP?

Existing scholarship on enhancing learning through self-assessment.  How are law students’ essays assessed?  Used a tool called AWA – Academic Writing Tool, with highlighted text, purple, green and yellow.  Tags include question, position, etc.  Students feedback, neutral.  Reason?  Might not understand grammar.  So explained grammar to students.  Didn’t work too well.  Second intervention was teaching students the app’s discourse markers.  Discourse markers are procedural in text – however, furthermore, in the next three examples, in summary etc.  Break through was when she gave students a text with the discourse markers stripped out and asked them to put them back in.  Feedback was good.   Conclusions?  To improve self-assessment, students need meaningful interventions; a cause for pause.  Understanding the mechanics of discourse markers can improve academic writing.  Understanding the mechanics of grammar can improve students’ understanding of natural language processing technologies.

Great tasks.  I did something similar with students in reading and writing (without the tech), and found that this sort of task was useful to help students understand the legal reading process.  I’ve published on some of that in Transforming Legal Education.

Next, Sandra Noakes (WSU), on ‘Getting it write: locating good practice pedagogy to support and develop law student writing’.   She commented that law schools aren’t adopting best practices in writing skills.  Comms skills are essential, according to all the regulatory standards.  Writing instruction adopt non-linear processes used by successful writers to be embedded within classes; and understanding of student literacy, and there is a need for interdisciplinary analysis. Adopts New Literacy Studies, eg James Paul Gee.  Models of writing support in HE takes three models – academic skills approach – decontextualised skills, deficit model.  Academic socialisation, sociocultural aspects of literacy recognised, enculturation emphasised, but the process is not seen as problematic.  Academic Literacies is closely allied to New Lit Studies, and seeks to deonstrate gaps between students’ understanding and staff assumptions.

So what are law schools doing in AU? Sandra conducted interviews and used information on websites of then 38 law schools.  She used the work of Carmela Briguglio and Shalini Watson: ‘Embedding English across the curriculum in Higher Education: A continuum of development support.  2014 27, 1, Australian J of Language & Literacy, 67.   She analysed the types of support being offered by law schools.  Type 1 support is based on academic skills model, the deficit paradigm, is exclusionary, surface writing features, and voluntary.  Type 2 was In-faculty support, ie assigning all specialist to faculty.  Actually this is good for teaching academics not individual students.  Do teaching academics access this support?  Probably not.  Type 3 support was integrated support, characterised by eg credit-bearing language units, stand alone first year legal skills subject, with instruction in writing.  Embraces socio-cultural understandings of literacy, and enculturation by discipline experts.  But it’s still not embedded – it’s additional, and the shortcomings are identified in the US legal writing courses.  Type 4 is the fully integrated support model..  Adopted by 20 out of 38 law schools, used in first year foundations, common first year academic literacy subject.  Best practice mode, inclusive, emphasises literacy in context, as mastery of discourse.  Model is relevant to TEQSA & TLO5.  But there are challenges.  Resistance from teaching academics; making the ‘obvious’ explicit; it’s labour intensive; requires re-design of subjects; embedding beyond subject level is difficulty.

Two really interesting papers, full of insight and absorbing details on the writing process.  Learned a lot from them both.

{ 0 comments }

Day 2, session 2, UNSW legal education research conference

December 5, 2017

This session is called ‘Face to face or online?’.  First up, Christina Do and Leigh Smith (Curtin U), on ‘The importance of f2f teaching’.  They started by noting how digital literacy was becoming more important.  Colbran’s research was cited, and points to the increasing development of online courses.   Is this a good thing, they […]

Read the full article →

Plenary, Carrie Menkel-Meadow: ‘Thinking or acting like a lawyer?  What we don’t know about legal education and are afraid to ask’.

December 5, 2017

Carrie Menkel-Meadow needs no introduction.  She’s looking at six claims that things change legal education and lawyering.  Her slides are dense with information, so will do what I can to summarise the myths and their details. Myth 1: legal education = think like a lawyer. What about doctrine in CL and civil jurisdictions.  Method is […]

Read the full article →

Session 1, day 2, UNSW legal research conference

December 4, 2017

This session is called ‘Technology: disrupting legal education’.  First up, Michael Adams, giving us ‘Law and technology: 20 year reflections’.  Started with a roundup of hardware.  According to him underlying pedagogy has not changed; though technology, he says has changed teaching.  Not sure I agree with that.  Mentioned LMSs, showed market placings of LMSs, mentioned […]

Read the full article →

Parallel session 3, day 1 UNSW legal education research conference

December 4, 2017

This session is entitled Technology: disrupting legal education?  First, Lyria Bennett Moses, from UNSW on ‘The need for lawyers’.  I came in late (tea break…), but Lyria is talking about the use in admin law of data for machine learning and expert systems delivery of judicial roles and decisions.  Lyria teaches expert systems: key message […]

Read the full article →

Parallel session 2, UNSW legal education research conference

December 4, 2017

The session I attended out of three was ‘The landscape of legal education scholarship’.  First up, Kate Galloway, Melissa Castan and Alex Steel, on ‘Towards a taxonomy of legal education research’.  I’d mentioned the subject in the keynote, and lo, there’s a paper on it, already minted.  Their SoLE Project is an examination of legal […]

Read the full article →

Parallel session 1, UNSW legal research conference

December 4, 2017

First up, Tony Bradney, talking on ‘Who controls university legal education in UK’.  In contemporary E+W the value of legal education research has grown in value in a pragmatic sense.  It gives law schools a sense of what they want to do in their courses and schools.  Tony described the situation re the SQE that […]

Read the full article →

Legal research conference, UNSW, day 1

December 3, 2017

I’m in Sydney for the conference on legal research at UNSW, and kindly invited by Alex Steel to give a keynote at it.  Title, not short on polysyllables – Prometheus, Sisyphus and Themis: three rival futures for legal education research.  Slides at the usual places, at Slideshare and at the Slides tab above.  I’ll be […]

Read the full article →
Follow me on Academia.edu