Categories
Advice and Guidance

AI and Jisc’s Leadership Survey

News on a mobile phone

Each year at Jisc we run a leadership survey, which is sent to leaders in HE and FE, with responses from vice-chancellors and principals, technology and library strategic leaders and more.  The latest was sent during the spring of this year.

The survey asks several questions about the perception of Jisc and our services, the challenges our members face, and, this year, dived into AI in more detail.

We received responses from over 600 people from 134 HE institutions and 258 FE institutions, so it gives a great overview.  In this post, we’ll look at the results around AI.

About the questions

For the challenges question, AI was included in the challenges institutions could select from as their most pressing challenges, picking up to five.

With our AI questions, we wanted to understand where institutions were with some of the key areas of our maturity model, and how they were using AI. The three questions we asked around this covered:

  • What AI activities you have undertaken, with options from our AI readiness checklist.
  • Whether you felt prepared on some key AI issues.
  • How AI was being used in the institutions.

We get multiple responses per institution, so we took a ‘most optimistic answer’ approach for each answer, on the basis that if someone from the organisation knew an activity was happening it probably was.

The results

Challenges

Respondents could pick five top challenges from a list of common challenges, including topics such as cyber security, AI, staff retention, escalating costs etc.  The results for AI were as follows:

Higher Education

AI was the second most frequently cited challenge (47%) over the next 12 months; up from 16th place (15%) in 2023 to 2nd in 2024.  Cybersecurity was the most cited.

Further Education

AI is the top challenge over the next 12 months alongside cyber security (58%); up from 14th (13%) to joint 1st  place with cyber security.

Activities

For the first AI-specific question, we wanted to see which of a set of key activities institutions had done.  These were taken from our ‘Principles to Practice’ checklist, and cover initial actions around working groups, guidance and staff development.

The question was phrased as:

“With regards to Artificial Intelligence (AI), has your organisation done any of the following?” 

Further Education Results

Bar chart titled ‘FE: With regards to Artificial Intelligence (AI), has your organisation done any of the following?’ displaying survey results in percentages for four categories: Produced guidance for students/learners: Yes (32%), Planning to (49%), Not Considering (3%), Don’t Know (16%), No (0%) Set up a programme of staff development: Yes (33%), Planning to (50%), Not Considering (2%), Don’t Know (15%), No (0%) Reviewed academic policies: Yes (53%), Planning to (33%), Not Considering (3%), Don’t Know (11%), No (0%) Have an organisational working group: Yes (53%), Planning to (29%), Not Considering (7%), Don’t Know (11%), No (0%) The bars are color-coded with blue for ‘Yes’, orange for ‘Planning to’, grey for ‘Not Considering’, yellow for ‘Don’t Know’, and green for ‘No’. The chart provides insights into how different organisations are approaching AI in terms of policy development and planning."

We noted that many colleges are still in the planning stage for guidance and staff development, and felt we could help with this, by producing example starter templates:

These are available on the blog, covering staff and learners.

We have also since launched a programme of training webinars to help with staff development, including making the resources available to members.

Higher Education Results

"Bar graph titled ‘HE: With regards to Artificial Intelligence (AI), has your organisation done any of the following?’ displaying survey results with the following statements and responses: Produced guidance for all students/learners: Yes (75), Planning (19), Not Considering (5), Don’t Know (1) Produced guidance for all staff: Yes (28), Planning (27), Not Considering (6), Don’t Know (18) Set up a programme of staff development: Yes (30), Planning (46), Not Considering (6), Don’t Know (18) Reviewed academic policies: Yes (81), Planning (13), Not Considering (16), Don’t Know (0) Have an organisational working group: Yes (83), Planning (10), Not Considering (4), Don’t Know (3)

Overall, we felt the figures in higher education showed that Universities are well prepared, with most having completed the core activities, and moving to plan staff development.  We felt this showed no specific support was needed on these tasks.

How Prepared?

We then asked:

“Is your organisation sufficiently prepared on the following issues related to AI?”

The main purpose of asking this was to help us consider where to focus our attention.

Further Education Results

Bar graph displaying the preparedness of institutions on AI-related issues, with vertical axis ranging from 0 to 100% and horizontal axis listing issues such as Data Protection, Academic Integrity, IPR, Safety, and Equality of Access. Data Protection shows the highest level of preparedness, while Equality of Access is among the lowest.

We note that the majority of colleges were feeling insufficiently prepared across the board,  which is perhaps unsurprising given the pace of change, and as a result, our focus remains balanced.

Higher Education Results

“A bar chart illustrating the preparedness of institutions on AI-related issues in higher education. The chart indicates that 32% of institutions are prepared for Data Protection, 53% for Academic Integrity, 22% for Intellectual Property Rights (IPR), 18% for Safety, and 16% for Equality of Access.”

The results follow a similar pattern to FE, with stronger confidence around academic integrity.

Using AI

The final set of questions were to get a feel for where AI was being used in institutions.  We know the areas we picked as options are very much open to interpretations, and the data wouldn’t be readily available, so the answer would be very much based on people’s view across the organisation.  We still think it is useful though to get a broad picture.

“Are you using AI for the following in your organisation?”

Further Education Results

A graph displaying the number of institutions using AI for various purposes with the following data: Teaching and Learning preparation: Yes (58), Planning to (21), Not Considering (4), Don’t Know (18) Teaching and Learning delivery: Yes (40), Planning to (31), Not Considering (6), Don’t Know (23) Assessment and feedback: Yes (28), Planning to (34), Not Considering (8), Don’t Know (30) Business reporting/analysis: Yes (19), Planning to (36), Not Considering (13), Don’t Know (32) Marketing and communications: Yes (20), Planning to (28), Not Considering (11), Don’t Know (40) Planning: Yes (21), Planning to (29), Not Considering (12), Don’t Know (37) The graph provides a clear overview of the adoption and consideration of AI in different operational areas within institutions."

As mentioned above, the results are just to give a feel for the balance of activity and are open to a lot of interpretation.  Still, we can see a lot of activity around learning and teaching preparation in our colleges, which matches what we see on the ground, and with the success of tools such as Teachermatic.

We expected a lot of ‘Don’t know’ here, and that’s what we got – we think there is probably a lot of activity happening at a smaller scale in departments which isn’t known across the institution.

Higher Education ResultsTeaching and Learning preparation: Yes (49), Planning to (19), Not Considering (4), Don’t Know (28) Teaching and Learning delivery: Yes (40), Planning to (25), Not Considering (7), Don’t Know (28) Assessment and feedback: Yes (24), Planning to (28), Not Considering (11), Don’t Know (37) Business reporting/analysis: Yes (21), Planning to (42), Not Considering (7), Don’t Know (30) Marketing and communications: Yes (18), Planning to (29), Not Considering (12), Don’t Know (41) Planning: Yes (10), Planning to (31), Not Considering (12), Don’t Know (48) Research admin: Yes (13), Planning to (31), Not Considering (25), Don’t Know (31)

The higher education results follow a similar pattern to FE, with learning and teaching preparation being the most cited. and a similar expected pattern of ‘Don’t know‘.

Conclusions

The results very much match our expectations from discussions with members.  A lot has happened to ensure institutions are meeting the challenges and opportunities of AI, with widespread working groups, advice and guidance to students and planning for training.  The use of generative AI is spreading across the institution, particularly around learning and teaching.

Yet still, institutions don’t feel prepared.  This isn’t surprising given the pace of change, and from our perspective, shows a continued need for us to expand our advice, guidance and training and to continue to bring the community together to work together on shared challenges.


Find out more by visiting our Artificial Intelligence page to view publications and resources, join us for events and discover what AI has to offer through our range of interactive online demos.

For regular updates from the team sign up to our mailing list.

Get in touch with the team directly at AI@jisc.ac.uk

Leave a Reply

Your email address will not be published. Required fields are marked *