Many higher education institutions use student satisfaction surveys given at the end of a course to measure course and instructor quality. But is that really a true measure of quality? All things being equal, an instructor who teaches a rigorous course will likely score much lower than an instructor whose course is a little less demanding. Then there’s the whole timing of the satisfaction surveys. For the most part, students are simply glad the course is over (even if they liked it) and put little thought or time into completing the survey. Unless of course they know they failed, in which case you will get a detailed assessment of how you are boring, inflexible, out of touch, or otherwise unfit to teach.
No wonder surveys get such a bad rap. If end-of-course evaluations are the only surveys you use, there’s a lot more you can, and should, be doing. Done correctly, surveys can deliver tremendous insight into what’s working, what’s not, and why. This special report features 10 articles from Online Classroom, including a three-part and a five-part series that provides stepby-step guidance on how to use surveys and evaluations to improve online courses, programs, and instruction. You’ll learn when to use surveys, how to design effective survey questions, why it’s important to ensure anonymity, and the advantages and disadvantages of Web-based surveys.
Articles in Online Course Quality Assurance: Using Evaluations and Surveys to Improve Online Teaching and Learning include:
• Online Teaching Fundamentals: What to Evaluate, parts 1-3
• Course and Instructor Evaluation: If It’s So Good, Why Does It Feel So Bad?
• Getting Evaluation Data through Surveys: What to Consider before Getting Started
• Using Surveys to Improve Courses, Programs, and Instruction, parts 1-5
If you’re dedicated to continuous improvement, this special report is loaded with practical advice that will help you create more effective surveys before, during, and after your course ends.
Rob Kelly
Editor
Online Classroom
Shifting from an emphasis on teaching to learning is a complex task for both teachers and students. This paper reports on a qualitative study of teachers in a nurse specialist education programme meeting this shift in a distance education course. The study aimed to gain a better understanding of the teacher-student relationship by addressing research questions in relation to the students' role, the learning process, and the assessment process. A didactical design comprising three phases focusing on distinct learning outcomes for the course was adopted. Data were collected through in-depth interviews with teachers and were analysed using inductive thematic analysis. The results indicate a shift towards a problematising and holistic approach to teaching, learning, and assessment. This shift highlighted a teacher-student relationship with a shared responsibility in the orchestration of the learning experience. The overall picture outlines a distance education experience of process-based assessment characterised by the imposition of teachers’ rules and a lack of creativity due to the limited role of ICT merely as a container of content.
Keywords: Distance education; higher education; e-learning
Technology and the Problem of Change
In November 2005, the province of Ontario and the federal government signed two historic agreements – the Canada-Ontario Labour Market Development Agreement and the Canada-Ontario Labour Market Partnership Agreement. One year later, on Nov. 24, 2006, key labour market stakeholders, including users, delivery agents and government came together to collectively take stock of progress and to explore how partners can help governments move forward with successfully
implementing the agreements.
The symposium, Developing Skills through Partnerships, was co-hosted by Colleges Ontario, the Ontario Chamber of
Commerce, ONESTEP, and the Canadian Policy Research Networks.
In his book, The World is Flat, author Thomas L. Friedman argues the barriers that used to separate countries – such as commerce and the movement of people – are gone, leaving the world more integrated, mobile and open to competition from all. Only countries that understand how to embrace this new reality will thrive in the world economy of the future. Creativity is always looking for a better home, as the Canadian Urban Institute and Jane Jacobs have argued.
• Each year, more than 500,000 students and clients are served by ontario’s colleges of applied arts and technology (caats) . of this group, approximately 200,000 are full-time students .
• there were 197,433 distinct applicants for the 2012-13 academic year .
• Fifty-eight per cent of new fall 2013 entrants to ontario post-secondary institutions enrolled in a college .
• Sixteen per cent of surveyed college applicants were not born in canada; 22 per cent of these individuals came to Canada from 2002 to 2006, while another 40 per cent arrived since 2007 .
• more than one-quarter of college applicants reported a household income of less than $30,000
and 55 per cent had incomes of less than $60,000 .
• total funded full-time equivalent (FtE) post-secondary enrollment in the colleges was 220,721 (including funded full-time, part-time and tuition-short programs) .
• more than 23,000 international students enrolled in Ontario colleges in 2013 .
• Fourteen per cent of ontario college students indicated use of special needs/disability services, almost half of whom reported high usage .
• colleges delivered 87 per cent of the apprenticeship in-school training in 2012-13 .
• last year, more than 82,000 students graduated from post-secondary programs, representing a 4 .8 per cent increase over the previous year .
• Eighty-three per cent of 2011-12 graduates in the labour force were working six months after graduation .
• twenty-four per cent of graduates continued their education with full- or part-time studies within six months of graduation .
The Ontario university sector is already somewhat differentiated. A policy decision to increase the differentiation of the postsecondary system brings the following benefits:
• Higher quality teaching and research programs
• More student choice with easier inter‐institution transfer and mobility
• Greater institutional accountability
• A more globally competitive system
• A more financially sustainable system
Ontario’s postsecondary system can transition seamlessly and incrementally to greater differentiation with the judicious and strategic use of funding strategies already familiar to government. This transition to a more differentiated university sector is guided by principles including:
• Equal value on the teaching and research functions of universities
• Forging a contemporary relationship between Ontario’s colleges and universities
• Linking the differentiation policy to funding decisions
• More effective use of multi‐year accountability agreements and performance
indicators to evaluate whether universities are meeting expected goals and targets.
The Student Success Program (SSP) at George Brown College is designed to foster a supportive college environment for first-year students. The College committed to fund the SSP for a five-year period beginning in 2008-2009. As part of the SSP, a range of academic and non-academic activities are offered to first-year students in order to promote collaborative learning and peer interaction. Some of these activities take place in class, while others are offered outside of class. The SSP components are tailored to programs within individual centres or schools, so as to provide the types of activities best suited to assist first-year students in those areas.
This report was requested and partially funded by the University of Waterloo’s Centre for the Advancement of Co-operative Education (WATCACE), along with funding from the Higher Education Quality Council of Ontario. It presents a customized analysis of findings from three surveys, undertaken in spring 2011 and spring 2012, to gather perspectives from graduating college and university students, postsecondary faculty, and Ontario employers on work-integrated learning (WIL) within a postsecondary program of study. The three surveys were funded by the Higher Education Quality Council of Ontario (HEQCO) and conducted by Academica Group Inc., in partnership with the Ministry of Training, Colleges and Universities (MTCU), the Ministry of Economic Development and Innovation (MEDI), as well as 14 Ontario postsecondary institutions and a variety of student associations and other stakeholders. The surveys were designed to gain a better understanding of student, faculty, and employer experiences with WIL, including motivations and barriers to participation, and perceptions of challenges and benefits. The results presented in this report provide insights into the attitudes and opinions of students and faculty from the University of Waterloo and the Ontario employers most likely to hire University of Waterloo graduates.
This research report represents the first phase of a multi-year collaborative research initiative of the Association of Colleges of Applied Arts and Technology of Ontario.1 The initiative is designed to develop a cohesive picture of the pathways from secondary school to college. The major purpose of this phase of the research was to identify secondary school students’ perceptions of Ontario colleges and of college as a possible post-secondary educational destination for them, and to determine the factors that have shaped these perceptions. A second purpose was to identify secondary school student achievement patterns, graduation rates and course enrolments in order to consider their influence on current and future college enrolments.
The renowned American political sociologist, Seymour Lipset, has been interested in the study of cultural and institutional differences between Canada and the United States ever since he attempted to explain, in his doctoral thesis more than forty years ago, why the first socialist government in North America happened to come to power in Canada. Continental Divide, thus, represents more than forty years of study, reflection, and accumulation of data on differences between Canada and the United States with respect to political values, behaviour, and institutions.
Before you even print off the application forms to request funding for your research project, take some time to review these tips.
Appreciative Inquiry (AI) is a way of helping organizations discover their strengths so they can create an alignment of those strengths, making their weaknesses and problems irrelevant. Since the mid-1980s, thousands of organizations in more
than 100 countries – corporations, businesses, nonprofits, churches, educational and governmental organizations – have used this strengths-based approach to organizational or institutional change and development.
The major assertion of this article is that the present curriculum-development approaches to education are limited in the types of tasks they can address and the level of proficiency they can expect from students. Such approaches may be useful as management tools, allowing the systematic management of instructional activities. However, the approaches may interfere with the quality of the educational process. It seems obvious that one of the goals of teaching reading and mathematics is to facilitate the development of proficiency in these skills. We can contrast mediocre competence with proficient performance of a task. A novice who is trained to achieve mediocre competence can follow rules and procedures with satisfactory levels of speed and accuracy, but has difficulty in applying skills to new situations and in acquiring greater expertise. In contrast, the
attainment of proficient performance implies that a person can perform a skill so well and so efficiently that it can be a building block for the acquisition of additional skills, and is easily extended to unfamiliar tasks. The contrast is between young adults who can read 150-200 words per minute, and get most questions right on comprehension tests, and students who read for enjoyment and view libraries as tools for answering questions. The contrast is between students who can generally follow the steps of a mathematical procedure to get an answer right and students who can recognize which type of mathematical
procedure is needed in order to attack a given problem. Someone who has reached mediocre competence must still concentrate on performing the task correctly. Someone who has achieved proficiency at a task can focus attention on achieving personal and vocational goals.
Over the past decade there has been an upsurge of interest in the quality of postsecondary education, with a particular focus on learning, engagement, and other student outcomes. Instructors, administrators, and other staff across the postsecondary sector have been investigating innovative approaches and services, while many institutions, faculties, departments, and professional associations have established teaching and learning centres or offices to help enhance student success. Governments and governmental organizations have provided support for new approaches and for research projects evaluating them.
This guide, co-sponsored by the McMaster Centre for Leadership in Learning (CLL) and the Higher Education Quality Council of Ontario (HEQCO), and endorsed by the Society for Teaching and Learning in Higher Education (STLHE) and the Canadian Association of College and University Student Services (CACUSS), is intended to assist researchers and evaluators of postsecondary educational outcomes. The intended audiences for this document include, but are by no means restricted to, the following:
• faculty members and educational developers investigating innovative approaches or technologies designed to enhance learning in postsecondary contexts;
• faculty members and administrators leading initiatives for students enrolled in programs or courses that are considered particularly challenging;
• anyone involved in professional development initiatives for faculty, graduate students, and others intended to enhance teaching and learning effectiveness;
• student service providers at postsecondary institutions; and
• students and student associations focusing on effective teaching, learning and student success.
One of the many lessons learned from the early years of distance education is the fact that you cannot simply pluck an instructor out of the classroom, plug him into an online course, and expect him to be effective in this new and challenging medium. Some learned this lesson the hard way, while others took a proactive approach to faculty training. All of us continue to refine our approach and discover our own best practices.
Today, it’s possible to learn much from the mistakes and successes of those who blazed the trail before us. Faculty development for distance educators is a critical component of all successful distance education programs. Well thought-out faculty development weaves together needed training, available resources, and ongoing support, and carries with it the same expectations for quality teaching that institutions of higher education have for their face-to-face classes.
This special report, Faculty Development in Distance Education: Issues, Trends and Tips, features 12 articles pulled from the pages of Distance Education Report, including:
• Faculty Development: Best Practices from World Campus
• Developing Faculty Competency in Online Pedagogy
• A Learner-Centered, Emotionally Engaging Approach to Online Learning
• How to Get the Best Out of Online Adjuncts
• Workload, Promotion, and Tenure Implications of Teaching Online
• Four Steps to Just-in-Time Faculty Training
This report is loaded with practical strategies that can help you build a comprehensive
faculty development program, helping ensure that instructors stay current in both online
pedagogy and practical technical know-how. No matter what the particular character of
your program is, I think you’ll find many ideas you can use in here.
Christopher Hill
Editor
Distance Education Report
chill@magnapubs.com
Students spend an average of 10 days out of the school year taking district-mandated tests and nine days taking state-required tests, according to the Center on Education Policy. Over 12 years of schooling, that adds up to nearly four months of a young person’s life. And that’s just the tip of the iceberg. That number does not include teacher-made tests, quizzes, final exams, many college-admissions tests and pretests; nor does it account for the number of time teachers spend preparing students to take all those exams.
The National Student Financial Wellness Study (NSFWS) is a survey of college students examining the financial attitudes, practices, and knowledge of students from institutions of higher education across the United States. The purpose of the 2014 NSFWS is to gain a more thorough and accurate picture of the financial wellness of college students. The NSFWS was developed and administered by The Ohio State University in collaboration with co-investigators from Cuyahoga Community College, DePaul University, Iowa State University, Oberlin College, Ohio University, and Santa Fe College. The survey was administered online during autumn 2014 or winter 2015 to random samples of students from 52 participating institutions. Please see the following page for a complete list of the institutions that participated in the study. More information on the study is available at go.osu.edu/nsfws or by emailing the NSFWS team at nsfws@osu.edu.
Abstract
The demand for quantitative assessment by external agencies and internal administrators can leave post-secondary instructors confused about the nature and purpose of learning outcomes and fearful that the demand is simply part of the increasing corporatization of the university system. This need not be the case. Developing learning outcomes has a number
of benefits for course design that go beyond program assessment. This article clarifies some key aspects of the push toward using learning outcomes and introduces a tripartite nomenclature for distinguishing among course outcomes, outputs, and objectives. It then outlines a process for instructors to use these three categories to develop and design courses
that meet institutional assessment demands while also improving overall teaching effectiveness.
Résumé
L’évaluation quantitative que demandent les agences externes et les administrateurs internes peut confondre les instructeurs de niveau postsecondaires quant à la nature et à l’objectif des « résultats d’apprentissage », et leur faire craindre que cette demande ne fasse simplement partie de la privatisation croissante du système universitaire. Ce n’est pas forcément le cas. La création de résultats d’apprentissage présente de nombreux avantages sur le plan de la conception de cours, avantages qui vont au-delà de l’évaluation de programme. L’article clarifie quelques aspects principaux de la poussée vers l’utilisation de « résultats d’apprentissage » et présente
une nomenclature tripartite pour faire la distinction entre les résultats de cours, le rendement et les objectifs. Il décrit ensuite un processus pour que les instructeurs emploient ces trois catégories afin de concevoir des cours qui répondent aux exigences en évaluation de l’institution, tout en améliorant l’efficacité de l’enseignement dans son ensemble.
OUSA’s LGBTQ+ Student Experience Survey was a mixed methods research project conducted in Novem-ber 2014 designed to gain understanding of the opinions and experiences of Ontario university students who identify as Lesbian, Gay, Bisexual, Trans, Queer, Questioning, or other orientations or identities that do not conform to cisgender and heterosexual paradigms (LGBTQ+). The purpose of the survey was to identify any gaps that might exist in university services, programming, and supports that can diminish or negatively impact university experiences for these students.