Many higher education institutions use student satisfaction surveys given at the end of a course to measure course and instructor quality. But is that really a true measure of quality? All things being equal, an instructor who teaches a rigorous course will likely score much lower than an instructor whose course is a little less demanding. Then there’s the whole timing of the satisfaction surveys. For the most part, students are simply glad the course is over (even if they liked it) and put little thought or time into completing the survey. Unless of course they know they failed, in which case you will get a detailed assessment of how you are boring, inflexible, out of touch, or otherwise unfit to teach.
No wonder surveys get such a bad rap. If end-of-course evaluations are the only surveys you use, there’s a lot more you can, and should, be doing. Done correctly, surveys can deliver tremendous insight into what’s working, what’s not, and why. This special report features 10 articles from Online Classroom, including a three-part and a five-part series that provides stepby-step guidance on how to use surveys and evaluations to improve online courses, programs, and instruction. You’ll learn when to use surveys, how to design effective survey questions, why it’s important to ensure anonymity, and the advantages and disadvantages of Web-based surveys.
Articles in Online Course Quality Assurance: Using Evaluations and Surveys to Improve Online Teaching and Learning include:
• Online Teaching Fundamentals: What to Evaluate, parts 1-3
• Course and Instructor Evaluation: If It’s So Good, Why Does It Feel So Bad?
• Getting Evaluation Data through Surveys: What to Consider before Getting Started
• Using Surveys to Improve Courses, Programs, and Instruction, parts 1-5
If you’re dedicated to continuous improvement, this special report is loaded with practical advice that will help you create more effective surveys before, during, and after your course ends.
Rob Kelly
Editor
Online Classroom
The exploration of study orchestrations emphasises students’ active participation in learning, describing the ways in which they marshal the resources available to them in response to their learning environment. This study reports the identification of study orchestrations in a group of distance students and identifies the existence of dissonant study orchestrations, which previous research has linked with poor achievement, in approximately one-fifth of the group. Data came from responses by 176 students to the ASSIST questionnaire. The data was subject to factor analysis to ensure commensurability with previous studies, and then cluster analysis was used to identify groups with similar study orchestrations. Four clusters were identified. One of these was clearly dissonant, pointing toward problematic links between learning environments and student approaches to study. The implications of dissonant study orchestrations are explored and further research is suggested, along with implications for the practice of distance educators.
Keywords: Approaches to study; study orchestrations; metacognition; higher education
Recognise your social and digital media efforts as part of the research process
We are aware that social media can often feel like an additional burden to academics’ already busy workload. To avoid social media burnout, find out where these tools might fit more systematically in the wider network of interactions informing and communicating your research. Research has always been a social process and there are bound to be many opportunities for you to explore these social aspects further. Our book aims to provide a framework to help you explore different ways of employing social media throughout the research lifecycle.
Ontario firms and organizations are being challenged to increase productivity through innovation in order to compete on the fiercely competitive world stage and improve the quality of life of Ontarians. Yet, Ontario suffers from innovation gaps
that place its productivity and prosperity goals at risk.
Ontario’s 24 Colleges of Applied Arts and Technology have long been recognized for their contributions to career-oriented education and training programs that have strengthened the Ontario economy throughout the latter part of the 20th century.
Poised on the threshold of the 21st century, college-based applied research and development (R&D) and business and industry innovation activities are of ever increasing importance to the achievement of Ontario’s productivity and prosperity
goals.
Colleges recommend that, beginning in 2006/07, the Government of Ontario establish a new, forward-looking provincial research and innovation policy framework and launch three strategic programs to bolster college capacity to support
business and industry through applied R&D, innovation and commercialization activities over the next decade, at a cost of $50 million over first five years.
The ability of students to move between colleges and universities is an activity, often expected by students, intended to combine the strengths of both sectors and support the pursuit of continuous lifelong learning. Students in Ontario have been ahead of educators and planners in “discovering the value of combining the strengths of the colleges in hands-on learning with the
strengths of the universities in academic education” (Jones & Skolnik, 2009, p.22). The College University Consortium Council (CUCC), established in 1996, was created, in part, to facilitate such activity. The Advisory Panel on Future Directions for Postsecondary Education produced a report, Excellence, Accessibility, Responsibility, which endorsed the CUCC as the objective body that would facilitate “province-wide information collection and comparative analysis” to assist all stakeholders in decision-making affecting postsecondary education (Smith et al,1996, p.48). The Investing in Students Task Force cited the CUCC in its 2001 report, advocating, among other things, for the body to “assess and evaluate the existing mechanism” of transfer
between the college and university systems (Investing in Students Task Force, 2001, p.20). Traditionally, Ontario has not held a coherent postsecondary education system with collaborative sectors, but rather two systems, college and university. The colleges were established to be comprehensive institutions that were occupation oriented and designed to meet the needs of the local community. These institutions were an alternative for those who were not inclined to purely academic pursuits and who did not have the qualifications to gain entry to university.
In 2004, in the discussion paper launching the Ontario Postsecondary Review, a student expressed his desire for “the freedom to move between programs or institutions with recognition of my previous work so that I can obtain an education as unique as I hope my career will be” (Rae, 2004, p.19). However, the paper continued by describing the existing situation as a
patchwork of institutional agreements that “cover only a fraction of existing programs”; therefore,in order to “ensure that its public institutions can meet the growing expectations of students and employers, and operate as a coherent system”, Ontario would need to establish a system to set “standards for credit recognition and student transferability between institutions” (p.21).
Attempts to formalize seamless pathways, however, have been confounded by a lack of data to support claims of student demand and actual movement, particularly from college to university.
Ontario colleges were not established to facilitate transfer, but the pursuit of articulation agreements by the institutions themselves and the historic movement of students into universities have legitimized this function as one of its main activities.
The Ontario government’s mandated collection of key performance indicators (KPIs) provides one opportunity to analyze provincial data that is systematically collected in a consistent manner. The Graduate Satisfaction Survey is used to calculate the results of two of the KPIs1, employment rate and graduate satisfaction. Additionally, the survey asks graduates if they have enrolled in an educational institution; students identify which institution and program. In 2005,the colleges and the MTCU decided to expand the survey for those who indicated that they had continued their education after graduation. Therefore, in 2006-07 a modified Graduate Satisfaction Survey with new transfer related questions was introduced. These additions and changes have enabled a deeper analysis of student movement between and within institutions or sectors.
The new questions were included to capture data that could better inform colleges about the students who graduate from their respective institutions. The questions on transfer were also intended to assist the government on matters that could affect policy with respect to student movement, particularly between postsecondary sectors. In addition to documenting the program and institutional destination of graduates seeking further education, the graduate survey now gathers information on the motivation for continuing, the source of transfer information, the amount of transfer credit received, the timing of notification for credit, the relationship to the previous program, the satisfaction with the transfer experience and the satisfaction with college preparation for further studies. This report is the first comprehensive analysis of the new questions from the first year of administration (2006-07).
One of the many lessons learned from the early years of distance education is the fact that you cannot simply pluck an instructor out of the classroom, plug him into an online course, and expect him to be effective in this new and challenging medium. Some learned this lesson the hard way, while others took a proactive approach to faculty training. All of us continue to refine our approach and discover our own best practices.
Today, it’s possible to learn much from the mistakes and successes of those who blazed the trail before us. Faculty development for distance educators is a critical component of all successful distance education programs. Well thought-out faculty development weaves together needed training, available resources, and ongoing support, and carries with it the same expectations for quality teaching that institutions of higher education have for their face-to-face classes.
This special report, Faculty Development in Distance Education: Issues, Trends and Tips, features 12 articles pulled from the pages of Distance Education Report, including:
• Faculty Development: Best Practices from World Campus
• Developing Faculty Competency in Online Pedagogy
• A Learner-Centered, Emotionally Engaging Approach to Online Learning
• How to Get the Best Out of Online Adjuncts
• Workload, Promotion, and Tenure Implications of Teaching Online
• Four Steps to Just-in-Time Faculty Training
This report is loaded with practical strategies that can help you build a comprehensive
faculty development program, helping ensure that instructors stay current in both online
pedagogy and practical technical know-how. No matter what the particular character of
your program is, I think you’ll find many ideas you can use in here.
Christopher Hill
Editor
Distance Education Report
[email protected]
The Colleges of Applied Arts and Technology of Ontario (CAATs) are engaged in a wide range of international activities which have not previously been the subject of any in-depth study. This thesis provides the first comprehensive examination of the international student recruitment and educational export activities of the CAATs. This study, relying on literature reviews, a survey of the colleges and interviews with college administrators, explores the historical evolution of recruitment and export activities, the motivation behind participation in these activities and the financial implications of export and recruitment. The study also reviews some of the linkages between international student recruitment and export and internationalization and globalization.
By enhancing communication with students, ONCAT both increases their awareness of transfer opportunities and facilitates their ability to transfer. ONCAT works with students, through its advisory board, by engaging with student leaders and participating in student fairs, to ensure that there is a better understanding of the transfer and mobility opportunities afforded by our system.
Is it just that time of the semester, or are academics more and more stressed out? In the past week alone, I’ve talked with:
-A colleague emotionally reeling from counseling two students who each had a parent die this semester.
-Another unsettled colleague who received an expletive-filled email from an angry student demanding to "speak to your supervisor."
-A friend at another institution buried under a mountain of papers — the product of a fourth course that he’s teaching on overload to make a little extra money.
Business, political, and educational leaders are increasingly asking schools to integrate development of skills such as problem solving, critical thinking, and collaboration into the teaching and learning of academic subjects. These skills are often referred to as “21st century skills” or “deeper learning.”
At the request of several foundations, the National Research Council appointed a committee of experts in education, psychology, and economics to more clearly define “deeper learning” and “21st century skills,” consider these skills’ importance for positive outcomes in education, work, and other areas of life, address how to teach them, and examine related
issues.
The professional development of new university instructors has received considerable investments of resources at Canadian universities, but the impact of these efforts has only rarely been evaluated or studied. Universities in Ontario have witnessed and participated in the formation of teaching and learning units responsible for professional development of academics since the mid-1980s (Landolfi, 2007). These units have been responsible for the development of programs to address the pedagogical needs of university instructors, with the goal of making them more effective (Ibid.).
In situations of decreased availability of funding, individual university support for central teaching and learning units has oscillated. This has often required that they operate with inadequate financial support and a minimal number of full-time employees. Currently, the four smallest units in Ontario universities operate with only one to three staff members.
While the formal training of postsecondary educators and the issue of enforcing mandatory training of academic teaching staff has been broadly accepted in colleges for years (see volume 2 of this report which will follow in 2012), the same issue has recently been discussed more frequently among universities as well at the level of teaching professionals and policy makers, with intense controversy on either side of the debate.
New Faculty Orientations (NFOs) – an induction program for newly hired faculty members at the beginning of their teaching careers – vary widely in the content delivered across different Ontario universities. While some simply provide a general introduction to a particular university’s settings, and/or a list of local resources for the new faculty members to choose and use as they see fit, others focus on specific teaching skills and organize a series of sessions, which explore a variety of teaching and learning issues and strategies.
Surprisingly, of the 20 institutions surveyed there are only two Ontario universities that still do not organize NFOs for new teaching staff even though they have established teaching and learning centres. In these instances, new faculty members receive a general orientation provided by the President’s Office and Faculty Recruitment departments, as well as their faculties. Other findings from this study include the following:
• The majority of Ontario universities (72 per cent) include both contract instructors and full-time faculty members in their orientation sessions.
• Only in two Ontario universities is orientation mandatory for all newly hired faculty members. In other institutions where NFO attendance is voluntary, participation varies from 40 per cent to 85 per cent.
• In terms of the cost of new faculty orientation, data differ from institution to institution, with a few
institutions spending a modest amount of $1,000 and others (the minority) spending about $35,000 on NFOs per annum.
The top five separate sessions that are typically included for NFOs at Ontario universities are, in this order:
a) greetings/conversation with VP Academic Provost,
b) academic policies and procedures,
c) classroom teaching management methods,
d) teaching with technology, and
e) a panel/discussion with experienced faculty members.
This study investigates the validity, within an Ontario college, of the U.S.-based Community College Survey of Student Engagement (CCSSE) benchmarks of effective educational practices, formally referred to as the Model of Effective Educational Practices (MEEP). MEEP factors include active and collaborative learning; student effort, academic challenge, studentfaculty
interaction, and support for learners. The validity of CCSSE was explored for this study through analysis of the model fit of MEEP and analysis of its correlations and capacity to predict five academic outcomes based on a sample of Ontario students that completed CCSSE during the Winter 2009 semester. Results of the analyses reveal that MEEP exhibits good model fit and that three of the five benchmarks were consistently correlated with the five selected academic outcomes (self-reported GPA, semester GPA, cumulative GPA, cumulative credit completion ratio, and percentage of courses completed with a grade of 70 per cent or higher). After controlling for subject characteristics, two of the five benchmarks, active and collaborative learning and academic challenge were identified as predictors of most of the academic outcomes.
Colleges and institutes contribute to the research and innovation cycle in Canada through applied research. More specifically, they directly contribute to applied research through enhanced research infrastructure, involvement of faculty and students, and
the creation of partnerships with the business, industry and social innovation sectors. Colleges and institutes receive the
majority of their funding from the Government of Canada.
Abstract
David Mamet’s play Oleanna may be infamous for reasons that do not do justice to the play’s real accomplishments. One reason for the controversy is the author’s apparent focus on sexual harassment. The play is not about sexual harassment. It is about power. And in particular the power of language to shape relationships within social environments such as universities. First
published and performed in 1992 - at a time when many were outraged by the Clarence Thomas - Anita Hill debate - the playwright himself was compelled to deny his play was about sexual aggravation. Mamet’s Oleanna serves to instruct
us about the power dynamics within one of our most vital institutions.
The aim of this article is to take a dedicated look at this dramatic spectacle to see if we cannot uncover something about leadership and the mechanics of power and communication in higher education that is intellectually riveting,
as well as socially constructive.
Résumé
La réputation d’Oleanna, pièce de David Mamet, ne rend pas justice aux accomplissements réels de l’oeuvre. C’est qu’elle a suscité la controverse en traitant du harcèlement sexuel, du moins si l’on en croit tout ce qui a été écrit à son sujet. Erreur, puisque le thème est celui du pouvoir, en particulier du pouvoir du langage dans les relations au sein de nos grandes institutions
sociales, comme les collèges et les universités. Après la présentation initiale en 1992 (pendant le scandale entourant l’affaire Clarence Thomas-Anita Hill),
l’auteur a nié avoir écrit sur le harcèlement sexuel. Reposant sur le jeu de deux CJHE / RCES Volume 44, No. 1, 2014
Power play / P. Chiaramonte 39 acteurs, la pièce en trois actes ratisse plus large. Elle révèle la dynamique du pouvoir dans l’enseignement supérieur, un fleuron institutionnel. Notre analyse porte sur le regard stimulant et constructif que pose Mamet sur ce milieu : ses instances dirigeantes, son évolution, sa mécanique du pouvoir et ses communications.
Social Media Usage Trends Among Higher Education Faculty
The numbers surrounding social media are simply mind boggling.
750 million. The number of active Facebook users, which means if Facebook was a country it would be the third-largest in the world.
90. Pieces of content created each month by the average Facebook user.
175 million. The Twitter accounts opened during Twitter's history.
140 million. The average number of Tweets people sent per day in February 2011.
460,000. Average number of new Twitter accounts created each day during February 2011.
120 million. LinkedIn members as of August 4, 2011.
More than two per second. The average rate at which professionals are signing up to join LinkedIn as of June 30, 2011.
All of these stats, which come from the respective companies’ own websites, serve as proof points to what we already knew: social media is growing at breakneck speed. Yet the story of social media is still being written as organizations and individuals alike continue to evaluate the benefits and drawbacks of social media in the workplace. When that workplace is a college or university, there’s a cacophony of opinions in terms of the most effective uses, if any.
For the past two years, Faculty Focus conducted a survey on Twitter usage in higher education, this year we expanded the survey to include Facebook and LinkedIn, while changing a number of the questions as well. Twitter, Facebook, and LinkedIn are considered "the big three" in social media, and we thank those who recommended we take a
broader look at the landscape.
All three platforms have their strengths and weaknesses, and are better used for some things than others. But how are the three being used in higher education today? It’s our hope that these survey results provide at least some of the answers while lending new data to the discussion.
Motivating students to be enthusiastically receptive is one of the most important aspects of mathematics instruction and a critical aspect of any curriculum. Effective teachers focus attention on the less interested students as well as the motivated ones. Here are nine techniques—based on intrinsic and extrinsic motivation—that can be used to
motivate secondary school students in mathematics.
“Pop leadership” philosophy abounds in our culture today. Book stores have shelves full of books on leader ship. Leaders and leadership are discussed daily on tele vision, radio, newspapers, magazines and on the web. As a result, many mixed messages about leadership are expressed. So – how do you decide what is accurate?
As laptops become smaller and more ubiquitous, and with the advent of tablets, the idea of taking notes by hand just seems old-fashioned to many students today. Typing your notes is faster — which comes in handy when there's a lot of information to take down. But it turns out there are still advantages to doing things the old-fashioned way.
For one thing, research shows that laptops and tablets have a tendency to be distracting — it's so easy to click over to Facebook in that dull lecture. And a study has shown that the fact that you have to be slower when you take notes by hand is what makes it more useful in the long run.
Every higher education institution today faces the complex challenges of serving increased enrollment levels within tight budgets. Adding to the complexity are new student expectations for the when, where and how of learning — where passive listening and doing classwork in isolation are no longer acceptable.
These challenges are prompting many colleges and universities to explore new approaches, especially blended learning, for delivering courses. Blended learning delivers higher levels of learning interactivity and collaboration and
— more importantly for student and institutional success
— higher levels of student engagement.
This morning I will speak to what we must do next to more effectively address the continuing problem of student attrition in higher education. To do so I will briefly look back on what is now a thirty-year history of research & practice on student retention and reflect on the lessons we have learned over that time. I will argue that we have yet to attend to the deeper educational issues that ultimately shape student success in higher education. Until we do so, our efforts will always be less effective than we desire.