There is currently a powerful push-pull factor in schooling. The push factor is that school is increasingly boring for students and alienating for teachers. The pull fac-tor is that the exploding and alluring digital world is irresistible, but not necessarily productive in its raw form. The push-pull dynamic makes it inevitable that disruptive changes will occur. I have been part of a group that has been developing innova-tive responses to the current challenges. This response consists of integrating three components: deep learning goals, new pedagogies, and technology. The result will be more radical change in the next five years than has occurred in the past 50 years.
In 2008, the OECD launched the AHELO feasibility study, an initiative with the objective to assess whether it is possible to develop international measures of learning outcomes in higher education.
Learning outcomes are indeed key to a meaningful education, and focusing on learning outcomes is essential to inform diagnosis and improve teaching processes and student learning. While there is a long tradition of learning outcomes’ assessment within institutions’ courses and programmes, emphasis on learning outcomes has become more important in
recent years. Interest in developing comparative measures of learning outcomes has increased in response to a range of higher education trends, challenges and paradigm shifts.
Many higher education institutions use student satisfaction surveys given at the end of a course to measure course and instructor quality. But is that really a true measure of quality? All things being equal, an instructor who teaches a rigorous course will likely score much lower than an instructor whose course is a little less demanding. Then there’s the whole timing of the satisfaction surveys. For the most part, students are simply glad the course is over (even if they liked it) and put little thought or time into completing the survey. Unless of course they know they failed, in which case you will get a detailed assessment of how you are boring, inflexible, out of touch, or otherwise unfit to teach.
No wonder surveys get such a bad rap. If end-of-course evaluations are the only surveys you use, there’s a lot more you can, and should, be doing. Done correctly, surveys can deliver tremendous insight into what’s working, what’s not, and why. This special report features 10 articles from Online Classroom, including a three-part and a five-part series that provides stepby-step guidance on how to use surveys and evaluations to improve online courses, programs, and instruction. You’ll learn when to use surveys, how to design effective survey questions, why it’s important to ensure anonymity, and the advantages and disadvantages of Web-based surveys.
Articles in Online Course Quality Assurance: Using Evaluations and Surveys to Improve Online Teaching and Learning include:
• Online Teaching Fundamentals: What to Evaluate, parts 1-3
• Course and Instructor Evaluation: If It’s So Good, Why Does It Feel So Bad?
• Getting Evaluation Data through Surveys: What to Consider before Getting Started
• Using Surveys to Improve Courses, Programs, and Instruction, parts 1-5
If you’re dedicated to continuous improvement, this special report is loaded with practical advice that will help you create more effective surveys before, during, and after your course ends.
Rob Kelly
Editor
Online Classroom
In the past, the term “persistence†was used somewhat interchangeably with “retention†to describe the fact of students remaining in a course of studies from one year to the next, typically at a single institution and sometimes within a particular program. Over the last few years, however, persistence has shifted in meaning to refer to the ability of students to continue their PSE studies and ultimately graduate, regardless of switches between programs or institutions or even temporary absences from PSE altogether. There is a growing recognition in Ontario and across Canada that this system-wide perspective on persistence will help government and institutions manage a highly functional, well-integrated PSE system, one in which students can avail themselves of numerous alternative educational opportunities and pathways to success.
It would be a mistake, however, to assume that these system-wide concerns are the primary arena in which PSE outcomes ought to be managed. Indeed, the concept of persistence as a process whereby students overcome obstacles is of note only in the context of the presence of initial decisions to leave and not return to a particular institution. The central aim of any university ought to be to improve its own retention of students. Indeed, a sustained focus on improving in situ retention outcomes is a vital component of an overall strategy for achieving high system-wide persistence rates. It is in the best interests of government and universities to develop the means by which retention practice efficacy can be reliably assessed, compared amongst institutions and used within institutions to actively improve retention rates.
Unfortunately, two common approaches used to calculate retention rates – the raw rate approach and the natural rate approach – are seriously flawed and cannot be recommended for use by Ontario PSE institutions as tools for managing retention practices.
The raw rate approach is transparently inadequate. The crux of the problem with raw rates is that they are essentially outcome measures unadjusted for variation in inputs. An institution that is in a position to admit students who are highly prepared academically, financially and culturally for university life at that particular institution can expect to be rewarded with relatively high outcome rates, and this without having to innovate or invest much in retention practices. Evaluating retention practice efficacy on the basis of raw rates favours institutions that are able to offload potential retention risks during the admissions process.
Another common approach used to calculate retention rates is to calculate the differences between raw rates and “expected†or “natural†rates and then to base evaluations and comparisons on these differences. Natural institutional rates are averages of the estimated probabilities of an event occurring (e.g., being retained after one year, graduating within four years) for each member of a cohort of students at an institution. One key feature of the statistical models upon which the probability estimates are based is the fact that they are system-wide models, pooling data across all institutions in the study and delivering a single set of model coefficients that is applied to all institutions. Another key feature is the fact that probability estimates are based on predictor variables that usually include only pre-entry characteristics of students and sometimes include environmental characteristics such as institution size, the field of study and whether the school primarily serves urban commuters. An institution with a raw rate that exceeds its natural rate is deemed to be performing well at
2 –Shifting from Retention Rates to Retention Risk: An Alternative Approach for Managing Institutional Student Retention Performance retaining students, whereas an institution with a raw rate that is lower than its natural rate is evaluated as performing poorly. This approach has been implemented in the United States but not in Canada.
Three interpretation problems are ingrained in the natural rate approach that impede its meaningful application: normative interpretations given to natural rates are unwarranted; attributions of causation – to students in the case of natural rates and to institutions in the case of differences between natural and raw rates – are also unwarranted and potentially misleading; and a single set of system-wide coefficients is not likely to provide useful characterizations of the realities in play at individual institutions. A large and growing body of research embeds retention processes within the local context of individual institutions and indeed individual students. As research findings accumulate, there is a deeper and growing appreciation of the fact that the PSE system is not homogeneous in terms of the magnitude or direction of relationships between factors influencing retention event occurrence and the actual occurrence of those events. Rather, processes generating retention events operate locally and with considerable variation in form and intensity amongst locales, so system-wide characterizations do not give meaningful summaries of local conditions. The natural rate approach looks like a more sophisticated, finely tuned analysis, but its looks are deceiving.
An alternative to the raw and natural rate approaches is to move away from retrospective analyses of retention rates in favour of prospective analyses of retention risks. According to this approach, institutions use historical data to develop statistical models of retention risk at the individual student level. These models are then employed to estimate for each student in a currently enrolled cohort the “risk†(expressed as a probability) of continuing with their studies beyond a certain length of time.
Abstract
The community college is one of many providers of postsecondary and adult education in Canada. In making decisions about how the community college should allocate its efforts among various possible programs and activities, it is important to understand its relationship to other providers of postsecondary and adult education. This article describes and analyzes the relationship between Canada's community colleges and other providers of postsecondary and adult education in Canada. It attempts to identify the comparative strengths and weaknesses of community colleges relative to other providers with respect to particular types of activity, and from that analysis it offers suggestions regarding the emphases that colleges might place on certain of their activities.
Résumé
Le collège communautaire est un des nombreux fournisseurs d’enseignement supérieur et d’éducation aux adultes au Canada. En prenant des décisions concernant la manière dont les collèges communautaires devraient allouer leurs efforts parmi différents programmes et activités, il est important de comprendre leurs relations avec d’autres fournisseurs d’enseignement supérieur et d’éducation aux adultes. Cet article décrit et analyse la relation entre les collèges communautaires du Canada et les autres fournisseurs d’enseignement supérieur et d’éducation aux adultes au Canada. Il tente d’identifier les forces et faiblesses des collèges communautaires comparativement à d’autres fournisseurs relativement à certains types d’activités, et à partir de cette analyse, il offre des suggestions concernant l’importance que les collèges peuvent accorder à certaines de leurs activités.
Abstract: This article describes the consequences for workplace e-learning of viewing organisations as political systems. Organisations tend to stratify, and potential conflicts develop between “top-down†or designer-generation of workplace systems, and “bottom-up†or learner- and practice-based approaches. The differences in the objectives, procedures, tacit knowledge and conceptions of the value of workplace e-learning between these orientations have led to conflicts that have damaged real e-learning projects in the past. Some cases from the literature are analysed to support this point. However, other examples show how these tensions may also be turned into opportunities for communication, learning and collaborative design by including a measure of operational proximity and organisational citizenship behaviour in workplace e-learning design. It is suggested that through initiatives like these, designer-generation and learner-generation of context may act as complementary checks or balances, each helping compensate for the deficits of the other, thus improving workplace e-learning effectiveness.
Keywords: workplace e-learning; professional development; learner-generated contexts; communities of practice (CoPs); conflict; co-ordination
One thing is becoming increasingly clear in the area of workplace training: the standard approaches applied are not adapted to individual needs and the knowledge society as a whole. Offering something more than a standard one-size-fits-all product involves “personalizing” learning. What do we mean by personalizing learning? We mean considering the diversity of learners (learning characteristics) in order to better adapt their learning to their needs (current and target skills), by offering them customized online solutions (synchronous, asynchronous and mixed) and by optimizing learning situations (alternate teaching methods) to reflect work-related requirements (e.g., adapted to their time constraints, work environment and job demands) and each learner’s skills.
Background Web technologies are developing at an unprecedented pace and constitute an excellent tool for improving the flexibility and effectiveness of learning. An increasing number of studies demonstrate that an adult can learn more – and faster – with an online course than face to face in a classroom. What about teachers, who must teach themselves on the job how to use these technologies and effectively integrate them into their teaching? A number of obstacles and a certain resistance hinder this training and integration, the most significant being the time available and the motivation to learn.
Increasingly, teachers are seeking à la carte training solutions that can be split up and accessed at different times in the workplace or close to home. The Internet offers more and more courses that successfully bring the knowledge conveyed in line with learners’ actual needs, regardless of where they may be on the planet, or where their workplace is located. But what do we really know about the impact of these online solutions on workplace learning? There is little literature on the subject, thus the relevance of research to analyze these types of intervention and document the success factors of online training in the workplace.
Goal
Given that little formal research has been conducted on the use of Web technologies for developing the technological and pedagogical skills of teachers in the workplace, and even less on operating training programs that provide a personalized approach to learning, the goal of this study was to test a mixed online learning model that provides a personalized mix of synchronous classroom instruction and asynchronous distance learning to suit the learning characteristics of adult learners in the workplace. With this educational approach in mind, the Form@tion program was launched online to offer professional development opportunities to teachers in the workplace who wished to develop their skills in online teaching. More specifically, the objectives of this study are to understand working teachers’ resistance to change and the obstacles facing them in terms of information and communications technologies Study on the impact of mixed online training (synchronous and asynchronous) on the skills development of teachers in the workplace (ICT); to test a mixed training program that offers a personalized training plan to meet the training needs and learning characteristics of practising teachers; and to measure the changing attitudes of teachers towards the need for lifelong learning.
Partnerships between Ontario colleges and universities have become increasingly important recently for at least two
reasons. Partnerships are encouraged generally in Canada, USA, Europe and elsewhere to transcend organizational boundaries, foster synergies and stimulate change. So universities are enjoined to partner with employers to integrate education and work, with industry to foster innovation and with other universities to avoid duplication.
One of the many lessons learned from the early years of distance education is the fact that you cannot simply pluck an instructor out of the classroom, plug him into an online course, and expect him to be effective in this new and challenging medium. Some learned this lesson the hard way, while others took a proactive approach to faculty training. All of us continue to refine our approach and discover our own best practices.
Today, it’s possible to learn much from the mistakes and successes of those who blazed the trail before us. Faculty development for distance educators is a critical component of all successful distance education programs. Well thought-out faculty development weaves together needed training, available resources, and ongoing support, and carries with it the same expectations for quality teaching that institutions of higher education have for their face-to-face classes.
This special report, Faculty Development in Distance Education: Issues, Trends and Tips, features 12 articles pulled from the pages of Distance Education Report, including:
• Faculty Development: Best Practices from World Campus
• Developing Faculty Competency in Online Pedagogy
• A Learner-Centered, Emotionally Engaging Approach to Online Learning
• How to Get the Best Out of Online Adjuncts
• Workload, Promotion, and Tenure Implications of Teaching Online
• Four Steps to Just-in-Time Faculty Training
This report is loaded with practical strategies that can help you build a comprehensive
faculty development program, helping ensure that instructors stay current in both online
pedagogy and practical technical know-how. No matter what the particular character of
your program is, I think you’ll find many ideas you can use in here.
Christopher Hill
Editor
Distance Education Report
[email protected]
Ontario firms and organizations are being challenged to increase productivity through innovation in order to compete on the fiercely competitive world stage and improve the quality of life of Ontarians. Yet, Ontario suffers from innovation gaps
that place its productivity and prosperity goals at risk.
Ontario’s 24 Colleges of Applied Arts and Technology have long been recognized for their contributions to career-oriented education and training programs that have strengthened the Ontario economy throughout the latter part of the 20th century.
Poised on the threshold of the 21st century, college-based applied research and development (R&D) and business and industry innovation activities are of ever increasing importance to the achievement of Ontario’s productivity and prosperity
goals.
Colleges recommend that, beginning in 2006/07, the Government of Ontario establish a new, forward-looking provincial research and innovation policy framework and launch three strategic programs to bolster college capacity to support
business and industry through applied R&D, innovation and commercialization activities over the next decade, at a cost of $50 million over first five years.
This article reviews the history of large-scale education reform and makes the case that large-scale or whole system reform policies and strategies are becoming increasingly evident. The review briefly addresses the pre 1997 period concluding that while the pressure for reform was mounting that there were very few examples of deliberate or successful strategies being developed. In the second period—1997 to 2002—for the first time we witness some specific cases of whole system reform in which progress in student achievement was evident. England and Finland are cited as two cases in point. In 2003–2009 we began to observe an expansion of the number of systems engaged in what I call tri-level reform—school/ district/government. As Finland, Singapore, Alberta, Canada, Hong Kong, and South Korea continued to demonstrate strong performance in literacy, math and science, Ontario joined the ranks with a systematic tri-level strategy which virtually immediately yielded results and continues to do so in 2009. The nature of these large-scale reform strategies is identified in this article. It can be noted that very little productive whole system reform was going on in the United States. Aside from pockets of success at the level of a few districts since 2000, and despite the presence of a ‘policy without a strategy’ in the form of No Child Left Behind the US failed to make any progress in increasing student achievement. In the final section of the paper I consider the early steps of the Obama
administration in light of the ‘theory of action’ of whole system reform identified in this article and predict that there we will see a great expansion and deepening of large-scale reform strategies in the immediate future, not only in the U.S. but across the world.
Mismatches between workers’ competences and what is required by their job are widespread in OECD countries. Studies that use qualifications as proxies for competences suggest that as many as one in four workers could be over-qualified and as many as one in three could be under-qualified for their job. However, there is significant variation across countries and socio-demographic groups. Our meta-analysis of country studies suggests that over 35% of workers are over-qualified in Sweden compared with just 10% in Finland, with most other OECD countries located between these two extremes. There is also extensive evidence that youth are more likely to be over-qualified than their older counterparts and the same is found to be true for immigrant workers compared with a country’s nationals. On the other hand, no definitive evidence has been found of the persistence of qualification mismatch, with some papers showing that over-qualification is just a temporary phenomenon that most workers overcome through career mobility and others finding infrequent trantisions between over-qualification and good job matches. Across the board, over-qualified workers are found to earn less than their equally-qualified and well-matched counterparts but more than appropriately-qualified workers doing the same job. Under-qualified workers are found to earn
more than their equally-qualified and well-matched counterparts but less than appropriately-qualified workers doing the same job. Over-qualified workers are also found to be less satisfied about their job and more likely to leave their work than well-matched workers with the same qualifications.
For most educators, writing a philosophy of teaching statement is a daunting task. Sure they can motivate the most lackadaisical of students, juggle a seemingly endless list of responsibilities, make theory and applications of gas chromatography come alive for students, all the while finding time to offer a few words of encouragement to a homesick
freshman. But articulating their teaching philosophy? It’s enough to give even English professors
a case of writer's block.
Traditionally part of the teaching portfolio in the tenure review process, an increasing number of higher education institutions are now requiring a philosophy of teaching statement from job applicants as well. For beginning instructors, putting their philosophy into words is particularly challenging. For one thing they aren’t even sure they have a philosophy yet. Then there's the added pressure of writing one that’s good enough to help them land their first teaching job.
This Faculty Focus special report is designed to take the mystery out of writing teaching philosophy statements, and includes both examples and how-to articles written by educators from various disciplines and at various stages of their professional careers.
Some of the articles you will find in the report include:
• How to Write a Philosophy of Teaching and Learning Statement
• A Teaching Philosophy Built on Knowledge, Critical Thinking and Curiosity
• My Teaching Philosophy: A Dynamic Interaction Between Pedagogy and Personality
• Writing the “Syllabus Version†of Your Philosophy of Teaching
• My Philosophy of Teaching: Make Learning Fun
As contributor Adam Chapnick writes, “There is no style that suits everyone, but there is almost certainly one that will make you more comfortable. And while there is no measurable
way to know when you have got it ‘right,’ in my experience, you will know it when you see it!â€
Education is undergoing a dramatic transformation. Technology plays a powerful role in the life of today’s students and institutions can no longer meet their needs through classroom-based instruction alone.
Blended learning is one way institutions can prepare themselves for the next era in education. It combines face-to-face and online instruction by integrating technology into their curriculum.
Many educators agree that the blended approach is benefi cial. It delivers a fl exible experience and supports learning by allowing students to learn at their own pace. Meanwhile, use of this model helps maximize instructor efficiency, increasing engagement inside the classroom while simultaneously enabling them to reach more students. Institutions see the benefi ts as well. Retention rates increase, recruitment efforts improve and early evidence suggests that use of this approach can improve grades. The ME2U research project, conducted at the University of Sussex1, found that students using blended learning technology to view recorded content prior to assessment often produced higher scores.
With these advantages, it’s no surprise that blended learning is experiencing a dramatic upsurge
in popularity. Today, student demand for blended learning courses continues to outpace most institutions’ ability to meet the growing need. Eighty-four percent of surveyed students would like blended learning technology offered in more of their courses.
ABSTRACT
Student parents are a significant minority population on Canadian post-secondary campuses. As research exploring this population has been extremely limited to date, this study provides the first national profile of Canadian student parents. We explore student parent enrolment patterns over time and examine current demographic characteristics. The data for this study were drawn from two datasets collected by Statistics Canada: the Labour Force Survey 1976–2005 and the Survey of Labour and Income Dynamics 2004 cross-sectional data file. Student parents accounted for between 11% and 16% of all post-secondary enrolment between 1976 and 2005. Further analyses explore participation patterns based on type of institution college/university), study status (full-/part-time study), age, gender, and marital status. Future research directions and implications for policies and institutional practice are discussed.
RÉSUMÉ
Les étudiants qui sont aussi parents représentent une population minoritaire d’importance sur les campus postsecondaires canadiens. Puisque la recherche portant sur cette population demeure extrêmement limitée à ce jour, l’étude qui suit constitue le premier profil national d’étudiants canadiens qui sont aussi parents. On y explore les modèles d’inscription de ces étudiants au fil du temps et on y examine les caractéristiques démographiques actuelles. Les données de cette étude ont été prises de deux sources recueillies par Statistique Canada : la « Labour Force Survey 1976-2005 » et la « Enquête sur la dynamique du travail et du revenu, 2004 [Canada]: Fichier d’enquête transversale principale ». Les étudiants qui sont aussi parents représentent entre 11 % et 16 % de toutes les inscriptions postsecondaires entre 1976 et 2005. D’autres
CJHE / RCES Volume 41, No. 3, 2011
analyses explorent les modèles de participation fondés sur le type d’institution (collège ou université), le statut de l’étudiant (temps plein ou temps partiel), l’âge, le sexe et le statut familial. On y discute également de la direction des recherches futures, ainsi que des implications pour la rédaction de politiques et pour la pratique en milieu institutionnel.
This study investigates the validity, within an Ontario college, of the U.S.-based Community College Survey of Student Engagement (CCSSE) benchmarks of effective educational practices, formally referred to as the Model of Effective Educational Practices (MEEP). MEEP factors include active and collaborative learning; student effort, academic challenge, studentfaculty
interaction, and support for learners. The validity of CCSSE was explored for this study through analysis of the model fit of MEEP and analysis of its correlations and capacity to predict five academic outcomes based on a sample of Ontario students that completed CCSSE during the Winter 2009 semester. Results of the analyses reveal that MEEP exhibits good model fit and that three of the five benchmarks were consistently correlated with the five selected academic outcomes (self-reported GPA, semester GPA, cumulative GPA, cumulative credit completion ratio, and percentage of courses completed with a grade of 70 per cent or higher). After controlling for subject characteristics, two of the five benchmarks, active and collaborative learning and academic challenge were identified as predictors of most of the academic outcomes.
Ontario’s professors and academic librarians are on the front lines of Ontario’s universities. They are uniquely positioned to assess the performance of the sector, and to identify trends that affect the quality of university education.
To take advantage of this insight, the Ontario Confederation of University Faculty Associations (OCUFA) surveyed Ontario faculty to gauge their opinions on the quality of university education in our province. The survey was also designed to assess the priorities of university faculty, particularly in regards to the balance of teaching and research in their work.
The survey was conducted online between March 21, 2012 and April 16, 2012. Responses to the questionnaire were received from over 2,300 faculty members, with a total of 2,015 complete responses from professors and academic librarians from all Ontario universities and a full range of disciplines. The following report presents the survey findings and provides additional commentary about key results.
Social Media Usage Trends Among Higher Education Faculty
The numbers surrounding social media are simply mind boggling.
750 million. The number of active Facebook users, which means if Facebook was a country it would be the third-largest in the world.
90. Pieces of content created each month by the average Facebook user.
175 million. The Twitter accounts opened during Twitter's history.
140 million. The average number of Tweets people sent per day in February 2011.
460,000. Average number of new Twitter accounts created each day during February 2011.
120 million. LinkedIn members as of August 4, 2011.
More than two per second. The average rate at which professionals are signing up to join LinkedIn as of June 30, 2011.
All of these stats, which come from the respective companies’ own websites, serve as proof points to what we already knew: social media is growing at breakneck speed. Yet the story of social media is still being written as organizations and individuals alike continue to evaluate the benefits and drawbacks of social media in the workplace. When that workplace is a college or university, there’s a cacophony of opinions in terms of the most effective uses, if any.
For the past two years, Faculty Focus conducted a survey on Twitter usage in higher education, this year we expanded the survey to include Facebook and LinkedIn, while changing a number of the questions as well. Twitter, Facebook, and LinkedIn are considered "the big three" in social media, and we thank those who recommended we take a
broader look at the landscape.
All three platforms have their strengths and weaknesses, and are better used for some things than others. But how are the three being used in higher education today? It’s our hope that these survey results provide at least some of the answers while lending new data to the discussion.
The exploration of study orchestrations emphasises students’ active participation in learning, describing the ways in which they marshal the resources available to them in response to their learning environment. This study reports the identification of study orchestrations in a group of distance students and identifies the existence of dissonant study orchestrations, which previous research has linked with poor achievement, in approximately one-fifth of the group. Data came from responses by 176 students to the ASSIST questionnaire. The data was subject to factor analysis to ensure commensurability with previous studies, and then cluster analysis was used to identify groups with similar study orchestrations. Four clusters were identified. One of these was clearly dissonant, pointing toward problematic links between learning environments and student approaches to study. The implications of dissonant study orchestrations are explored and further research is suggested, along with implications for the practice of distance educators.
Keywords: Approaches to study; study orchestrations; metacognition; higher education
Learning to Lead Change - The Pathways Problem