In 2011, as part of a comprehensive research agenda on learning outcomes development and measurement, the Higher Education Quality Council of Ontario (HEQCO) began supporting eight Ontario institutions to assess the generic skills acquisition of their students. This report summarizes the activities and results of the eight institutions that piloted the Council for Aid to Education’s Collegiate Learning Assessment (CLA), a written examination designed to assess the critical thinking and problem solving skills of entering and graduating students. It reviews the rationale for the project, the challenges and issues encountered with CLA test administration and implementation, and the institutions’ impressions of the value of the resulting data. While there is significant interest from institutions and programs in measuring the generic skills of students and understanding the amount of learning that can be attributed to the institution, the experiences of the institutions that participated in this project highlight certain administrative and methodological challenges that arise in the move from theory to practice in large scale assessments.
In 2008, the OECD launched the AHELO feasibility study, an initiative with the objective to assess whether it is possible to develop international measures of learning outcomes in higher education.
Learning outcomes are indeed key to a meaningful education, and focusing on learning outcomes is essential to inform diagnosis and improve teaching processes and student learning. While there is a long tradition of learning outcomes’ assessment within institutions’ courses and programmes, emphasis on learning outcomes has become more important in
recent years. Interest in developing comparative measures of learning outcomes has increased in response to a range of higher education trends, challenges and paradigm shifts.
Growing enrollments, shrinking budgets and unprecedented diversity in student populations are just a few of the challenges community colleges around the country are facing today. And there are no signs that the situation will change anytime soon.
The American Association of Community Colleges estimates that U.S. enrollment in two-year colleges increased 17 percent from 2007 to 2009, from 6.8 million students to 8 million. Anecdotal evidence says this trend will continue.
During an economic downturn, community colleges feel an even greater strain with enrollment. People go back to school to learn new skills or get certificates or degrees that help their careers. Many must learn new jobs because their previous ones have gone away. While it’s good to have more students, the growth has been so rapid that it has put pressure on the institutions. How do they handle more students every semester? How do they grow despite less funding from federal, state and county governments?
“Because community colleges are growing so fast, and because they’re relatively new as institutions, they don’t have
the infrastructure that the big universities have. And yet they are being asked to do more,” said John Halpin, Vice President of SLED Strategy and Programs at the Center for Digital Education (CDE), a national research and advisory institute focused on IT
policy and best practices in education.
A New Course Community colleges now have a terrific opportunity to evolve thanks to technology, Halpin said. Numerous technologies — wireless, broadband, cloud computing and others — have greatly matured in recent years. They’ve been proven in the real world, and they’ve become more efficient and less expensive.
At community colleges, whether it’s for teaching and learning or for financial aid or other back-end systems, technology is making a huge impact on productivity. Students are learning in exciting new ways. E-mentoring, e-advising, online tutoring and even educational gaming are effectively engaging students and enhancing the educational experience. Professors are incorporating audio/video content to deliver learning in a manner that grabs the student’s interest. Schools are processing incoming students more efficiently and less expensively by putting administrative functions, such as application, orientation and registration, online.
Online learning, or e-learning, is booming. “Students value distance learning,” said Wilton Agatstein, Senior Fellow with the CDE. “It is very convenient for them, as they can learn from any place and at any time. Schools value distance learning because they can serve more students and a larger student demographic without having to build new classrooms and campuses. Distance learning serves everyone well, which is why its adoption is accelerating.”
Technology expectations are sky high. Students step onto campus expecting to incorporate their own communications tools — phones, music players, e-book readers, laptops/netbooks and other devices — into the learning experience. They want wireless access from any point on campus. And they want the ability to connect to school resources even when off campus.
Teachers and staff want the best technology too, because the right tools help everyone.
The internationally recognized series of Horizon Reports is part of the New Media Consortium’s Horizon Project, a comprehensive research venture established in 2002 that identifies and describes emerging technologies likely to have a large impact over the coming five years on a variety of sectorsaround the globe. This volume, the 2011 Horizon Report, examines emerging technologies for their potential impact on and use in teaching, learning, and creative inquiry. It is the eighth in the annual series of reports focused on emerging technology in the higher education environment.
This document represents the first review and summary of existing research on student course evaluations from a Canadian perspective. The scholarship in this area is vast and of varying quality and scope. Our review is an attempt to capture and synthesize the key issues and findings regarding the validity and utility of student course evaluations. We have organized our research into the following seven sections:
Section 1: Introduction provides an overview of the scope, methodology and limitations of this study.
Section 2: Context identifies the current state of scholarship and interest in course evaluations and the evaluation of teaching more generally. It also reviews student, faculty and administrator perceptions of course evaluation systems.
Section 3: Current Policy and Practice in North America offers an overview of evaluation instruments, policies and processes from 22 post-secondary institutions in Canada and the United States as well as policies related to course evaluations from system-level and government agencies.
Section 4: Reliability, Validity and Interpretation of Course Evaluation Data summarizes and reviews the findings from previous studies conducted over the past 40 years with a particular emphasis on the last two decades.
Section 5: Implementing Effective Evaluation Measures: Recommendations from the Research synthesizes research findings and identifies recommendations for improved administration and interpretation of course evaluations.
Section 6: Emerging Trends, Existing Gaps and Suggestions for Further Research highlights issues currently being considered in the scholarship along with those that have been identified as areas requiring more in-depth analysis.
Section 7: Concluding Remarks provides a brief summary of our most important findings and recommendations.
Overall, our findings indicate that while course evaluation instruments generally provide reliable and valid data, significant barriers to the effective use of such evaluation systems continue to exist due to: Persistent myths and misconceptions about variables affecting evaluation results; Unclear concepts and definitions of effective teaching; Student Course Evaluations: Research, Models and Trends Insufficient education about the goals, uses and validity of course evaluations for students, faculty and administrators; Poor presentation and contextualization of evaluation data; and Inconsistent and inequitable policies and practices regarding the implementation and administration of course evaluations.
Our findings suggest that no matter the reliability and validity of the evaluation instruments themselves, the policies, processes and practices at an institution determine the degree to which evaluations are an effective measure of teaching quality.
Abstract
The HANDS (Helping Autism-diagnosed teenagers Navigate and Develop Socially) research project involves the creation of an e-learning toolset that can be used to develop individualized tools to support the social development of teenagers with an autism diagnosis. The e-learning toolset is based on ideas from persuasive technology. This paper addresses the system design of the HANDS toolset as seen from the user’s perspective. The results of the evaluation of prototype 1 of the toolset and the needs for further development are discussed. In addition, questions regarding credibility and reflections on ethical issues related to the project are considered.
Keywords: E-learning; autism; mobile learning; persuasive technology
Peter Øhrstrøm
Aalborg University, Denmark
Writing assignments, particularly for first- and second-year college students, are probably one of those items in the syllabus that some professors dread almost as much as their students do. Yet despite the fact that essays, research papers, and other types of writing assignments are time consuming and, at times, frustrating to grade, they also are vital to furthering student learning.
Of course part of the frustration comes when professors believe that students should arrive on campus knowing how to write research papers. Many do not. With as much content as professors have to cover, many feel they simply can’t take time to teach the research skills required to write a quality, college-level term paper. But as teaching professors who support the writing across the curriculum movement would tell you, improving students’ writing skills is everyone’s business, and carries with
it many short- and long-term benefits for teachers and students alike. Further, many instructors are finding ways to add relevance to writing assignments by aligning them with the type of writing required in a specific profession as an alternative to the traditional, semester-long research paper.
This special report was created to provide instructors with fresh perspectives and proven strategies for designing more effective writing assignments. It features 11 articles from The Teaching Professor, including:
• Revising the Freshman Research Assignment
• Writing an Analytical Paper in Chunks
• Designing Assignments to Minimize Cyber-Cheating
• Chapter Essays as a Teaching Tool
• Writing (Even a Little Bit) Facilitates Learning
• How to Conduct a ‘Paper Slam’
While not every approach discussed in this special report will work for every course, every
time, I invite you to identify a few that look appropriate for your courses, and implement
them next semester. You just might be surprised by the results.
Maryellen Weimer
Editor
The Teaching Professor
Le réseau des collèges publics a été créé en 1967 par le gouvernement du Québec et il est maintenant implanté dans toutes les régions du Québec. Les 48 cégeps (43 francophones et 5 anglophones) constituent la première étape de l’enseignement supérieur québécois et offrent d’une part neuf programmes préuniversitaires, qui mènent à l’université, et d’autre part, cent trente programmes de formation technique, qui préparent à l’entrée sur le marché du travail. En plus des diplômes d’études collégiales (DEC) de l’enseignement ordinaire, les cégeps offrent divers programmes de formation continue afin de faciliter l’acquisition de compétences et de connaissances spécialisées, soit en cours de carrière ou dans le cadre d’un retour aux études.
Pour l’année scolaire 2012-2013, les cégeps comptaient 172 793 étudiants à l’enseignement ordinaire, soit 48,7 % au secteur préuniversitaire, 45,8 % au secteur technique et 5,5 % au programme Tremplin DEC. De plus, 26 024 étudiants poursuivaient des études collégiales par l’entremise de la formation continue créditée. De ces grands totaux, on dénombrait 2 226 étudiants internationaux en 2012-20131.
Stratosphere:
Integrating Technoloyg, Pedagogy and Change Knowledge
For many years now, people have been touting the arrival of the “digital native,” or students that were “born digital”. These terms were meant to describe members of a generation who, according to the more fevered sections of the technorati at least, actually have a different set of neural pathways – who, having been exposed since birth to the Internet and hypertext, “think and process information differently” from previous generations.1 In some quarters this has led to calls – on the basis of evidence that can sometimes be alarmingly thin – that curricula and instructional technologies be radically overhauled in order to cater to the “new learner.”
At the same time, much has been made about the quality-enhancing – and cost-reducing – potential of using the Internet for learning purposes in universities. The National Center for Academic Transformation in the United States, in particular, has been a leading voice in using course redesign as a means to improve both learning outcomes and resource allocation.2 This has not really been about moving whole courses online – the “disruptive technology” that some commentators suggest is about to change universities completely3 – but rather it has been about deploying e-learning resources in such a way as to complement and amplify what is being done in more traditional courses. The entwining of these kinds of resources into courses that
remain primarily physical and class-based is commonly referred to as “blended learning.”
The purpose of this study was to identify how entrepreneurship education is delivered in Ontario colleges and universities. In Ontario, as in the rest of Canada, the increase in the number of entrepreneurship courses at universities and colleges, and the concurrent popularization and maturation of entrepreneurship programming, contribute to fostering entrepreneurial skills and mindsets, and the creation of businesses. The overall aim of this report is to inform debate and decision-making on entrepreneurship education through a mapping and assessment of existing programs in the province.
61% of parents have more than one type of debt, with a mean number of debt types at 2.25
▪ 28% of parents have either type of student loan debt (for parents’ or kids’ education), and 5%
have student loan debt for both parents’ and kids’ education
▪ Parents with student loan debt (from parents’ education) are significantly more likely to have
credit card debt (67% vs. 54%) and payday loan debt (19% vs. 7%)
▪ Parents with student loan debt (from kid’s education) are significantly more likely to have
credit card debt (75% vs. 54%) and payday loan debt (38% vs. 5%)
▪ Parents with student loan debt (from parents’ education) are significantly more likely to say
they lose sleep worrying about college costs for their kids (49% vs. 40%)
Online writing resources have the potential to improve writing instruction for university students, particularly in large classes where frequent writing assignments are often not possible. The Assignment Planner (AP) is an online resource created by the Writing Centre at Wilfrid Laurier University and is freely available to all students through the Writing Centre website. The AP guides students through the process of researching and writing an academic paper. It projects a timeline for each paper and breaks down the research and writing process into 11 steps. Our research project was designed to examine whether integrating use of the AP into large classes has benefits for students and/or professors.
In this quasi-experimental research project, four large first-year classes and one fourth-year seminar class were studied. The first-year classes were randomly assigned to either a control condition (no classroom integration) or intervention condition (explicit integration of the AP into the classroom). The fourth-year seminar class, in which integration of the AP was already underway, was a post hoc addition to the study. Data collection included frequency counts of students’ online access to the AP, student in-class surveys, student writing marks and professor interviews.
Abstract
Purpose – This paper aims to offer junior scholars a front-to-back guide to writing an academic, theoretically positioned, qualitative research article in the social sciences.
Design/methodology/approach – The paper draws on formal (published) advice from books and articles as well as informal (word-of-mouth) advice from senior scholars.
Findings – Most qualitative research articles can be divided into four major parts: the frontend,
the methods, the findings, and the backend. This paper offers step-by-step instructions for writing each of these four parts.
Originality/value – Much of the advice in this paper is taken-for-granted wisdom among senior scholars. This paper makes such wisdom available to junior scholars in a concise guide.
Keywords Qualitative research, Theoretical contribution, Writing an article
Paper type Technical paper
While Canada leads other OECD member countries in postsecondary education (PSE) participation rates, there still remain underrepresented segments of the population which are less likely to pursue PSE. Ontarians who come from low-income households, have parents with no PSE, live in a rural area, identify as an Aboriginal person, and/or have a disability are less likely to enrol in PSE (Norrie & Zhao, 2011).
Youth from some ethnic and racial groups are also less likely to pursue PSE, particularly university (Abada, Hou, & Ram, 2008).
This paper focuses on early intervention programs as one approach to support underrepresented youth to complete secondary school and make the transition to PSE. These programs are intended to provide youth with the resources, support and information necessary to avoid dropping out of school and to increase their chances of participating in PSE (Chambers & Deller, 2011). Early intervention programs can originate within the elementary and secondary school systems, colleges, universities, community centres or other community-based organizations.
The first section of this report is a literature review summarizing the key thinking on the role of early
intervention programs in supporting access. Much of what we know in Canada about these programs is
drawn from the American context, where research on the topic has been extensive. As a result, the
literature review draws heavily from American sources, making links to the Canadian context where
possible.
This paper reports the results of a study of provincial level arrangements for coordination of planning and operations between university and college sectors in Canada. The data are drawn from a survey of senior government and sector officials in which respondents were asked to describe existing arrangements for coordination and to comment upon the importance attached to, and priority issues for, coordination; characteristics of effective structures for coordination; and their satisfaction with existing arrangements. The findings indicate that inter-sector coordination is perceived as an important issue; that coordination structures are most developed in the provinces in which there is the strongest mandate for articulation between sectors; and that efforts are under way in most provinces to refine and improve structures for inter-sector coordination.
Love or hate it, group work can create powerful learning experiences for students. From understanding course content to developing problem solving, teamwork and communication skills, group work is an effective teaching strategy whose lessons may endure well beyond the end of a course. So why is it that so many students (and some faculty) hate it? Although the students may not state their objections verbally, the nonverbal reactions are truly eloquent. They just sit there; only with much urging do they look at those sitting nearby and move minimally in the direction of getting themselves seated as a group. This lack of enthusiasm is at some level a recognition that it is so much easier to sit there and take notes rather than work in a group and take ownership. The resistance also derives from past experiences in groups where not much happened, or where some members did nothing while other did more than their fair share of the work.
Often very little happens in groups because students don’t tackle the tasks with much enthusiasm, but group ineffectiveness also may be the product of poorly designed and uninteresting group tasks. This special report features 10 insightful articles from The Teaching Professor that will help you create more effective group learning activities and grading strategies as well as tips for dealing with group members who are “hitchhiking†(getting a free ride from the group) or “overachieving†(dominating the group effort). Here’s a sample of the articles in the report:
. Leaders with Incentives: Groups That Performed Better
. Dealing with Students Who Hate Working in Groups
. Group Work That Inspires Cooperation and Competition
. Better Understanding the Group Exam Experience
. Use the Power of Groups to Help You Teach
. Pairing vs. Small Groups: A Model for Analytical Collaboration
The Council of Ministers of Education, Canada (CMEC), affirmed their commitment to improving outcomes for Aboriginal students and identified the gaps in academic achievement and graduation rates between Aboriginal and non-Aboriginal students as a key area for attention. One of the strategies articulated in the CMEC Aboriginal Education Action Plan for addressing these gaps in outcomes is “strengthening the capacity for evidence-based decision making.” Toward that goal, CMEC commissioned a report to consider how better data and evidence can be developed to support jurisdictions’ efforts to improve the academic achievement and attainment of Aboriginal students in provincial and territorial elementary and secondary schools.
Many devices have become popular across generations, with a majority now owning cell phones, laptops and desktop computers. Younger adults are leading the way in increased mobility, preferring laptops to desktops and using their cell phones for a variety of functions, including internet, email, music, games, and video.
Among the findings:
- Cell phones are by far the most popular device among American adults, especially for adults under the age of 65. Some 85% of adults own cell phones overall. Taking pictures (done by 76% of cell owners) and text messaging (done by 72% of cell owners) are the two non-voice functions that are widely popular among all cell phone users.
- Desktop computers are most popular with adults ages 35-65, with 69% of Gen X, 65% of Younger Boomers and 64% of Older Boomers owning these devices.
ï‚· Millennials are the only generation that is more likely to own a laptop computer or netbook than a desktop: 70% own a laptop, compared with 57% who own a desktop.
- While almost half of all adults own an mp3 player like an iPod, this device is by far the most popular with Millennials, the youngest generation—74% of adults ages 18-34 own an mp3 player, compared with 56% of the next oldest generation, Gen X (ages 35-46).
- Game consoles are significantly more popular with adults ages 18-46, with 63% owning these devices.
- 5% of all adults own an e-book reader; they are least popular with adults age 75 and older, with 2% owning this device.
- Tablet computers, such as the iPad, are most popular with American adults age 65 and younger. 4% of all adults own this device.
Additionally, about one in 11 (9%) adults do not own any of the devices we asked about, including 43% of adults age 75 and older.
In terms of generations, Millennials are by far the most likely group not only to own most of the devices we asked about, but also to take advantage of a wider range of functions. For instance, while cell phones have become ubiquitous in American households, most cell phone owners only use two of the main non-voice functions on their phones: taking pictures and text messaging. Among Millennials, meanwhile, a majority use their phones also for going online, sending email, playing games, listening to music, and recording videos.
However, Gen X is also very similar to Millennials in ownership of certain devices, such as game consoles. Members of Gen X are also more likely than Millennials to own a desktop computer.
e-Book readers and tablet computers so far have not seen significant differences in ownership between generations, although members of the oldest generation (adults age 75 and older) are less likely than younger generations to own these devices.
Alive in the Swamp vividly articulates the key components needed for digital innovations to be transformational in a practical, easy-to-use tool that has applicability across the spectrum, from leaders of large school systems to education entrepreneurs. As education systems across the world continue to struggle with learner engagement, student achievement and equity, this work is more relevant and necessary than ever before.