This report outlines a series of recommendations for the post-secondary sector arising from a research study carried out by researchers from Queen’s University and St. Lawrence College. Funding for this 30-month project, which began in January 2013, was provided by the Ontario Ministry of Training, Colleges and Universities under the Mental Health Innovation Fund. In the fall of 2012, each post-secondary institution in Ontario was invited to submit proposals for funding and this project was one of ten successful applications.
As online education moves from the fringes to the mainstream, one question still persists: “How do I know what my online students have learned?” There are no simple answers, just as there aren’t in face-to-face courses, but with a little creativity and flexibility, you soon discover that the online learning environment opens up a host of new student assessment possibilities. And, just as with traditional courses, the trick is finding the right combination that works best for your particular course.
This special report features 12 articles from Online Classroom that will cause you to examine your current methods of online assessment, and perhaps add something new to your assessment toolbox. It even talks about some of the common assessment mistakes you’ll want to avoid.
Take a look at some of the articles you will find in Assessing Online Learning: Strategies, Challenges and Opportunities:
• Authentic Experiences, Assessment Develop Online Students’ Marketable Skills
• Four Typical Online Learning Assessment Mistakes
• Assessing Whether Online Learners Can DO: Aligning Learning Objectives with
Real-world Applications
• Strategies for Creating Better Multiple-Choice Tests
• Assessing Student Learning Online: It’s More Than Multiple Choice
• Using Self-Check Exercises to Assess Online Learning
• Measuring the Effectiveness of an Online Learning Community
• Ongoing Student Evaluation Essential to Course Improvement
Online courses enable a strong student-centered approach to learning and, as a result, assessment. We hope this report helps you design and develop online assessment strategies that take full advantage of the many formal and informal assessment tools now at your fingertips.
Over the last decade, Ontario has had great success increasing high school graduation rates (5 year rates have improved from approximately 68% to 82%1), and sending more graduates on to university, college, or apprenticeships. But some students—Aboriginal, low-income, disabled, and those from the English-speaking Caribbean and Central and South America—still do not share equally in educational success.
Improved graduation rates stem largely from the province’s Student Success Strategy, which has created more caring,
motivating environments for students in grades 7 to 12, with focused support for at-risk learners and at key transitions.
Ontario has also expanded co-operative education, developed ways to make up components of failed courses through a
system known as “credit recovery,” created focused programs called Specialist High Skills Majors, and designed programs
that let students earn dual credits that count toward both their high-school diploma and a post-secondary diploma, degree or
certification.
Student Debt and the Class of 2013 is our ninth annual report on the cumulative student loan debt of recent graduates from four-year colleges. Our analysis of available data finds debt levels continue to rise, with considerable variation among states as well as colleges.
About seven in 10 (69%) college seniors who graduated from public and private nonprofit colleges in 2013 had student loan debt. These borrowers owed an average of $28,400, up two percent compared to $27,850 for public and nonprofit graduates in 2012. About one-fifth (19%) of the Class of 2013’s debt was comprised of private loans, which are typically more costly and provide fewer consumer protections and repayment options than safer federal loans.
Over the past few decades, Canada’s labour requirements have changed drastically—from a need for physical labourers to a need for knowledge workers—as a result of changes in economic and social conditions that have included advances in information and communication technologies, globalization of economic activity and shifting demographics. Consequently, employers and firms are increasingly seeking skilled workers with a more sophisticated array of capabilities. Of recent concern, the current global recession has led to the deterioration of labour-market conditions in Canada and worldwide, profoundly affecting—through increased vulnerability to unemployment—the economic and social well-being of families and communities across Canada. Canada’s economic strength, as in other countries, depends on its ability to develop a skilled and flexible workforce, capable of adapting to continuous change. While Canada’s formal education is of a high standard, it alone cannot provide the conditions needed to secure the development of Canada’s talent—its human infrastructure*—which is a necessary element of our country’s future prosperity. Against this backdrop, Securing Prosperity through Canada’s Human Infrastructure, CCL’s second†report on the state of adult learning and workplace training in Canada, demonstrates that investments in human infrastructure—both in times of economic uncertainty and relative prosperity—are critical to securing a strong economy and greater social equity.
About Ontario Centres of Excellence Inc.
The Ontario Centres of Excellence (OCE) not-for-profit program was formally established in 1987 with seven independent centres that evolved and amalgamated into Ontario Centres of Excellence Inc. in 2004.
Twenty-five years ago, the traditional economic foundation for the province, and for Canada, was shifting from a north american focused and commodities-based economy to one that is globally oriented and knowledge-based.
Prior to the creation of OCE, there was limited connection between universities, colleges, research hospitals and industry. Consensus was that these academic and research institutions were producing quality research that was not being utilized to its full potential by industry.
OCE was designed to bridge that gap and create productive working partnerships between university and college
research departments, research hospitals and Ontario industry.
Public colleges are the only academic institutions in Canada that deliver a robust range of career-focused programs and training to all segments of the population. The colleges’ labour-market programs, such as Second Career, employment counselling, academic upgrading and apprenticeship training serve more than 160,000 students
each year.
Ontario’s public college programs are affordable and reach students in all socioeconomic groups – from people who need upgrading in order to qualify for full-time college programs, to university graduates seeking marketable skills.
Graduates of Ontario’s 24 public colleges earn credentials that have met the province’s rigorous standards for post-secondary education and are valued by employers. College graduates continue to be in high demand.
In 2008, the OECD launched the AHELO feasibility study, an initiative with the objective to assess whether it is possible to develop international measures of learning outcomes in higher education.
Learning outcomes are indeed key to a meaningful education, and focusing on learning outcomes is essential to inform diagnosis and improve teaching processes and student learning. While there is a long tradition of learning outcomes’ assessment within institutions’ courses and programmes, emphasis on learning outcomes has become more important in
recent years. Interest in developing comparative measures of learning outcomes has increased in response to a range of higher education trends, challenges and paradigm shifts.
AHELO aims to complement institution-based assessments by providing a direct evaluation of student learning outcomes at the global level and to enable institutions to benchmark the performance of their students against their peers as part of their improvement efforts. Given AHELO’s global scope, it is essential that measures of learning outcomes are valid across
diverse cultures and languages as well as different types of higher education institutions (HEIs).
Since the Higher Education Quality Council of Ontario (HEQCO) was launched, it has completed and published more than 140 research studies – and funded dozens more that are currently underway – that explore a wide range of trends and issues involving Ontario's postsecondary system. Drawing mainly from HEQCO's own research, this @Issue paper:
. Describes how the definition of student success has gradually broadened at Ontario colleges and universities;
. Summarizes some of the underlying institutional and student population factors that also impact on most current measures of student success;
. Provides broad observations about some recent findings as they relate to the awareness, utilization and impact of various student service, course-based and other initiatives designed to promote student success;
. Recommends what can be measured – as well as how and what outcomes can be expected – when it comes to initiatives and interventions designed to improve student success.
Some readers will be looking for the "silver bullet" within this paper. They will want to be told about a best practice that has been proven to be most effective at improving academic achievement, retention or engagement at an Ontario college or university, and that can be replicated to equal effect elsewhere. This @Issue paper does not identify “silver bullets.†As explained in the pages that follow, the scope and scale of an intervention may make it difficult to measure – or even expect – considerable impacts on student success, especially in the short term.
This paper does provide broad lessons, however, that are likely to be applicable across a wide range of student service, course-based and other interventions currently offered at Ontario colleges and universities.
Defining “Student Successâ€
For several decades, both governments and colleges/universities in Ontario and across Canada have tried to broaden access to postsecondary education (PSE) In particular, it was believed that a wide variety of barriers – family and social background, financial resources, information about options, etc. – needed to be overcome to encourage broader PSE participation, especially by those from traditionally under-represented groups (low income, first-generation, Aboriginal, visible
minority, rural, etc.).
61% of parents have more than one type of debt, with a mean number of debt types at 2.25
▪ 28% of parents have either type of student loan debt (for parents’ or kids’ education), and 5%
have student loan debt for both parents’ and kids’ education
▪ Parents with student loan debt (from parents’ education) are significantly more likely to have
credit card debt (67% vs. 54%) and payday loan debt (19% vs. 7%)
▪ Parents with student loan debt (from kid’s education) are significantly more likely to have
credit card debt (75% vs. 54%) and payday loan debt (38% vs. 5%)
▪ Parents with student loan debt (from parents’ education) are significantly more likely to say
they lose sleep worrying about college costs for their kids (49% vs. 40%)
Abstract
The HANDS (Helping Autism-diagnosed teenagers Navigate and Develop Socially) research project involves the creation of an e-learning toolset that can be used to develop individualized tools to support the social development of teenagers with an autism diagnosis. The e-learning toolset is based on ideas from persuasive technology. This paper addresses the system design of the HANDS toolset as seen from the user’s perspective. The results of the evaluation of prototype 1 of the toolset and the needs for further development are discussed. In addition, questions regarding credibility and reflections on ethical issues related to the project are considered.
Keywords: E-learning; autism; mobile learning; persuasive technology
Peter Øhrstrøm
Aalborg University, Denmark
The digital revolution is transforming our work, our organisations and our daily lives. Driverless cars are now legal in three American states. One third of payments in Kenya are made via mobile phones. Wearable computing will soon mean that your jacket will monitor your heart rate (should you want it to). I have seen a violin - played beautifully - that was 3-D printed.
This revolution is already in homes across the developed world and increasingly in the developing world too. And there, it is transforming the way children and young people play, access information, communicate with each other and learn. But, so far, this revolution has not transformed most schools or most teaching and learning in classrooms.
Over the past 15 years, the provincial government has placed a greater importance on attracting international students to college and university campuses. Between 2005 and 2015, the number of international students at Ontario colleges increased by 27 per cent, while the number of international students at Ontario universities has increased by 92 per cent.1 The 2014 Federal government set a goal of doubling international student enrolment in Canada to approximately 450,000 students. Also, in 2014, the Government of Ontario prioritized international students as a key group of potential immigrants to meet the goals of building an educated, prosperous and skilled society. Just one year later international students constituted 82 per cent of the Ontario provincial nominees immigration program.2 Despite this increase, international students only account for five per cent of skilled immigrants coming to Ontario. Immigrants in Ontario make up 30 per cent of the labour force, the push to attract more international students and increase the amount of people admitted into the provincial nominees immigration program does reflect the province’s desire to attract a highly skilled and educated labour force.3
The Strategic Mandate Agreement (SMA) exercise was intended to address at least three desired
outcomes:
1. To promote the government’s stated goal1 of increasing the differentiation of the Ontario postsecondary system by asking each Ontario postsecondary institution to articulate an institutional mandate statement identifying its distinctive strengths or aspirations and to identify key objectives aligned with that aspiration.
2. To advance and inform the discussion about how the Ontario system could increase its productivity to deliver a quality education to more students within the financial constraints expected in the public sector.
3. To elicit the best thinking from institutions about innovations and reforms that would support higher quality learning and, in its most ambitious form, transform Ontario’s public postsecondary system.
To assist with the evaluation of the SMAs, the Ministry of Training, Colleges and Universities (MTCU)
“…instructed the Higher Education Quality Council of Ontario (HEQCO) to establish a peer review panel to evaluate…mandate submissions … for their ability to achieve significant improvements in productivity, quality and affordability through both innovation and differentiation.” The members of the Expert Panel are listed in Appendix 1.
As Canadaâ's youth consider their increasingly broad and complex array of post-secondary education (PSE) options, they are faced with potentially costly decisions. Moreover, they often do not have the information they need to make appropriate choices, which can negatively impact their participation and persistence in PSE. For many students, it is a challenge to choose, design and follow a post-secondary pathway to its conclusion without deviating from their original plan. Students are increasingly taking non-linear pathways through PSE. Some may need to relocate and attend a different institution. Many students may decide to change the focus of their study, while others may wish to change their program entirely. Some may shift their goals from academic to applied forms of study, or vice versa. However, the structures of post-secondary systems in our provinces, and the various mechanisms that bind them, do not always provide clearly apparent and unobstructed pathways for students, particularly for mobile students. These problems are exacerbated by shifting mandates, roles, and labels of institutions across the Canadian PSE sector.
Canada does not have a clear framework for understanding the many changes that have occurred within its PSE sector over the past 15 years. This monograph sets out to explain these changes, with a view to clarifying their potential effects on students’ comprehension of, and mobility through, the structures that comprise our current PSE landscape.
In the past, Canadian post-secondary education has been described as binary, a term that indicates the presence of two separate institutional sectors: public universities offering academic and professional programming at the degree-level; and public colleges providing diplomas and certificates in programs of a more technical or vocational nature. However, this conceptualization overlooks private post-secondary institutions and, as Marshall (2006) notes, significant growth in the number and types of degrees offered by a wider variety of Canadian post-secondary institutions over recent decades.1 As a result, the distinction between the university and college sectors has become increasingly blurred, and the nature of some Canadian post-secondary institutions is no longer made clear by their names. Canada's PSE sector is now characterized by a broad and complex mix of institutions for which a clear and comprehensive taxonomy has yet to be developed.
Evolutionary and legislative changes in many Canadian jurisdictions challenge the transparency of current Canadian post-secondary education vocabulary. Students’ ideas about which institutions offer which programs, and which programs lead to which opportunities, may not be aligned with these changes. It is arguable that Canadian PSE has become less transparent in recent years, exacerbating the potential that students make PSE decisions inappropriate to their aspirations. Issues of program choice and fit might be better addressed through the provision of a classification framework aimed at making Canadian PSE more transparent to its users.
Background/Context: Parental involvement is a key ingredient in the educational success of students and an integral component of involvement is teacher-parent communication. One body of research finds that minority immigrant parents face barriers in interacting with schools, and communicate less with schools than native-born White parents. However, we know little of how schools reach out to parents.
Purpose: In this study, I use a nationally representative sample of high schoolers to examine patterns of teachers communicating with parents.
Students enter college hoping it will be a major step up from what they were doing before, writes Roger Martin, but
they are often disappointed.
In the traditional college classroom today, faculty and students arrive with a certain set of expectations, shaped largely by past experiences. And although students may need the occa-sional (or perhaps frequent) reminder of what’s required of them, there’s usually something very familiar about the experience for both faculty and students alike.
In the online classroom, an entirely new set of variables enters the equation. It’s a little like trying to drive in a foreign country. You know how to drive, just like you know how to teach, but it sure is hard to get the hang of driving on the left side of the road, you’re not quite sure how far a kilometer is, and darn it if those road signs aren’t all in Japanese.
So much of what determines the overall success or failure of a course takes place well in advance of the first day of class. It’s the thoughtful contemplation of your vision for the course — from what you want your students to learn, to selecting the instructional activities, assignments, and materials that will fuel that learning, to determining how you will measure
learning outcomes. Course Design and Development Ideas That Work examines this multifaceted issue from a variety of fronts to bring you proven course design alternatives implemented in courses of varying sizes and disciplines. Featuring 12 articles pulled from the pages of The Teaching Professor, the report will inspire you to rethink some components of your course.
For example, in the article titled A Large Course with a Small Course Option, we learn about an innovative course design for a large 300-level course. Essentially, the instructor created two options: in one, students attend lectures and take four exams. In the second option, students are responsible for those same lectures and exams, but they also participate in small group
discussions and complete a set of writing assignments. The second option was most valued by students who are not very good test-takers or who have a keen interest in the subject.
In the article The Placement of Those Steppingstones, the University of Richmond’s Joe Ben Hoyle compares the placement of steppingstones in a koi pond to the educational processes teachers use to help their students get from point A to point B. Hoyle theorizes that “education stumbles when either the learning points are not sequenced in a clearly logical order or they are not placed at a proper distance from each other.”
Other articles in Course Design and Development Ideas That Work include:
• A Course Redesign that Contributed to Student Success
• Pairing vs. Small Groups: A Model for Analytical Collaboration
• How Blended Learning Works
• Should Students Have a Role in Setting Course Goals?
• In-Class Writing: A Technique That Promotes Learning and Diagnoses Misconceptions
If you’re looking to update an existing course, this report will give you sound strategies to
consider.
Maryellen Weimer
Editor
The Teaching Professor
In a traditional face-to-face class, students have many opportunities to interact with their instructor and fellow students. Whether it’s an informal chat before or after class, or participating in the classroom discussion, interaction can be an important factor in student success.
Creating similar opportunities for participation and collaboration in an online course is one of the biggest challenges of teaching online. Yet, opportunities for meaningful interaction online are plentiful, provided you design and facilitate your course in the correct manner and with the proper tools.