The past few years have ushered in more strident calls for accountability across institutions of higher learning. Various internal and external stakeholders are asking questions like "Are students learning what we want them to learn?" and "How do the students' scores from one institution compare to its peers?" As a result, more institutions are looking for new, more far-reaching ways to assess student learning and then use assessment findings to improve students' educational experiences.
However, as Trudy Banta notes in her article An Accountability Program Primer for Administrators, “just as simply weighing a pig will not make it fatter, spending millions simply to test college students is not likely to help them learn more.” (p. 6)
While assessing institutional effectiveness is a noble pursuit, measuring student learning is not always easy, and like so many things we try to quantify, there’s much more to learning than a number in a datasheet. As Roxanne Cullen and Michael Harris note in their article The Dash to Dashboards, “The difficulty we have in higher education in defining and measuring our outcomes
lies in the complexity of our business: the business of learning. A widget company or a fast-food chain has clearly defined goals and can usually pinpoint with fine accuracy where and how to address loss in sales or glitches in production or service. Higher education is being called on to be able to perform similar feats, but creating a graduate for the 21st century workforce is a very
different kind of operation.” (p. 10)
This special report Educational Assessment: Designing a System for More Meaningful Results features articles from Academic Leader, and looks at the assessment issue from a variety of different angles. Articles in the result include:
• The Faculty and Program-Wide Learning Outcome Assessment
• Assessing the Degree of Learner-Centeredness in a Department or Unit
• Keys to Effective Program-Level Assessment
• Counting Something Leads to Change in an Office or in a Classroom
• An Accountability Program Primer for Administrators
Whether you’re looking to completely change your approach to assessment, or simply improve the
efficacy of your current assessment processes, we hope this report will help guide your discussions
and eventual decisions.
Rob Kelly
Editor
Academic Leader
New Faculty Orientations in Improving the Effectiveness of University Teaching.’ In the earlier published report, attention was directed at New Faculty Orientation (NFO) programs offered across Ontario’s twenty publicly-funded universities. The survey-derived data presented in the first report provide insights into the composition, strengths and drawbacks of the range of services offered to foster the pedagogical development of Ontario’s university faculty.
The purpose of this second report is to inquire into the availability of NFO programs across Ontario’s 24 publicly-funded community colleges.1 As in the first report, research presented herein is derived from an online survey instrument. Also like its counterpart, the present paper draws on survey-derived data in order to extend beyond questions about the prevalence of NFO programs in Ontario’s community college sector to also include discussion of more general teaching development services offered to faculty working within Ontario’s publicly-funded community colleges.
Workforce development issues have come to the forefront of national discussions as the country continues its recovery from the Great Recession. In this shifting economy, one way that job seekers, students and workers may improve their opportunities is by earning credentials. Colleges, states and the federal government have traditionally tracked the attainment of bachelor’s and associate’s degrees, but recent research suggests that there are other types of credentials that matter to employers. One-quarter of adults in the United States had a non-degree credential in fall 2012, and full-time workers with these credentials have higher median earnings than those without, according to a report released in January 2014 by the U.S. Census Bureau.1 The report shows that non-degree credentials are an important part of the labor market.
CACUSS is pleased to support the second edition of this guide to “Researching Teaching and Student Outcomes in Postsecondary Education.”
The first edition was a useful resource for our members in working collaboratively to understanding academic and co-curricular learning in postsecondary contexts. The guide offers an accessible introduction to the issues and techniques in conducting research and we believe that it is a good resource for student affairs staff who are considering a research project to measure outcomes in their departments, programs, or campus.
Student affairs professionals are involved in various research and assessment projects seeking to understand the student experience. We are asked more and more frequently to provide evidence of how our work impacts student learning, wellbeing, development and success rates. In addition, the need to refine programs, build outcomes-based plans and engage with faculty on academic initiatives to support student success also persists.
We congratulate the authors and collaborators on their work in updating this useful tool.
The time for meaningful transformation in Ontario’s postsecondary system is now. To meet the needs of the emerging
economy, reform must focus on innovation and applied learning that vaults our province ahead of its competition in creating the best-educated, best-prepared workforce in the world. Composed of distinct but equally valued and complementary partners, Ontario’s transformed postsecondary system will ensure that all students can reach their full potential through a broad array of theoretical and applied learning opportunities. Colleges will continue to be student focused, specializing in applied learning that leads to good jobs for graduates, addresses labour market needs and affords access to the broadest possible population. Colleges and universities will offer a range of credentials within their systems and collaborate on a multitude of programs that
offer students the best of both. Expanded pathways will give students the opportunity to customize their post-secondary
experience to match their interests. Online and blended learning, married to leading-edge technology, will enable students
to learn anywhere, anytime, and in ways best suited to their learning styles. Students will be better prepared than ever before to meet the demands of the economy, and they will achieve their goals faster and at less cost.
The proportion of adults in Canada with a post-secondary education is the highest among all OECD countries, and the cost of that education is roughly double the OECD average. Yet, more and more of those degree holders fall behind in the earnings scale. The share of Canadian university graduates who make less than half the national median income is the largest among all OECD countries. Sure, on average it pays to get a post-secondary education, but with the education premium narrowing, the number of low-income outliers is rising. And despite the overwhelming evidence that one’s field of study is the most important factor determining labour market outcomes, today’s students have not gravitated to more financially advantageous fields in a way that reflects the changing reality of the labour market.
Responding to trends in research, National Survey of Student Engagement (NSSE) institutional data and curriculum renewal processes, several recent initiatives at the University of Toronto focus on the complementary role of the teaching assistant (TA) as part of a teaching team. Particularly, these initiatives focus on the establishment of learner-centred environments, support for deep student learning, and the development of core skills and competencies for both undergraduate and graduate students.
This study examined the influence of two teaching assistant (TA) models – the Advanced University Teaching Preparation Certificate (AUTP), offered by the University of Toronto’s Teaching Assistants’ Training Program (TATP), Centre for Teaching Support & Innovation, and the Writing Instruction for TAs (WIT) Program, offered in the Faculty of Arts & Science. Both of these TA models aim to improve undergraduate student learning by ensuring that TAs are integral members of the teaching team and that they receive sufficient training and guidance in order to effectively support deep student learning. Both of these TA models utilize peer training as a core dimension.
What will the landscape of international higher education look like a generation from now? What challenges and opportunities lie ahead for universities, especially “global” research universities? And what can university leaders do to prepare for the major social, economic, and political changes—both foreseen and unforeseen—that may be on the horizon? The nine essays in this collection proceed on the premise that one way to envision “the global university” of the future is to explore how earlier generations of university leaders prepared for “global” change—or at least responded to change—in the past. As the essays in this collection attest, many of the pat-terns associated with contemporary “globalization” or “internationalization” are not new; similar processes have been underway for a long time (some would say for centuries).1 A comparative-historical look at universities’ responses to global change can help today’s higher-education leaders prepare for the future.
This report analyzes the economic impact of post-secondary education (PSE) in Canada. It is one of three foundational studies by The Conference Board of Canada’s Centre for Skills and Post-Secondary Education. The report considers three kinds of economic impact: spending in the economy (either directly by PSE institutions or indirectly through tourism and other channels), human capital formation, and intellectual capital formation. The report develops a bottom-up approach to understanding impacts, from the PSE institutions to the broader economy.
As video-based instructional materials become available to distance learners to learn practical skills at a distance, it is important to assess the instructional effectiveness of these materials and to understand how students respond to them. This paper is the second part of a larger exploratory study that assessed the instructional effectiveness of video-based instructional materials for teaching distance learners practical skills in block-laying and concreting and how learners respond to these instructional materials. Specifically, this paper aims to assess learners’ acceptance and satisfaction with the materials. It also aims to determine whether levels of learner satisfaction and acceptance differ according to study centres. Data were collected from 71 respondents at three study centres using a self-completion questionnaire comprising 17 Likert-type items. The data were analyzed using descriptive statistics, ANOVA, and Scheffe’s post hoc test at a 0.05 level of significance. Learners appeared positive about their learning experiences with the use of video-based instructional materials to learn practical skills at a distance as they rated highly all the items assessing their acceptance and satisfaction. Results of item-by-item ANOVA regarding learner acceptance indicated that the respondents, categorized according to study centres, exhibited similar levels of acceptance for nine of the ten items. For learner satisfaction, there were no statistically significant differences for six of the seven items. Thus, learners of different study centres exhibited about the same level of acceptance and satisfaction.
Keywords: Block-laying and concreting; distance learning; learner acceptance; learner satisfaction; technical and vocational education and training (TVET); technology acceptance model (TAM); video-based instructional materials International Review of Research in Open and Distance Learning
Vol. 12.5 June – 2011
Assessment of Learner Acceptance and Satisfaction with Video-Based Instructional Materials for Teaching Practical Skills at a Distance
Francis Donkor, University of Education, Winneba, Ghana
What is good learning? That may be a subjective question. But it's likely that many educators would give answers that fall in the same ballpark'sstudents collaborating and discussing ideas, possible solutions project-based learning, designed around real world contexts connecting with other students around the world, on topics of study immersing students in a learning experience that allows them to grapple with a problem, gaining higher-order thinking skills from pursuing the solution
To many educators, these notions are music to their ears. Would it seem terribly strange then to hear that students indeed are doing these things regularly outside of their classrooms? While Timmy or Susie may not be running home from school saying, “What fun, deeply-engaging learning experience can we do today?, they are engaging with new technologies that provide them with the same opportunities. Every day, many students are spending countless hours immersed in popular technologies such as Facebook or MySpace, World of Warcraft, or Sim City which at first glance may seem like a waste of time, and brain cells. But these genres of technologiesSocial Networking, Digital Gaming, and Simulations deserve a second, deeper, look at what is actually going on.
I am a Research Assistant on a project entitled Writing Instruction Using an Online Assignment Planner. I am here to invite you to participate in this study. This study is designed to assess how teachers and students use the Assignment Planner in large classes
Canada’s performance in higher education and skills development has been fairly strong for many years. On key measures we are at or near the top of international rankings and our highly skilled people contribute to economic competitiveness, social
innovation, and political and community well-being. But there are troubling indications that Canada’s skills and education performance is deteriorating, that not enough is being done to address a range of economic and social problems, and that opportunities and benefits have been poorly distributed across regions and groups. In short, there are signs that we are not doing enough to achieve the high levels of skills excellence and equity we need. Action is needed to sustain and enhance the performance of higher education and skills development in Canada.
Teens share a wide range of information about themselves on social media sites;1 indeed the sites themselves are designed to encourage the sharing of information and the expansion of networks. However, few teens embrace a fully public approach to social media. Instead, they take an array of steps to restrict and prune their profiles, and their patterns of reputation management on social media vary greatly according to their gender and network size. These are among the key findings from a new report based on a survey of 802 teens that examines teens’ privacy management on social media sites:
Teens are sharing more information about themselves on social media sites than they did in the
past. For the five different types of personal information that we measured in both 2006 and
2012, each is significantly more likely to be shared by teen social media users in our most recent
survey.
Teen Twitter use has grown significantly: 24% of online teens use Twitter, up from 16% in 2011.
The typical (median) teen Facebook user has 300 friends, while the typical teen Twitter user has
79 followers.
Focus group discussions with teens show that they have waning enthusiasm for Facebook,
disliking the increasing adult presence, people sharing excessively, and stressful “drama,” but
they keep using it because participation is an important part of overall teenage socializing.
60% of teen Facebook users keep their profiles private, and most report high levels of
confidence in their ability to manage their settings.
Teens take other steps to shape their reputation, manage their networks, and mask information
they don’t want others to know; 74% of teen social media users have deleted people from their
network or friends list.
Teen social media users do not express a high level of concern about third-party access to their
data; just 9% say they are “very” concerned.
On Facebook, increasing network size goes hand in hand with network variety, information
sharing, and personal information management.
In broad measures of online experience, teens are considerably more likely to report positive
experiences than negative ones. For instance, 52% of online teens say they have had an
experience online that made them feel good about themselves.
As a key component of a comprehensive research program on learning outcomes, HEQCO initiated a Tuning project to identify and measure learning outcomes in specific “sectors” of postsecondary education (i.e., life and health science, physical science and social science) in Ontario colleges and universities. The term “Tuning” refers to a process of bringing together individuals from across institutions to articulate common student learning outcomes. Quite simply, it is a bottom-up process by those who are “on the ground” to articulate learning outcomes that are relevant, appropriate and useable.
This report analyzes the policies, laws, and regulations governing post-secondary education (PSE) and skills in Canada. It is one of three foundational studies by The Conference Board of Canada’s Centre for Skills and Post-Secondary Education. The report strives to understand and make sense of past efforts, including successes and failures, and to identify priority areas for action on policies, laws, and regulations reform that will lead to future, ongoing success in the skills and PSE environment.
Education is a crucial enabler in the modern world, giving children skills that are essential in later life. Parents expect these skills to be learned at different stages of education, with confidence (47%) and competency in the core skills of Maths, Science and English (43%) the most important outcomes of a good primary education.
At secondary school, parents want a good education to deliver skills in core subjects (40%) and in key areas such as problem solving (35%), computer literacy (32%) and analytical thinking (32%). University is seen as a springboard for success. More than two in five (43%) parents around the world say the ability to compete in the workplace is a key expectation of a good university education.
However, parents are united in having high aspirations for their children. Nearly nine in 10 (89%) parents want their child to go to university. Just over three in five (62%) want their child to study to a postgraduate level.
Personal learning environments (PLEs) hold the potential to address the needs of formal and informal learners for multi-sourced content and easily customisable learning environments. This chapter presents an overview of the European project ROLE (Responsive Open Learning Environments), which specialises in the development and evaluation of learning environments that can be personalised by individual learners according to their particular needs, thus enabling them to become self-regulated learners.
When building an online program, there are certain big questions that need to be answered. Among them are: What kind of program you want it to be – high tech or low tech? Professor intensive or adjunct driven? Blended learning or fully online? What kind of technology will be used to deliver course content? What about opportunities for collaboration? Indeed, even though distance learning is no longer in its infancy, and there are a whole discipline-full of best practices learned by those who blazed the trail before you, it’s easy to get overwhelmed by the questions and the possibilities of what you want your program to look like today and five years from now. We created this special report to suggest some responses to the big questions about distance education: About pedagogy, technology, philosophy and administration of distance learning programs. In this report, you will find concise, informative articles on distance education administration and policy that have appeared in Distance Education Report. Titles include:
• Seeing Where the Distance Education Opportunities Lie
• Dumb is Smart: Learning from Our Worst Practices
• Building a Distance Education Program: Key Questions to Answer
• Eight Steps to On-Campus/Online Parity
• Creating a Business Continuity Plan for Your Distance Education Program
• Integrating Distance Education Programs into the Institution
• Solving the Problems of Faculty Ownership with Online Courses
The mass of program and policy issues confronting distance education administrators grows every day. We hope this special report will help you conceptualize, manage and grow the distance education program at your school.
Unable to cope with the transition from secondary school to postsecondary school or the new pressures of first year, a number of students at Ontario’s universities and colleges withdraw before they graduate. What leads them to leave is still under discussion. One possibility is that they lack what are called emotional and social competencies that are often linked to academic success and retention.
Emotional Intelligence Interventions to Increase Student Success was a project undertaken at Fleming College that aimed to improve the emotional and social competencies of first semester students through the modification of a Technology Career Essential course.