Data and Results

An Introduction to Evidence-Based Undergraduate STEM Teaching – Spring 2017 Offering

 

1,128 Learners enrolled with 123 learners scoring high enough (50% or above) to pass the course resulting in a 10.9% completion rate.

Of those students:

31.5% Had a Doctorate Degree
32.2% Had a Masters Degree
23.3% Had a Bachelors Degree
2.7% Had an Associates Degree
8.7% Had a High School Diploma or Less

Those students were located in 87 countries with:

48.3% in the US
4.2% in India
2.5% in Turkey
2.4% in Brazil
2.4% in Canada
2.1% in the UK
38.1% Elsewhere

These learners were:

50.5% Female
48.0% Male
1.5% Preferred not to say

The ages of these learners ranged from:

14.0% Below 25 years old
59.8% Between 26 and 40 years old
26.3% Above 41 years old

With 8 MOOC-Centered Learning Communities

 

Advancing Learning Through Evidence-Based STEM Teaching – Spring 2017 Offering

 

1,077 Learners enrolled with 36 learners scoring high enough (50% or above) to pass the course resulting in a 3.3% completion rate.

Of those students:

21.6% Had a Doctorate Degree
32.9% Had a Masters Degree
29.3% Had a Bachelors Degree
3.9% Had an Associates Degree
9.9% Had a High School Diploma or Less

Those students were located in 104 countries with:

33.7% in the US
4.6% in India
3.4% in Canada
2.8% in Turkey
2.4% in the UK
2.2% in Brazil
50.9% Elsewhere

These learners were:

51.6% Female
47.6% Male
0.9% Preferred not to say

The ages of these learners ranged from:

18.7% Below 25 years old
58.1% Between 26 and 40 years old
23.2% Above 41 years old

With 7 MOOC-Centered Learning Communities

 

An Introduction to Evidence-Based Undergraduate STEM Teaching – Fall 2016 Offering

 

1,449 Learners enrolled with 202 learners scoring high enough (50% or above) to pass the course resulting in a 13.9% completion rate.

Of those students:

30.3% Had a Doctorate Degree
32.2% Had a Masters Degree
26.4% Had a Bachelors Degree
2.1% Had an Associates Degree
7.0% Had a High School Diploma or Less

Those students were located in 97 countries with:

52.5% in the US
4.2% in India
3.1% in Canada
2.6% in Australia
2.3% in the UK
2.1% in Brazil
33.2% Elsewhere

These learners were:

53.7% Female
45.4% Male
0.9% Preferred not to say

The ages of these learners ranged from:

14.8% Below 25 years old
60.1% Between 26 and 40 years old
25.0% Above 41 years old

With 21 MOOC-Centered Learning Communities

 

Advancing Learning Through Evidence-Based STEM Teaching – Fall 2016 Offering

 

1,051 Learners enrolled with 36 learners scoring high enough (50% or above) to pass the course resulting in a 3.4% completion rate.

Of those students:

22.0% Had a Doctorate Degree
36.0% Had a Masters Degree
28.1% Had a Bachelors Degree
2.9% Had an Associates Degree
10.1% Had a High School Diploma or Less

Those students were located in 102 countries with:

39.2% in the US
6.0% in India
3.4% in Canada
3.3% in the UK
2.1% in Australia
2.1% in Mexico
43.9% Elsewhere

These learners were:

51.4% Female
48.0% Male
0.6% Preferred not to say

The ages of these learners ranged from:

13.1% Below 25 years old
59.7% Between 26 and 40 years old
27.2% Above 41 years old

With 15 MOOC-Centered Learning Communities

 

Advancing Learning Through Evidence-Based STEM Teaching – Summer 2016 Offering

 

2,643 Learners enrolled with 135 learners scoring high enough (50% or above) to pass the course resulting in a 5.1% completion rate.

Of those students:

22.0% Had a Doctorate Degree
37.3% Had a Masters Degree
29.4% Had a Bachelors Degree
2.1% Had an Associates Degree
7.8% Had a High School Diploma or Less

Those students were located in 126 countries with:

41.9% in the US
5.1% in India
3.6% in Canada
2.4% in the Brazil
2.1% in Mexico
2.0% in Australia
42.9% Elsewhere

These learners were:

53.4% Female
45.5% Male
1.1% Preferred not to say

The ages of these learners ranged from:

13.7% Below 25 years old
57.2% Between 26 and 40 years old
29.1% Above 41 years old

20 MOOC-Centered Learning Communities

 

First Course offering Big Picture Data (Fall 2014)

 

There were 5908 students enrolled in the fall 2014 session of the course, of which 4009 were active.  Out of those 4009 students 566 were issued a statement of accomplishment resulting in a ~14% completion rate.  In addition 99% of students that filled out the pre-course survey already had a college degree.

 

Of those students:

  • 29% were doctoral students
  • 18% were post docs
  • 20% were faculty members
  • 9% were instructional staff

These students were located:

  • 75% in the US
  • 3% in Canada
  • 2% in India
  • 20% elsewhere

These students were:

  • 67% were female
  • 37% were male
  • 2% preferred not to say

Their concentrations were:

  • 39% Biological sciences
  • 20% Physical sciences
  • 12% Engineering
  • 5% Earth sciences
  • 5% Mathematics
  • 4% Computer Sciences
  • 4% Social Sciences

According to the post course surveys 14% of students spent 0-2 hours per week working on the course, 62% spent 3-6 hours a week, 19% spent 7-10 hours per week and 5% spent >10 hours per week.

 

MOOC-Centered Learning Community Data

 

In the fall 2014 session of the course there were 47 +1/-5 MCLCs active in the course, with an average of 10 participants and a self-reported mean attendance of 70% at weekly meetings. Half of the MCLCs formed at institutions not part of the CIRTL Network, an indication of spontaneous creation and growth. Two-thirds of the MCLCs were interdisciplinary, most had largely graduate student participants in the later stages of their degree program, but half also included postdocs and few had faculty, similar to the overall distribution of engaged participants in the MOOC. The facilitators spent an average of 2 hours per week preparing, and 90% would do it again and recommend it to a colleague. We also analyzed the responses from the pre-course and post-course surveys, together with the number of active MCLCs above and estimate that the number of MCLC participants were 420 +/- 40.

Pre-course survey

We analyzed in detail the intention to complete, the engagement in learning activities in the course, and the actual completion of the course as a function of participation in a MOOC-centered learning community. Details on the analysis:

  • 1426 participants filled out the pre-course survey and were distributed into cohorts as:
    • 421 stated that they intended to be in an MCLC. Correlating with the post-course survey, on average 75% who said they intended to be in an MCLC did participate in one.
    • 1000 stated that they did not intend (398) or weren’t sure (602) about MCLC participation, of the former, only 1% did and of the latter, 5%.
  • The basic outcome measure of the course is completion, an average of 70% on all the quizzes. 566 participants completed the course. 463 of the 566 also had filled out the pre-course survey.
Student Course Completion

Overall completion of the course, based on pre-course survey, was 42.5% for those who intended to be in an MCLC, and 28.2% for those who did not, regardless of other intentions or participating outcomes.

  • The pre-course survey also asked whether participants intended to complete the course. Of the 1426 who filled out the pre-course survey, 779, or 54.6% said they intended to complete.
  • 257 out of 421who said they intended to be in MCLC, said they also intended to complete the course ~ 61%, and out of these 257, 139 learners actually completed the course, 54% of those who intended.
  • Of the 1000 non-MCLC participants, 518 said they intended to complete the course, or ~52%, and out of these 518, 209 learners completed the course, 40% of those who intended.
  • 164 out of 421 who said they intended to be in MCLC, said they did not intend to complete the course, out of them, 40 completed the course or 24%; whereas of the 482 non-MCLC participants who said they did not intend to complete, only 73 did, or 15%.
MCLC Participants non-MCLC participants
Current Position Overall Number Completion Rate Overall Number Completion Rate
Doctoral student 145 46.9% 259 33.6%
Post-doctoral researcher 92 55.4% 170 46.5%
Instructional Staff 38 34.2% 96 24.0%
Faculty member (tenured) 32 25.0% 124 16.9%
Early career faculty member  (pre-tenure) 28 25.0% 101 15.8%
Master Student 16 31.3% 47 34.0%
Faculty professional development staff 16 31.3% 28 14.3%
Other 15 46.7% 42 16.7%
researcher 14 57.1% 19 15.8%
Not affiliated with a higher education institution. 13 38.5% 83 25.3%
Administrator 8 12.5% 27 18.5%
Information technology staff 2 50.0% 1 0.0%
Table 1: Completion rate by current position as a function of their intention to participate in a MOOC-centered learning community as reported on the pre-course survey. Note that graduate students and post-docs had by far the largest completion numbers and rates, with MCLC participant rates higher than individuals.
All Participants MCLC participants Non-MCLC participants
Current Position Overall Number Completion Rate Overall Number Completion Rate Overall Number Completion Rate
Doctoral student 404 38.40% 145 46.9% 259 33.6%
Post-doctoral researcher 262 49.60% 92 55.4% 170 46.5%
Instructional Staff 134 26.90% 38 34.2% 96 24.0%
Faculty member (tenured) 156 18.60% 32 25.0% 124 16.9%
Early career faculty member  (pre-tenure) 129 17.80% 28 25.0% 101 15.8%
Master Student 63 33.30% 16 31.3% 47 34.0%
Faculty professional development staff 44 20.50% 16 31.3% 28 14.3%
Other 57 24.60% 15 46.7% 42 16.7%
Researcher 33 33.30% 14 57.1% 19 15.8%
Not affiliated with a higher education institution. 96 27.10% 13 38.5% 83 25.3%
Administrator 35 17.10% 8 12.5% 27 18.5%
Information technology staff 3 33.30% 2 50.0% 1 0.0%
Table 1: Completion rate by current position overall and as a function of their intention to participate in a MOOC-centered learning community as reported on the pre-course survey. Note that graduate students and post-docs had by far the largest completion numbers and rates, with MCLC participant rates higher than individuals.
In-course learning activity:
  • The number of participants who watched at least one video was 3100. If they watched one video, they watched on average 35% of the videos, based on regression.
  • The number of participants who completed one quiz was 1119. If they completed one quiz, they completed 65% of the quizzes and watched 59% of lectures on average.

Overall completion of the course, based on pre-course survey, was 42.5% for those who intended to be in an MCLC, and 28.2% for those who did not, regardless of other intentions or participating outcomes.

  • 61% of declared MCLC participants said they intended to complete the course, and 54% did.
  • 52% of declared non-MCLC participants said they intended to complete the course, and 40% did.
  • MCLC vs. non-MCLC: 2x rate of completion of those who said they did not intend to complete.

 

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Copyright An introduction to Evidence-Based Undergraduate STEM Teaching