Canvas analytics and assessment data week fifteen fall 2021


An official holiday on Tuesday and an unofficial holiday on Thursday may have contributed to decreased engagement as measured by page views on the Instructure Canvas platform.

Click to enlarge

While page views are down from week 14, the week 15 Tuesday national holiday had the same level of engagement as the day before, Monday on week 15. There is no obvious indication that the holiday impacted page views negatively, page views are down across week 15. 


Other metrics on the platform were either stable or showed small amounts of growth into week 15.

Assessment

This week a brief look at learning as disaggregated by course and the relative impact of outcomes assessed by items on quizzes and tests versus outcomes assessed by rubrics attached to assignments. 


Learning outcome assessment against a five point scale for courses reporting course learning outcomes. Week 15 saw 373 records added to the learning outcomes report.  


Of the fourteen courses reporting learning, only four (29%) are using quiz question banks attached to course learning outcomes from the institutional bank of course learning outcomes. Quizzes and tests, however, are generating 3905 of the 6407 total records (61%). 


Removing the contribution from quizzes leaves 2502 records generated by assignments with attached rubrics. Some faculty have chosen to strip the points out of the learning outcomes rating scale, leaving only 1390 scored records for 193 students. 

Underneath the numbers are data stories. The MS 150 Statistics course has a learning outcome average of 2.8 as measured by tests and quizzes. In MS 150 Statistics the only assignments evaluated by a rubric are open data exploration mini-projects. As measured by this more complex activity, the learning outcome average is up at 4.28. The strength of Canvas is that learning data is flowing from actual in-class artifacts. This allows one to perform explorations such as the above, explorations that are simply not possible at present in TracDat, at least not as currently configured and used. As a faculty member, I am doing no extra work to generate this learning data, none other than using the outcomes already available in the institutional bank of course learning outcomes. The dashboards can accessed by other instructors, allowing instructors to identify areas of learning strength and weakness, enabling faculty to close their own assessment loops. 

Dashboards

Course learning outcomes fall 2021
General education outcomes 2021.3
Course learning outcomes assessment fall 2021 dll sis
Pentascale average time series fall 2021
Learning outcome ratings on assignments only 2021.3
Spectacular dashboards: a cautionary tale

Reports

Week one: Assessment available at sunrise on a new term
Week two: SIS disaggregation and a deep dive into mapping decisions
Week three: SIS disaggregation and another dive into mapping complexities
Week four: A focus on subaccounts and campuses
Week five: Pivot of state of origin versus gender
Week six: Dashboards can be focused
Attendance versus performance in statistics
Week seven: Outcome performance at the course level and other dashboards
Week eight: Update at midterm
Week nine: A look at score and grade distributions
Week ten: Grey goo revisited
Week eleven: Update on the numbers
Week twelve: Page views collapse
Week thirteen: Holiday impact or disengagement?
Week fourteen: Some indications of reengagement
Week fifteen: A look at courses ranked by learning

Comments

Post a Comment

Popular posts from this blog

Plotting polar coordinates in Desmos and a vector addition demonstrator

Image
In an earlier post I noted that Desmos did not directly plot polar coordinates. Not only was I incorrect, but Desmos responded to my blog to correct me! Although I had at some point seen that one could define a function f(x)=3x+5 and then have Desmos calculate f(6), I had not absorbed how this might be used to plot polar coordinates. The above works beautifully . Realizing that I could effectively program Desmos, I applied this thinking to demonstrating how to add two vectors when given the magnitudes m and the direction angles theta. The graph calculates the i and j components for the two vectors and then adds the vectors, graphically displaying the result while also providing information on the magnitude and direction of the vector sum. m1 and theta1 are the magnitude and direction angle for one of the two vectors, m2 and theta2 are the magnitude and direction for the other vector. All four are dynamically interactive and can be changed. The diagram purports to illustra...
Read more

Traditional food dishes of Micronesia

Image
Clara, Jennette, and Joanie presented ground hard taro cooked in an umw, effectively a hot rock oven. Pohnpeian: rotama. Pingelapese: sero. Mwoakillese: rodma. Mortlockese: Amahd. Kosrae: rodoma. After cooking in an umw the rotama is pounded with the petiole of a palm frond. Rotama is made from hard or swamp taro, known as mwahng on Pohnpei, mweian on Pingalap, pula in Mortlockese, and pahsruhk on Kosrae. In traditional times on the outer islands the women had primary responsibility for tending the taro while the men handled fishing and climbing tasks. Joesen and Noeleen presented fermented breadfruit from the outer islands of Yap such as Woleai and Eauripik. The raw ingredients were actually brought in from Yap, Noeleen prepared the maare.  The leaf wrap is ti leaf - Cordyline fruticosa. Pauleen, Barnson, Trisha, Verginia, Con-ray, and Maylanda from Kitti, Pohnpei brought in mahi umw, koahpnoair koakihr, and uht sukusuk. Above is breadfruit umw, mahi umw, o...
Read more

Setting up a boxplot chart in Google Sheets with multiple boxplots on a single chart

Image
The  Google Statistics  add-on for Google Sheets can display multiple boxplots in a single chart. The key is the layout of the data. One column should be the variable by which the data is to be grouped, the other column should be the data to be box plotted. Set up the Statistics add-on with the data to be plotted as the variable, and the grouping column as the "by" variable. In this image I had deselected all but the boxplot option, the result was the appearance of the Moment, Standard errors, and Confidence intervals options. The default is apparently a 95% confidence interval for the mean. The result is multiple boxplots on a single chart with a common scale. The new tab that is created also quotes 95% confidence intervals for the mean. Note that as of 2018 the Google Statistics add-on cannot be found by search in the add-ons. In addition, as of May 2018 the add-on no longer verifies, possibly due to the add-on not having been updated since August 2017. One may ha...
Read more