This article will help familiarise you with the different parts of the LearnSci Analytics performance dashboard.
The performance dashboard is launched from the Smart Worksheet Performance tab of the main usage dashboard.
It is pre-filtered to the appropriate quiz and Smart Worksheet based on the row in the usage dashboard from where you launched the performance data. You can change these filters if you realise you selected the wrong row in the table or want to look at a different date range.
There is an indicator in the top right corner of each dashboard element that you can roll over to see which filters have been applied.
This section provides a summary of the number of attempts and number of students accessing the quiz containing the Smart Worksheet of interest. Note some students may have opened the quiz but not (yet) interacted with the Smart Worksheet.
You may notice minor discrepancies between the data on this dashboard, on the usage dashboard and in Moodle. This is usually in the region of 1-2 attempts of students and is due to interaction with a Smart Worksheet over an extended period of time.
There is also a link to view the assessment itself so you can cross reference this with performance data. This is especially useful when reviewing the question-level performance later on.
This section provides the mean % score for a sheet and the distribution of scores across the cohort.
Unlike Moodle data, dashboards include data from incomplete or unsubmitted attempts to provide a truer reflection of cohort performance.
This section forms the bulk of the dashboard. It starts with providing data by section and learning outcome (where available) and then moves on to cohort performance data for every question in the sheet.
Data on section and learning outcomes (where available) is reported to students at the end of each Smart Worksheet. The appearance of this reporting varies depending on sheet version but this is what it looks like for each of the latest sheets.
Individual questions are not tagged with skills so we cannot report on performance by skill. Students get qualitative feedback on how they have developed a number of key skills at the end of every sheet in the Smart Worksheet Library.
The question-level breakdown table reports on the cohort performance for every question in a Smart Worksheet. As there are no question numbers in Smart Worksheets, you need to use the question keys (visible to instructors but not students) to cross-reference performance analytics with the question the student answered.
This is what question keys look like in the latest version of worksheets.
For ease of access to the assessment, a link is provided in the table at the top of the dashboard. You can also navigate to wherever you added the resource to your VLE and load it from there.
The first six columns in the question-level breakdown table provide a summary of meta-data from that question.
The question label provides a brief summary of the task the student was asked to perform, and is the same text read out to students via a screen reader.
The columns on the right of the table report on the number of attempts, percentage score and percentage auto-solve for each question. As with the section and learning outcome tables, the data reported is for all attempts on a question, regardless whether or not those are complete or have been submitted.
You can easily download data into a spreadsheet format for further analysis using the menu in the top right corner of the table.