how does course analytics on the dashboard in moodle work

by Roberta Brown 4 min read

The Moodle Learning Analytics machine-learning engine needs historical data (previous courses or other activity, depending on the model), so it will need to be enabled on a production site or a copy of your production site. The model training process happens in the background once the model is enabled on your Moodle site.

Full Answer

What analytics does the Moodle module add?

This local Moodle Module adds Analytics, currently supports 3 Analytics modes, Piwik, Google Universal Analytics and Google Legacy Analytics. Please note that this plugin is not yet supported for Moodle 2.8.

What do I need to know about machine learning in Moodle?

Machine learning models such as Students at risk of dropping out must be trained on a site with data . These models cannot make predictions on a site until this is done. Models must be designed and selected to match the educational priorities of the institution. The Moodle learning analytics system requires some initial configuration before use.

What are the different types of reports in Moodle?

Site-Wide Reports Moodle administrators have access to a variety of powerful and useful site-wide reports for learning analytics, including security, question instances, logs and comments. Read more about site-wide reports here. 4. Engagement Analytics

Do we need more context around each micro-action in Moodle?

Much more context is needed around each micro-action to develop a pattern of engagement. Many third-party plugins also exist for Moodle that provide descriptive analytics. There are also integrations with third-party off-site reporting solutions.

What is a learning analytics dashboard?

Learning analytics dashboards (LADs) can provide learners with insights about their study progress through visualisations of the learner and learning data.

What is analytics in Moodle?

The Moodle Analytics API allows Moodle site managers to define prediction models that combine indicators and a target. The target is the event we want to predict. The indicators are what we think will lead to an accurate prediction of the target.

How do I enable analytics in Moodle?

The Moodle learning analytics system requires some initial configuration before it can be used. You can access Analytics settings from Site administration > Analytics > Analytics settings.

What is IntelliBoard Moodle?

IntelliBoard provides analytic and reporting services to education communities and institutions that use Moodle as their Learning Management System. We help extract the statistical data gathered within the LMS and present it on a single dashboard in the form of printable charts, graphs, and analytics.

What is meant by learning analytics?

Generally speaking, learning analytics refers to the collection and analysis of data about learners and their environments for the purpose of understanding and improving learning outcomes. Learning analytics is where big data meets traditional quantitative methods in education.

What can Moodle track?

Moodle can detect cheating in online classes or during online exams through the use of a number of tools like plagiarism scanning, proctoring software or using lockdown browsers. These tools are separately applied by the instructors separately or incorporated as plugins.

How do I turn off insights in Moodle?

Users can disable the notification email by themselves by going to User Profile > Preferences > Notification preferences. Under System, scroll down to Insights generated by prediction models and toggle all switches to OFF.

Does Moodle have AI?

Moodle learning analytics supports two types of models. Machine-learning based models, including predictive models, make use of AI models trained using site history to detect or predict hidden aspects of the learning process.

How do I create a report in Moodle?

Generate logsIn the Settings block, under Course administration, click Reports.From the expanded Reports menu, select which report you want to see (this example shows Logs)

Overview

The Moodle Learning Analytics API is an open system that can become the basis for a very wide variety of models. Models can contain indicators (a.k.a.

Existing models

Moodle core ships with three models, Students at risk of dropping out and the static models Upcoming activities due and No teaching. Other models can be added to your system by installing plugins or by using the web UI (see below). Existing models can be examined and altered from the "Analytics models" page in Site administration:

Creating and editing models

New machine learning models can be created by using the Analytics API, by importing an exported model from another site, or by using the new web UI.

Training models

Machine-learning based models require a training process using previous data from the site. "Static" models make use of sets of pre-defined rules, and do not need to be trained.

Evaluating models

This is a manual, resource-intensive process, and will not be visible from the Web UI when sites have the "onlycli" setting checked (default).

What are indicators in a model?

Models can contain indicators (a.k.a. predictors), targets (the outcome we are trying to predict), insights (the predictions themselves), notifications (messages sent as a result of insights), and actions (offered to recipients of messages, which can become indicators in turn).

What is learning analytics?

Learning analytics are software algorithms that are used to predict or detect unknown aspects of the learning process, based on historical data and current behavior. There are four main categories of learning analytics: 1 descriptive (what happened?) 2 predictive (what will happen next?) 3 diagnostic (why did it happen?) 4 prescriptive (do this to improve)

Overview

If your Moodle site administrator has enabled Moodle Learning Analytics, you may receive special notifications called "insights" sent by learning analytics models.

View Insights

Models will start generating predictions at different points in time, depending on the site prediction models and details like the course start and end dates.

Prediction details

The prediction details show which of the indicator values were used in the prediction, and what the student's values for those indicators are. Indicator calculated values that are low and are affecting the prediction are highlighted.

Actions

Each insight can have one or more actions defined. Actions provide a way to act on the insight as it is read. These actions may include a way to send a message to another user, a link to a report providing information about the sample the prediction has been generated for (e.g.

Is core Moodle included in the indicatorset?

At the present time, only core Moodle activities are included in the indicatorset (see below). Courses which do not include several core Moodle activities per “time slice” (depending on the time splitting method) will have poor predictive support in this model.

Can you use multiple prediction models in Moodle?

Moodle can support multiple prediction models at once, even within the same course. This can be used for A/B testing to compare the performance and accuracy of multiple models. Moodle core ships with two prediction models, Students at risk of dropping outand No teaching.

Will I start getting predictions as soon as I enable the model?

Static models do not require training, and will begin to deliver insights as soon as they are enabled (and the circumstances that trigger the model occur). Machine-learning based learning analytics models, such as Students at risk of dropping out, must be trained on your site data before they can generate predictions.

Is there a way to export and import model data between sites?

Model training data can be exported from one site and placed in the model data directory of a new site. This consists of a file of calculated target and indicator values for each sample examined by the model, along with some header information. No personally identifying information is included, but one row per sample (e.g.

Is there a way to export and import the settings of a model between sites?

Yes. Models can be created and tested on one site, and can be exported with weights and imported to a new site. This data does not reference individual users or courses in any way, and can be safely shared with researchers or other sites.

How can I disable Moodle Learning Analytics notifications, or restrict them to certain users, while still enabling models for testing purposes?

Notifications go to users with the "analytics:listinsights" capability in the context of the prediction-- what this means for the Students at risk of dropping out model is that notifications go to teachers in each course. What you can do is modify the "Teacher" role (editingteacher) to remove that capability.

How accurate are the model predictions?

This varies depending on the quality and quantity of site data (including how many activities are in each course and what percentage of the course is conducted online in Moodle). See Using analytics: Review evaluation results for more details on how to review model accuracy.

How can I create my own Learning Analytics models?

New machine learning models can be created by using the Analytics API, by importing an exported model from another site, or by using the web UI. For more information, see Using analytics: Creating and editing models. (Note: "static" models cannot be created using the web UI at this time.)

Why am I seeing the error "Not enough course activity between the start and the end of the course"?

Courses that are used for training the "Students at risk of dropping out" model need to have a minimum of 10 activity logs for user. So if your course has 322 students a minimum of 3220 activity logs between the start and the end of the course are required to consider this course valid for training.

Analytics for Dashboard

Is there a way to build analytics or reporting so that I can host it in a block on the dashboard ? I am having trouble finding any rich reporting or analytics in my cloud instance. Thank you in advance!

Re: Analytics for Dashboard

I don't see Course Reports option in the Reports section on MoodleCloud.

Will I start getting predictions as soon as I enable the model?

Static models do not require training, and will begin to deliver insights as soon as they are enabled (and the circumstances that trigger the model occur). Machine-learning based learning analytics models, such as Students at risk of dropping out, must be trained on your site data before they can generate predictions.

Is there a way to export and import model data between sites?

Model training data can be exported from one site and placed in the model data directory of a new site. This consists of a file of calculated target and indicator values for each sample examined by the model, along with some header information. No personally identifying information is included, but one row per sample (e.g.

Is there a way to export and import the settings of a model between sites?

Yes. Models can be created and tested on one site, and can be exported with weights and imported to a new site. This data does not reference individual users or courses in any way, and can be safely shared with researchers or other sites.

How can I disable Moodle Learning Analytics notifications, or restrict them to certain users, while still enabling models for testing purposes?

Notifications go to users with the "analytics:listinsights" capability in the context of the prediction-- what this means for the Students at risk of dropping out model is that notifications go to teachers in each course. What you can do is modify the "Teacher" role (editingteacher) to remove that capability.

How accurate are the model predictions?

This varies depending on the quality and quantity of site data (including how many activities are in each course and what percentage of the course is conducted online in Moodle). See Using analytics: Review evaluation results for more details on how to review model accuracy.

How can I create my own Learning Analytics models?

New machine learning models can be created by using the Analytics API, by importing an exported model from another site, or by using the web UI. For more information, see Using analytics: Creating and editing models. (Note: "static" models cannot be created using the web UI at this time.)

Why am I seeing the error "Not enough course activity between the start and the end of the course"?

Courses that are used for training the "Students at risk of dropping out" model need to have a minimum of 10 activity logs for user. So if your course has 322 students a minimum of 3220 activity logs between the start and the end of the course are required to consider this course valid for training.

Overview

  • Learning analytics are software algorithms that are used to predict or detect unknown aspects of the learning process, based on historical data and current behavior. There are four main categories of learning analytics: 1. descriptive (what happened?) 2. predictive (what will happen next?) 3. diagnostic (why did it happen?) 4. prescri…
See more on docs.moodle.org

Existing Models

Creating and Editing Models

Training Models

Image
The Moodle Learning Analytics API is an open system that can become the basis for a very wide variety of models. Models can contain indicators (a.k.a. predictors), targets (the outcome we are trying to predict), insights (the predictions themselves), notifications (messages sent as a result of insights), and actions (offered to recipients of messag...
See more on docs.moodle.org

Evaluating Models

  • Moodle core ships with three models, Students at risk of dropping outand the static models Upcoming activities due and No teaching. Other models can be added to your system by installing plugins or by using the web UI (see below). Existing models can be examined and altered from the "Analytics models" page in Site administration: These are some of the actions you can perform on an existing model: 1. Get predictions Train machine learning …
See more on docs.moodle.org