A Blog by Carnegie Learning
Administrators can make better data-driven decisions quickly and easily.
One of the great advantages of MATHia is that it continually collects data that allows parents, students, teachers and administrators to understand student progress and achievement. Today we’re excited to launch a brand new set of Leadership Reports that are designed to provide quick, easy insight into student learning to support district-level officials in their important work.
The Leadership Reports in MATHia focus on four key aspects of success, and provide benchmarks for each of these aspects.
First, administrators need to understand whether MATHia is being used consistently across their district, since consistent usage is critical for improving student outcomes. (Research has found especially strong results with students who completed more than 27 sections within the software.) One key indicator available to them through Leadership Reports is the number of students who have used the software recently (called “Active Students”).
Students also need to be given adequate time to work in MATHia in order to see the desired results. Leadership Reports show average student usage (minutes per week), along with an indicator of whether the usage so far is adequate for the average student to complete the curriculum. If average usage is not adequate, it could indicate a number of issues, like schedule changes in a building or network/hardware issues that need to be addressed.
Students work through MATHia at their own pace, completing the curriculum based on their mastery of workspaces within the software. The syllabus completion metric tells administrators whether students are on track to cover the required material by the end of the class. This data helps administrators make sure that the material is being paced through appropriately for students to cover all the necessary concepts to be learned that school year.
Finally, we want to understand how well students have learned the material that they have covered. The APLSE (Adaptive Personalized Learning Score) performance metric takes into consideration all other data points to indicate whether student learning is on track to meet end-of-course goals. For the first time ever, administrators will be able to see which students, if any, are not on-track for success long before it’s too late. This early warning sign makes sure that instruction can be adjusted and every student has a chance for success by the end of the year.
For each of these key indicators, Leadership Reports allow administrators to easily summarize across subsets of schools and classes (by grade level as well as classification, e.g. selecting only advanced classes).
Leadership Reports can also provide administrators with the ability to understand how these factors have changed over time, e.g. whether MATHia usage has dropped off or picked up.
Finally, the reports provide flexibility to compare these metrics across different schools in the district, using school and class filtering to ensure that these comparisons are fair.
Our aim for the Leadership Reports is to provide deep insight and flexibility to meet the varied needs of administrators in districts across the country. We are thrilled to be able to provide this level of detailed insight, and welcome feedback at firstname.lastname@example.org. Let us know what you think!
Steven Ritter, Founder and Chief Scientist at Carnegie Learning, has been developing and evaluating educational systems for over 20 years. He earned his Ph.D. in Cognitive Psychology at Carnegie Mellon University and was instrumental in the development and evaluation of Cognitive Tutors for mathematics. Through leadership of the research department, Dr. Ritter has led many improvements to the use of adaptive learning systems and math education in real-world settings. He is the author of numerous papers on the design, architecture and evaluation of Intelligent Tutoring Systems. He is lead author of an evaluation judged by the US Department of Education’s What Works Clearinghouse as fully meeting their standards and is lead author of a "Best Paper" at the International Conference on Educational Data Mining.Explore more related to this author
We are thrilled to be able to provide deep insight and flexibility to meet the varied needs of administrators in districts across the country.
Dr. Steve Ritter, Co-Founder and Chief Scientist, Carnegie Learning