Why Formative believes in a research based approach
Craig Jones and Kevin McFarland founded Formative while attending graduate school at UCLA. During their time there, they looked for every opportunity to learn more about how educators were utilizing technology in the classroom and conducted the following research:
Were granted access to research the effectiveness of recent technology roll-outs in the Los Angeles Unified School District, averaging 4 site (and many more classroom) visits per week
Attended the 4.0 Schools incubator program (made possible by the Bill and Melinda Gates Foundation) in New Orleans and observed what problems educators were trying to solve with technology
Partnered with schools across the nation to iterate on potential solutions to problems found in previous research
Both with analytical education backgrounds, Jones and McFarland utilize a research based approach to accomplish two main goals. 1) To push our understanding effective pedagogical practices as educators, and 2) to make sure Formative is based on real-world teacher experiences and not only their visions of what the future of education could entail.
Furthermore, Formative understands the necessity of keeping research of it’s own platform independent. The studies below were performed completely by 3rd party research organizations with the intent to remove any bias or influence. In these studies, Formative team members did not conduct surveys, analyze responses, or write the results.
Other Research Notes: Kevin McFarland worked as an undergraduate researcher while attending Lehigh University, focusing on the transportation of heat throughout high-energy plasmas in tokamak fusion reactors. His research was done under the guidance of professors Glenn Batement and Arnold Kritz, to whom he continues to hold an immense gratitude for their influence in his analytical approach. You can download a copy of his final report and a report his research supported from Professor J.D. Callen (University of Wisconsin) at the following links:
American Institute of Research
Technology‐Mediated Formative Assessment:
A Study of Educators' Self‐Reported Practice
A majority of teachers believe that formative assessment data positively impacts student outcomes
First and foremost, special thanks go out to the the Jefferson Education Accelerator (JEA) for their work with us the past few years and to the Michael and Susan Dell Foundation for making this independent study possible. We had been wanting to find a partner to research formative assessment practices and they were instrumental in getting the American Institute of Research (AIR) on the job. This is the second independent research conducted on behalf of Formative, and you can find the announcement from JEA HERE.
Highlights of Results
The first half of AIR’s study focused on teachers’ perceptions of Formative the platform (goformative.com). Here are some highlights of their responses.
92% of teachers believe using Formative fits easily into their weekly schedules
93% of teachers believe Formative is a valuable tool
90% of teachers believe Formative improves the achievement of students
80% of teachers believe Formative improves the behavior of students
The second half of AIRs study focused on the barriers, support structures, and practices inside of a educational setting that can impact a teacher’s ability to effectively utilize formative assessments as a practice. The following figure represents the correlation of responses across the listed categories.
Some Population Notes:
Results are for all responses, including High-Use teachers (averaging 237 lifetime logins) and Low-Use teachers (averaging 3 lifetime logins)
The Average responding teacher logged Into the platform 72 Times
Responding teachers were 28% in elementary, 34% in middle, and 30% in high schools (8 % in other grade structures)
Responding teachers represented populations where 47% of students qualified for free or reduced-price lunch
2015 Short-Cycle Evaluation Challenge Pilot Report • April 2016
This was the first independent research conducted on behalf of Formative. Partnering with a school in Queens, NYC was a pivotal moment for Formative to really evaluate the efficacy of its tool and approach in a drastically different environment from what it had observed in the past.
Highlights of Results
78% of students strongly agreed that Formative helped them to learn
68% of students indicated that Formative made them more interested in the topic they were learning about in class
76% of students strongly agreed that it was fun using Formative in class
85% of students said Formative was easy to use
73% felt that Formative helped them learn in a way that meets my needs
“I feel like Formative gives me a better understanding of what we do in class.”
“The technology is very easy to use. How instead of writing stuff on paper and take tests on paper, we can do it online.”
“It’s really helpful for anyone who needs help. It helps me to stay more focused on the topic.”
“I liked how you could add attachments or photos.”
“I like that when the teachers grade your work you could just click on that assignment and you can see your grade.”
“We want to do checks for understanding, so that we can differentiate instruction more effectively. It is very simple. The tool does exactly what we wanted it to do.”
“We were looking to find a tool that could offer real-time feedback so that teachers can adjust their lessons on the fly. Formative was able to do that for us. I saw that teachers had a visual of how each child was responding on their individual laptops, and could display the responses they wanted on the SMART Board. So the teacher could adjust by going directly over to Johnny and working on the misunderstandings he was having, or could project a common problem for everyone to see.”
School Challenge At-a-Glance
To help teachers at Crossroads Academy (a pseudonym) address the individual needs of all their students by checking to make sure they understand what is being taught in the classroom. Additionally, teachers wanted to be able to instantly check for student understanding by accessing data in real time.
Indicators of Effectiveness
EDC|CCT collected data on five “meta-indicators” that explain a product’s effectiveness for addressing a school’s challenge during the 90-day pilot. Pilots received an overall rating of Low, Moderate, or High on each indicator, based on a set of sub-indicators.