50 x 72: Digital Learning Now Report Card Details

There are 72 ways to divide us or unite us in our quest to provide rich learning experiences to every student using online and blended learning. That, at least, is the determination made by Digital Learning Now in their state report card reports published last week. I’m a firm & devoted proponent of DLN and of the online course revolution. However, I’m confused by several of the 72 data points and I’d advocate that several, if not many, should not be on their list. Another blog post will detail California’s falling grade, the many “partial” scores that lowered our total, and the criteria I find to be unreasonable.

When the DLN report cards were published, CLRN created a spreadsheet showing the totals for all 50 states in the 10 DLN categories. You may find it here.

Today, I’d like to share our database showing all 72 data points for all 50 states. You’ll find it here.

While there are 72 data points, the highest score by any state was 49, shared by Utah and Wyoming. If we weren’t grading on a curve, both #1s would have 68% on our test, earning “D” grades. However, given that this is a new test, one might ask if all the questions are valid, if some are more important that others, if there was a rubric indicating what is required to meet each point, or if the tests are fairly graded.

Are all points equal? Are some points more critical to promoting online & blended learning? Are some points arbitrary or politically motivated? Well, let’s see. We created this spreadsheet to determine which points all states had in common, which elements are shared by a critical mass, and which expectations that few states have enacted.

Let’s start with what we have in common. Four policies are shared by all 50 states (1, 35, 58 & 59).

  • (1) Under state law, district public school students are eligible for publicly-funded digital learning.
  • (35) State law requires digital content to be aligned with state standards or Common Core State Standards.
  • (58) Under state law, data on student learning is used to evaluate the quality of schools.
  • (59) State law requires poor performing schools, determined by student learning data, to be closed.

Six additional policies are shared by 40 or more states.  (2, 5, 26, 43, 49 & 50)

  • (2) Under state law, charter public school students are eligible for publicly-funded digital learning.
  • (5) State law ensures publicly-funded digital learning is available for all high school students.
  • (26) Under state law, students may enroll in both individual online courses and traditional face-to-face brick-and-mortar schools.
  • (43) State law or practice allows statewide authorizers for digital providers, including virtual charter schools and individual online course providers.
  • (49) State has public options for digital learning, including content, individual online courses and virtual and blended brick-and-mortar schools.
  • (50) State offers not-for-profit options for digital learning, including content, individual online courses and virtual and blended brick-and-mortar schools.

On the other end, no states have implemented four of the policies. While these may be good ideas, these entail cost requirements that are prohibitive at this time.

  • (67) State law requires a majority of content, such as textbooks, to be provided digitally.
  • (69) State law requires all teachers to be provided with Internet access devices.
  • (70) State law requires all students to have Internet access devices.
  • (72) State has implemented all of the Data Quality Campaign’s 10 State Actions to Ensure an Effective Data Use.

Seven elements have been implemented by five or fewer states. The elements and the number of states who have applied them are listed below.

  • (64) Under state law, students may enroll in an unlimited number of individual online courses.  (1 state)
  • (61) State law requires poor performing individual course providers, determined by student learning data, to be closed. (2 states)
  • (38) State law requires data on student learning to be considered when recertifying teachers. (2 states)
  • (8) State law requires students to complete at least one online course to earn a high school diploma. (2 states)
  • (41) Under state law, data on student learning is used to evaluate the effectiveness of teachers. (3 states)
  • (32) State law requires students to demonstrate competency on a standardized end-of-course exam to earn credit for a course. (3 states)
  • (60) Under state law, data on student learning is used to evaluate the quality of individual online courses. (4 states)

My questions about the validity of some of the data points and the bar California was expected to pass for each will be the subject of my next post. In the meantime, what do you find interesting in the data?

Digital Learning Now: Explaining California’s Failing Grade

When I discovered the Digital Learning Now (DLN) project, established by Governor’s Jeb Bush and Bob Wise, I felt there was bi-partisan support for online learning as a means to meet every student’s needs as well as consensus for the legislative changes needed for states to support online and blended learning. The 10 Elements of Digital Learning and their corresponding actions for policy makers and law makers spelled out specific actions needed to support teaching and learning in an online/blended learning world. When I learned last spring that not only were they planning to grade each state on their actions to support the 10 elements, but that they would be announcing their results at the Education In Action conference in San Francisco on October 13th, I was excited for the opportunity for California’s policymakers to hear specific actions that were required to support online learning.

While I suspected that California’s grade would be below average, I was not prepared for our score. Of the 50 states, California scored 50th, as in last. California’s grade for supporting online/blended learning is an “F”. You can see all the state’s scores for the 10 individual categories here. You may download my spreadsheet of all the data here. Today’s post will focus on California’s score from each of the categories, but future posts will review the categories and specific recommendations as related to CA.

DLN’s 10 elements contain 72 measures, with each category containing between two and 13 actions. My spreadsheet reflects each state’s score within individual categories as well as each state’s overall total. By the way, the highest scores attained were Utah & Wyoming with 49 points each. Rounding out the top ten were Arizona, Minnesota, Idaho, Washington, Virginia, Florida, Indiana, and Pennsylvania. The average score was 30.5 and the median score was 27.

California’s score was 14 points. Dead last. 50th of 50.

 

A full PDF of California’s rating for each of the 72 measures may be downloaded here. DLN’s web summary for CA is here.

Here’s the roundup of the 10 elements, their focus, and California’s score in each.

Element 1: Student Access-All Students are Digital Learners

Actions in this category include: 1) State ensures access to high quality digital content, online courses and virtual schools to all students; 2) State ensures access to high quality digital content, online courses and virtual schools to students in K-12 at any time in their academic career; & 3) State requires students take high quality online college-or career-prep courses to earn a high school diploma.

Possible score: 8

Highest score: 7 (seven states)

Lowest score: 2 (California and New York)

 

Element 2: Barriers to Student Access-All Students have Access to High Quality Digital Learning

Actions in this category include: 1) State does not restrict access to high quality digital content, online courses and virtual schools with policies such as class size ratios and caps on enrollment or budget; & 2) state does not restrict access to high quality digital content, online courses and virtual schools based on geography, such as school district, county, or state.

Possible score: 10

Highest Score: Utah with 10 points. Eight states received nine points

Lowest Score: North Dakota, 0. California tied for 42nd with six other states, each with two points.

 

Element 3: Personalized Learning-All Students can use Digital Learning to Customize Their Education

Actions in the category include 1) State allows students to take online classes full-time or part-time (by the individual course; 2) State allows students to enroll with multiple providers and blended online courses with onsite learning; 3) State allows rolling enrollment year round; and 4) State provides all students with access to all approved providers and does not limit provider options for delivering instruction.

Possible score: 12

Highest score: Alaska with 11. Four states received 10 points each.

Lowest score: Three states, including California, scored last with one point each.

 

Element 4: Advancement-All Students Progress Based on Demonstrated Competency

Actions include 1) State requires matriculation of online courses based on demonstrated competency and 2) State does not have a seat-time requirement for matriculation.

Possible score: 4

Highest score: Five states with two points each.

Lowest score: California and 23 other states with zero points.

 

Element 5: Quality Content-Digital Content and Courses are High Quality

Actions include 1) State requires digital content and online and blended learning courses to be aligned with state standards or common core state standards or Common Core standards where applicable and 2) State does not discourage digital content with print adoption practice.

Possible score: 2

Highest score: 27 states with two points. California is in this group. Woot!

Lowest score: Washington with zero.

 

Element 6: Quality Instruction-Digital Instruction is High Quality

Actions include 1) State provides alternative certification routes, including performance-based certification; 2) State provides certification reciprocity for online instructors certified by another state; 3) State creates the opportunity for multi-location instruction; 4) State evaluates the effectiveness of teachers based in part on student learning data; and 5) State ensures that teachers have professional development or training to better utilize technology and before teaching an online or blended learning course.

Possible Score: 6

Highest score: 5 (Texas and Virginia)

Lowest score: California and two other states tied for last with zero points.

 

Element 7: Quality Choices-All students have Access to Multiple High-Quality Digital Learning Providers

Actions include 1) State has an open, transparent, expeditious approval process for digital learning providers; 2) State provides students with access to multiple approved providers including public, private and not-for-profit; 3) States treat all approved education providers public, chartered and private-equally; 4) State has no administrative requirements that would unnecessarily limit participation of high quality providers; and 5) State provides easy-to-understand information about digital learning, including programs, content, courses, and other digital resources to students.

Possible score: 13

Highest score: 12 (Virginia, Washington, and Minnesota)

Lowest score: 0 (Nebraska)

California was tied for 27th place with 14 other states with four points.

 

Element 8: Assessment and Accountability-Student Learning is the metric for Evaluating the Quality of Content, Courses, Schools, and Instruction.

Recommended actions include 1) State administers assessments digitally; 2) State ensures a digital formative assessment system; 3) State holds schools and individual online course providers accountable for achievement and growth; and 4) State evaluates the quality of content and courses predominately based on student learning data.

Possible score: 6

Highest score: 4 (Virginia, Delaware, and Florida)

Lowest score: 2 (27 states including California)

 

Element 9: Funding Creates Incentives for Performance, Options, and Innovation

Recommended actions include: 1) State allows for digital content to be acquired through instructional material budgets and does not discourage digital content with print adoption practice; 2) State funding model pays providers in installments that incentivize completion and achievement; 3) State does not limit the number of credits earned online; and 4) State funding allows customization of education including choice of providers.

Possible score: 5

Highest score: 5 (Minnesota)

Lowest score: 0 (15 states)

California received one point.

 

Element 10: Infrastructure-Infrastructure supports Digital Learning

Recommended actions include: 1) State is replacing textbooks with digital content, including interactive and adaptive multimedia; 2) State ensures high-speed broadband Internet access for public school teachers and students; 3) State ensures all public school students and teachers have Internet access devices; and 4) State ensures local and state data systems and related applications are updated and robust to inform longitudinal management decisions, accountability, and instruction.

Possible score: 6

Highest score: 2 (four states)

Lowest score: 0 (20 states including California)

 

Digital Learning Now, Element #6: Instruction

Last year, Governors’ Jeb Bush and Bob Wise created the Digital Learning Now web site and published their 10 Elements of Digital Learning. In this video, Governor Wise and  Tom Vander Ark discuss element #6, Instruction and DLN’s recommendations for policy and lawmakers. As Governor Wise shares, “Great teachers produce great students — wherever they live or learn.” All videos are hosted at Digital Learning Now’s YouTube channel.

Digital Learning Now Element #5: Content

Last year, Governors’ Jeb Bush and Bob Wise created the Digital Learning Now web site and published their 10 Elements of Digital Learning. In this video, Governor Wise and Tom Vander Ark discuss element #5, Content and DLN’s recommendations for policy and lawmakers. As Governor Wise shares, “Quality content is what education is about.” All videos are hosted at Digital Learning Now’s YouTube channel.

 

Digital Learning Now Element #4: Advancement

Last year, Governors’ Jeb Bush and Bob Wise created the Digital Learning Now web site and published their 10 Elements of Digital Learning. In this video, Governor Wise and Tom Vander Ark discuss element #4, Student Advancement and DLN’s recommendations for policy and lawmakers. All videos are hosted at Digital Learning Now’s YouTube channel.

 

 

Digital Learning Now: Element #3-Personalized Learning

Last year, Governors’ Jeb Bush and Bob Wise created the Digital Learning Now web site and published their 10 Elements of Digital Learning. In this video, Tom Vander Ark discusses element #3, Personalized Learning and DLN’s recommendations for policy and lawmakers.  All videos are hosted at Digital Learning Now’s YouTube channel.

Digital Learning Now Element #2: Student Access

Last year, Governors’ Jeb Bush and Bob Wise created the Digital Learning Now web site and published their 10 Elements of Digital Learning. In this video, Governor Bob Wise discusses element #2, Student Access and DLN’s recommendations for policy and lawmakers. Governor Wise recently created the Center for Secondary School Digital Learning & Policy, which will focus on how digital learning can bring quality college and career ready education to secondary schools with a focus on improving outcomes for low-income students and low-performing schools. All videos are hosted at Digital Learning Now’s YouTube channel.