Case Study: Using Mosaic to Track and Reduce Chronic Absence at Novato Unified School District

Meet Stefanie:

Stefanie Parnell is the assistant principal at Hamilton Meadow Park School in the Novato Unified School District, which sits just thirty minutes north of San Francisco. Recently, Parnell has been using data to better understand chronic absence trends at her school and improve student attendance.

Data and Attendance at her District:

NUSD has recently adopted a district-wide push to improve attendance. Previously, it used a single, average attendance rate that was reported to schools monthly out of their SIS. Much to Parnell’s delight, Hamilton is now one of several NUSD schools piloting Mosaic District Progress Monitoring for more actionable data access, along with the district’s central office.

Stefanie’s “Aha!” Moment:

With access to interactive, intuitive dashboards, Stefanie had an “Aha!” moment that changed Hamilton Meadow’s attendance strategy. Read about what she discovered about her students and what she changed as a result in the full case study, Using Mosaic to Track and Reduce Chronic Absence at Novato Unified School District.

 

See below for a tour of the reports NUSD used:

District Profile
Dashboard designed for superintendents and their leadership team.

  • Visualizes leading indicators to monitor progress toward NUSD’s goals, including attendance, assessments, suspensions, course failures, and many more.
  • Compares performance across schools, grade levels, and student subgroups to understand trends over time and invest in efforts that will drive the highest priority outcomes.

(Note: At Schoolzilla we take both data visualization and data privacy very seriously. For these reasons we are displaying real Schoolzilla reports with 100% fake data.)


School Profile 
Dashboard designed for school leaders and principals.

  • Provides school leaders with actionable data from multiple sources all in one place.
  • Equips leaders with the data they need to implement timely intervention and deploy resources strategically to address areas of need.


Our Schools
Dashboard designed for superintendents and their leadership team.

  • Enables administrators to review individual school progress against key goals at a glance.
  • The list can be sorted and filtered by performance and attributes like school level for easy analysis at your fingertips.
  • Very similar to Our Students, a dashboard that shows school leaders, principals, and teachers see their students’ data.

 

Read the full story in the downloadable case study, Using Mosaic to Track and Reduce Chronic Absence at Novato Unified School District.

Congratulations To Our First Cohort Of Grant Recipients!

This week, Schoolzilla notified the school systems who are receiving awards in the first round of the Mosaic District Progress Monitoring Grant Program.   We made awards to 27 school systems serving 235,000 students in 11 states.  Recipients included San Francisco Unified School District, Bakersfield City School District, Hemet Unified School District, Battle Creek Public Schools, New London Public Schools, Inglewood Unified School District and the South Carolina Public Charter School District.

The final round deadline for the grant program is June 1, 2017.  Download the application here.

The grant awards were made to districts who are working towards:

  •     Making data more understandable & accessible for staff
  •     Setting goals for equitable outcomes on multiple measures, such as chronic absence, normed benchmark assessments, suspensions, or college readiness
  •     Using data to foster continuous improvement during the year, through the regular monitoring of real-time, leading indicators

The grant recipients documented inspiring visions for empowering school staff to use data to run great schools in their applications, including:

“We want schools to use data to inform their own goal setting, curriculum choices, and student interventions; at the district level, we want to use data to look at the system as a whole and easily assess performance across schools, identify best practices to share with schools that are lagging, and to capture information about those schools in need of additional supports.”

“We’d like to see our weekly/monthly/quarterly PD sessions driven by data that all staff have quick access to, and have folks engaged in ensuring equity and access for all students. On a larger scale, we’d also like to have big picture conversations about how our students do beyond graduation, our role within it, and what impact we have had and would like to have on the lives of our students.”

“We are actively pursuing closing inequitable gaps in our system. Clear data — and intentional, regular, data-driven conversation and PLC work — helps expose those gaps and helps us to move our system toward more equitable outcomes.”

We are thrilled and honored to be able to support these districts in achieving their visions, and look forward to the opportunity to expand the program to more school systems in the final round.  Congratulations to all!

Four Insights for Designing K-12 Dashboards

School districts today are collecting an increasing amount of data, and with that comes a growing desire to use that data to drive better outcomes for their students. The challenge is that while the data exists in stacks of paper on desktops and digitally in different academic systems, it’s not available in an aggregated form that empowers districts to use real-time progress monitoring to improve student achievement.

Read more

Data Champion Summit ’17 Highlights

Data Champion Summit is hands-down our favorite time of year– and 2017 did not disappoint, thanks to all of you! Data champions from across the country joined us for three days in March ’17 to share best practices, sharpen their data skills, and connect with colleagues just as passionate about education as they are. We […]

Our Commitment to Information Security

We are committed to information security and privacy—and we are constantly strengthening our best-practice based security systems and protocols to better serve the schools, teachers, and students who rely on us to get the information they need to enable all students to succeed. Read more

3 Keys To Successfully Implementing A District Strategic Plan

 

Everybody seems to have a strategic plan…

Experts like the Wallace Foundation and others have shown that great school districts must establish a strategic vision. And most school systems we talk to have a strategic plan, or are working on one.

 

…yet most of us do not act on our plans.  

Despite all of the thoughtful discussion, planning and work, the most common place to find a strategic plan is sitting on a dusty shelf. Strategic planning experts tell us that most strategic plans never get implemented (in school systems OR in the business world).  

 

How can this be?

How is it possible that this foundational tool that everyone has and everyone agrees is important doesn’t get used?  More importantly, how do you liberate your strategic plan from its three-ring-binder prison and make it useful?

 

We found three keys that will help you go from plan to implementation.

To solve this mystery, we talked to a lot of school systems, including many that DO use their strategic plans.  We also reached out to experts and read up on the research.  We found three keys to making strategic planning actually useful:

 

1. EDIT your plan down to a page.  

That can be really hard to do.  If you engage your stakeholders and community in developing your strategic plan, it’s easy to come up with a very long list of strategies and initiatives.  But prioritizing everything is the same thing as prioritizing nothing – if it takes a binder to list the things you’re going to do, they’re not likely to get done (or even looked at).  School districts that can articulate their strategy in one page (like Ector County Independent School District’s Performance Prioritization Plan) have attained a level of focus, clarity, and alignment that sets them up for success, and makes their plans actually useful.  Back it up with a binder if you need to, but if you can’t synthesize in one page, your plan is much less likely to get used.

2. DEFINE what success (and failure) look like.

That means identifying measurable outcomes and setting goals.  “Improve student engagement” is not measurable; “Reduce chronic absence to 7% of students” is.  Oakland Unified School District’s Balanced Scorecard, with its clear check marks and Xs, is a great example of how strategic goals can be clearly measured.  And remember, defining what “off track” looks like is as important as defining success. 

3. INSTITUTIONALIZE your plan by reporting on progress at least monthly.

The ACSD’s survey of school district strategic plans found that effective districts checked in on their progress at least monthly.  Regular check-ins can identify opportunities to change course, which drives real action.  Annual “autopsy” check-ins all too often uncover problems where it’s too late to solve.

Monthly reporting probably won’t happen without an automated tracking system for your plan.

Of course, as with most school improvement strategies, this is all easier said than done.  Most district leaders we talk to agree: obviously it’d be great to have a one-page plan of measurable goals that we check in on monthly.  But how do we get there?  It’s genuinely hard, especially without the right tools.  That’s why so many school districts write strategic plans but don’t actually implement them.

 

Sign up for a demo if you want to see our district progress monitoring solution.

Schoolzilla has worked with school systems across the country, including St. Louis Public Schools, to turn strategic plans into everything-on-one-screen dashboards that make it easy to monitor goals monthly (or even daily). We are working hard to help districts act on their plans.  

 

Interested in learning more?  

 

Achieving District Goals Using Data-Driven Performance Management Webinar Recording

Click below to watch the full webinar recording, and continue the discussion by sharing your own tips or questions on the Hub!

How to Roll Out Reports for Maximum Impact Webinar Recording

As data and academic leaders, how can you ensure the reports you’re rolling out become an integral part of your stakeholders’ practice?

In our November webinar, Caroline Galindo and Mariel Matze from Schoolzilla shared strategies for how to successfully roll out reports that make an impact, with a focus on the following:

  • Using roll out content to reinforce your organizational goals and positive data culture
  • Identifying key stakeholders and defining their role and responsibilities
  • Setting expectations for report usage
  • Soliciting and iterating on feedback from your key stakeholders

Click below to watch the full webinar recording, and continue the discussion by sharing your own tips or questions on the Hub!

Common Sense Media released free data security and privacy tools for districts; Schoolzilla earned top marks

The district CTO’s growing data privacy challenge:

According to the Teacher Knows Best survey of over 4,000 teachers, “Virtually all teachers (93 percent) now use some sort of digital tool to help guide instruction.” Given education technology tools’ sudden rise to near ubiquity, it is not surprising that “for the fourth straight year, state legislatures have passed bills to protect student data privacy, bringing the total number of laws on the books to 74.” (Center for Digital Education, 2016). District technology leaders (e.g., CTOs) are stretched to keep up with the pace of demand for new tools that unlock the potential of personalized learning and data-driven decision-making while also working to maintain the safety and privacy of student data.

New resources to help districts CTOs keep student safe:

Common Sense Media (CMS), the nation’s leading independent nonprofit organization dedicated to empowering kids to thrive in a world of media and technology, has developed tools to help districts evaluate providers and keep student data safe as they work to adopt new technologies. School districts can now use CMS’s comprehensive privacy evaluation tool for assessing education technology providers.  We were excited to learn that Schoolzilla earned top marks across all four categories of their privacy evaluation!

About CSM’s Privacy Evaluations:

Common Sense Media’s privacy evaluation effort, which involved almost 100 school systems in the evaluation process, includes privacy assessments on over 150 education technology applications. Vendors are evaluated on 4 dimensions that are key to keeping students and their data safe:

SAFETY – takes into consideration best practices that protect a user’s physical and emotional health.

PRIVACY – takes into consideration best practices that protect the disclosure of a user’s personal information.

SECURITY – takes into consideration best practices that protect the integrity and confidentiality of a user’s data.

COMPLIANCE – takes into consideration best practices of companies that collect personal information from children or students and the legal obligations for the privacy and security of that information.

5 ways to use CSM’s resources to keep your students’ data safe:

Whether your vendors are among the 150 who have been evaluated or not, there are multiple ways that you can leverage CSM’s resources to protect student data.

  1. Review the Information Security Primer for Evaluating Educational Software to learn more about how to best evaluate the security and privacy of technology providers.
  2. Look up your current technology providers or providers you are considering to see if they’ve been reviewed and how they scored in the privacy evaluation tool.
  3. Incorporate the privacy evaluation questions into your next RFP and/or vendor due diligence efforts.
  4. Bring CSM’s questions to your next contract renewal discussion with a technology provider for your district.
  5. Join the consortium of nearly 100 schools and districts that are working in the United States to help streamline the process of evaluating privacy policies for edtech apps.

Getting the Most Out of Your State Assessment Results

With the release of new state assessment results, district and school leaders are anxious to use their data and make decisions that will impact student achievement.

In our September webinar, LaKeshia Richardson and Steve Taylor from Schoolzilla focused on the essential questions district leaders, school leaders, and teachers are asking when reviewing their data:

  • Do I understand how proficiency levels, scores, and claim performance are changing over time?
  • What can I do to benchmark my data against others?
  • What are the benefits and drawbacks of looking at this data with formative assessment data?
  • How can I use this data to have meaningful conversations with stakeholders?

Using SBAC as an example, LaKeshia will share best practices for using growth data to make informed decisions and how applying user-centered design methods and user feedback can increase the use of data to drive action in your district.

Click below to watch the full webinar recording.

Schoolzilla has powerful Smarter Balanced assessment dashboards designed to help educators make immediate sense of their students’ results.

With Schoolzilla’s Explorers, you can visually answer questions like:

  • What achievement gaps are we seeing in our district vs. others?
  • How does performance vary by zip code, parent education, or disability status?
  • Where are the bright spots in our district?

Click here to start exploring the dashboards.

This is the Year: Kick-Start Your District’s Data Culture

Building a healthy data culture is essential to using data effectively in schools. From leading principals’ meetings to hosting a district-wide data day, school leaders need to consistently explore, analyze, and share data to drive action.

In our August webinar, Sarah Shoff and Jason Dolan from Schoolzilla focused on the key elements to building a strong data culture:

  • Thinking critically about setting and monitoring goals
  • Leading regular, action-oriented data conversations
  • Determining clear next steps—continuing the conversation and turning insights into action

Click below to watch the full webinar recording and learn how you can prepare for, lead, and follow up on data conversations as a key driver of your data culture.

Additional resources about building your district’s data culture can be found here on Schoolzilla’s Data Champion Hub:

(You must be logged in to view the above attachments. If you don’t have an account, please click here to register.)

Case Study: Using Data to Drive St. Louis Public Schools’ Transformation Plan

2013–2014 — Challenge:SLPS quote2

St. Louis Public Schools (SLPS) was working hard to regain their full accreditation, after showing enough progress to regain provisional accreditation the previous year. But, despite SLPS’ strong data culture, district leaders recognized that their data tools were insufficient to provide “the right data on the right timeline,” leading them to issue an RFP for a new data tool.

2014–2015 — Solution:

After considering seven vendors, the district selected Schoolzilla to build and power an integrated set of leading indicator and key outcome dashboards to enable district leaders to automatically monitor progress against the multiple measures within their district’s transformation plan.

2015–2016 — Result:

SLPS launched their new Schoolzilla dashboard system to their network of superintendents and pilot group of school leaders and teachers.

Looking forward to next year, SLPS remains relentlessly focused on using data to drive continuous improvement and is on track to achieve full accreditation by 2017.

2016-2017  — UPDATE:

SLPS regained full accreditation on January 10, 2017!

Screen Shot 2016-08-08 at 1.54.09 PM
Read the full case study, Using Data to Drive St. Louis Public Schools’ Transformation Plan, and learn more about how SLPS developed its Excellent Schools Transformation Tool (ESTT) dashboards to keep track of the district’s key performance indicators (KPIs) at the district, school, and student levels.

 

See below for a tour of St. Louis Public Schools’ ESTT Dashboards:

District Profile
Dashboard designed for superintendents and their leadership team.

  • Visualizes leading indicators to monitor progress toward SLPS’ goals outlined in their Transformation Plan.
  • Compares performance across schools, grade levels, and student subgroups to understand trends over time and invest in efforts that will drive the highest priority outcomes.

(Note: At Schoolzilla we take both data visualization and data privacy very seriously. For these reasons we are displaying real Schoolzilla reports with 100% fake data.)District Profile


School Profile
Dashboard designed for school leaders and principals.

  • Provides school leaders with actionable data from multiple sources all in one place.
  • Equips leaders with the data they need to implement timely intervention and deploy resources strategically to address areas of need.

(Note: At Schoolzilla we take both data visualization and data privacy very seriously. For these reasons we are displaying real Schoolzilla reports with 100% fake data.)School Profile


Student Profile
Dashboard designed for teachers.

  • Enables teachers to quickly understand the attendance, academic, and climate/culture trends of SLPS students.
  • Allows educators to strategically differentiate instruction and utilize appropriate interventions.

 (Note: At Schoolzilla we take both data visualization and data privacy very seriously. For these reasons we are displaying real Schoolzilla reports with 100% fake data.)Student Profile

The 6 Critical Jobs of an Effective District Data Ecosystem

Using data in a district context is deceptively difficult—a classic case of “data-rich, information-poor.” According to a recent survey of over 4,000 teachers across the United States, over two-thirds of teachers (67 percent) indicated that they were not fully satisfied with the effectiveness of the data and tools they had access to on a regular basis (Teachers Know Best).

Although every district will have needs that are unique, given the local context and strategic objectives, there are six jobs that every effective district data ecosystem must do to remain effective for educators.

 Read about the 6 Critical Jobs of an Effective Data Ecosystem and the tools—from spreadsheets to data warehouses—we most often see used to get those jobs done.

Designing Reports Your Users Will Love

Data + design thinking rarely go hand-in-hand. But designing reports your users will love involves more than just creating a graph or chart. Designing intuitive, easy-to-use reports that engage users and enable data-driven decision-making requires taking a step back to ensure that your visualizations are addressing real user needs.

In our June webinar, Maggie Goulder and Jason Dolan from Schoolzilla shared how applying user-centered design methods can improve the usability of your reports and enable data-driven decision-making, with a focus on:

  • Identifying key questions that will help you discover user needs and insights.
  • Leveraging design thinking and ideation techniques to generate new ideas for building data dashboards and reports.
  • Learning how to rapidly prototype your ideas to discover which ones best address user needs.

If you weren’t able to join us, or would like to share the webinar with a colleague, please click below to watch the full webinar recording!

Additional resources about designing reports your users will love can be found here on Schoolzilla’s Data Champion Hub:

(You must be logged in to view the above attachments. If you don’t have an account, please click here to register.)

 

Four Keys to Driving a Successful Change Management Strategy

Measuring the success of your change management initiative is critical in determining its effectiveness. Change management in education can be very difficult, whether you’re at a single-site charter school or a large traditional district. Bi Vuong, the former deputy CFO of the School District of Philadelphia (which she called “the District”), spoke at Schoolzilla’s Data Champion Summit. Vuong, now the director of Proving Ground at the Center for Education Policy Research at Harvard University, shared her own experience defining desired outcome measures and identifying the leading indicators necessary to drive the District’s strategy and improve enrollment.

To drive their change management initiative, the School District of Philadelphia established the following process to accelerate the transition and monitor progress against intended outcomes:

  1. Analyze district data to pinpoint exactly where the problems exist

  2. Develop a strategy that clearly addresses the problem

  3. Identify key outcome measures to define success

  4. Conduct rapid cycles of analysis to measure progress and refine the strategy

The School District of Philadelphia executed on this process to focus strategically on increasing enrollment at higher performing schools.

In 2014, the District had:

  • fewer than 50 percent of students reading at grade level by third grade
  • graduation rates were below 70 percent
  • closed twenty-four schools within one year
  • seen its enrollment decline by 60,000 students within the last twenty years

Vuong, who served at the District for over five years and most recently as its deputy chief financial officer said, “One of the superintendent’s goals was to get more kids college and career ready and [the other was to have] more kids reading at grade level.”  A strategy to help achieve these District-wide goals was to provide “the kids from the lowest performing schools the option of attending a higher-performing school,” Vuong said.

“We had high-performing schools with [available] space. We had students in underperforming schools.” To change this fact, the District more closely aligned its budget allocations to student enrollment. The number of teachers and the school’s budget were dependent upon the number of students enrolled.

Over the course of two years, the District continued to review and refine its processes to create alignment across the District, including:

  • adjusting enrollment dates to accept students earlier in the school year
  • developing a data structure with key stakeholders from the IT, HR, finance, and enrollment teams
  • monitoring student enrollment to measure how many students were applying to schools, getting accepted, enrolling, and actually showing up on the first day of school
  • adjusting a school’s budget based on the projected number of students who were expected to enroll on the first day of school

DSC_0511With the District’s enrollment strategy and technology tools in place, principals had easier access to data and could optimize their student acceptance decisions. Due in part to this initiative, the District had increased enrollment in higher performing schools between school year 2014–2015 and school year 2015–2016 by more than 7,000 students.

It took a year and a half for the School District of Philadelphia to develop, implement, and refine its change management initiative. According to Vuong, the key takeaways for defining and optimizing this change were:

  • deliberate planning to align cross-functionally with IT, student placement, and HR
  • collaboration, capacity building, and training to get people used to the new system and process
  • data, data, data. Vuong said, “We (the central office staff) used the exact same data that our principals saw and talked to them about it. [Our data] was very quick, very reliable, and very accessible.”

What problems is your organization working to solve? Do you have a strategy and outcome measures you have identified? Click here to share your thoughts and learn how other data champions are driving change management initiatives in their schools and/or districts.

Going Beyond Tableau With Schoolzilla

Good data visualization starts with two key ingredients: properly structured data and a great visualization tool. Schoolzilla provides school districts with the unique combination of a powerful data infrastructure and—via Tableau Software—an intuitive and beautiful data visualization tool. This combination allows district leaders to build and share the exact dashboards they need to answer the questions that matter most to serving their students.

Tableau is so great that sometimes we’re asked, “Why do we need Schoolzilla? Can’t we just do it all with Tableau?”

Think about the last time you created a bar chart in Excel, GooDatagle Sheets, or even Tableau. It only took you two seconds to press that bar chart button. But were you finished? Usually not. Most of the time, you realized that your data was not in the right format, didn’t have the right column names, or wasn’t at the right level of detail for that button to work. You ended up spending hours manipulating your data or using Jedi-level chart skills to get the chart you wanted. That’s because the data wasn’t properly structured.

In most schools, important data lives in 30 places or more. Schoolzilla brings that data together and transforms it into a data model that’s optimized for reporting. Without Schoolzilla’s data infrastructure, schools and districts will continue to spend 80% of their time organizing, connecting, massaging, and updating data to get it ready for Tableau to do its magic. We created Schoolzilla to eliminate the hours wasted in schools every day preparing data—and to give that time back to the data champions in school systems so they can push the frontiers of insight, usability, and data-driven action.

“Schoolzilla has enhanced our data work immeasurably. Our partnership with Schoolzilla has allowed us to provide real-time dashboards and analyses to our school leaders and staff. We used to build these reports by hand, using many different data sources. Now we have a centralized, live dashboarding platform.” —Edmund Han, Director of Data and Analytics, KIPP DC

Schoolzilla uses Tableau’s software for two primary reasons: to build our own out-of-the-box reports and to provide our partner organizations a way to build customized reports. But the ability to create and customize dashboards is only the top layer of Schoolzilla’s offering. Schoolzilla provides school systems with the technology and data solutions to make data visualization possible, including:

  • Time-Saving Data Integrations. Schoolzilla supports the time-intensive, ongoing, and costly work of maintaining the data connections required for your Tableau reports. If a state or vendor changes its file layout, Schoolzilla will do the work to make these layouts compatible with Schoolzilla. This ensures that reports that worked for last year’s state test will continue to work for current and future years.
  • Intuitive Dashboard Library. Schoolzilla offers beautiful out-of-the-box reports that we have built from the feedback and recommendations of teachers, principals, and data analysts. These reports are designed to be action-oriented, and they have been put to the test by organizations across the country.
  • Improved Data Quality. Schoolzilla supports our partners and school systems by helping them improve the quality of data in their systems. Schoolzilla does this by proactively identifying errors and ensuring that standard and custom reporting in these systems is accurate.
  • Effective Data Standardization. Schoolzilla transforms data from a variety of formats and different data systems that may be found in your organization into the same structure. This makes it much easier to build reports using data from multiple data systems (e.g., a SIS, blended learning tool, or an assessment).
  • Optimized Data Structure. Schoolzilla has years of experience working with education data and Tableau. We have learned how to best optimize data structures to empower sophisticated analysis using Tableau. Schoolzilla saves you the time once spent structuring your data with pivoting and manual reorganization, allowing you to get right to the analysis and reporting.
  • Secure Data Warehouse. We power your data through a secure, hosted data warehouse that puts all of your data in one place to help make sure it is only shared with the appropriate people serving students.
  • Customized Data Wall. Schoolzilla’s Data Wall enables you to manage and share the reports in your dashboard library so you can prioritize your most important reports, favorite the reports you find most useful, group reports by theme, project, or collection, and label reports so you can identify relevant trends and think about what to do next.

Together Schoolzilla and Tableau empower you with the tools to build, maintain, and share data visualizations that have an impact. Check out our online demo to see how easy it is to create your own dashboards with Schoolzilla.

 

Big Wins in the Little Things: Data Improvements for Key District Operations Webinar

Are you looking for ways to use data to identify key problems with simple solutions? Do you need examples for building tools and processes to address those problems and measure impact?

In our last webinar, Adam Kishel, senior data analyst at Lawrence Public Schools—a 14,000 student district in MA that’s been widely hailed as a turnaround success—and Vlad Gutkovich, district partnerships lead at Schoolzilla, shared how to achieve big data wins in small steps.

Here’s an overview of a few of the customized chronic absence and enrollment dashboards Adam has created to improve efficiency and efficacy in Lawrence Public Schools. For a more in-depth look at Adam’s dashboards, please watch the full webinar recording below.

1. Chronic Absence Status: School Comparison Dashboard—Used by Lawrence Public School’s district-level attendance officer, this dashboard shows students who are chronically absent—identifying who they are and showing where they’re located on a map. After reviewing the dashboard, the attendance officer can determine which areas of the city have the highest chronically absent students and plan which areas to visit.

LawrenceDashboard1

2. Section Enrollment Dashboard: With its highly mobile student population, Lawrence Public Schools needed a way to efficiently place students in the right schools while ensuring that the schools and classrooms had the capacity to accept the students. This dashboard enables the enrollment officer to quickly see if there is space in any of the sections, who the students are who are currently enrolled in each section, and where the students in each section are located geographically on the map.

LawrenceDashboard2

3. School Zone Dashboard: During summer placement, Lawrence Public Schools found that some schools were accepting more students and becoming overcrowded. This dashboard helps place students in the correct zone before the start of the school year by showing which students (based on their addresses) will be attending which school. It also displays alternate schools so the enrollment officer can see if there’s another school that is closer.

LawrenceDashboard3

Click below to watch the full webinar recording!

10 Simple Strategies for Holding the Best Data Day Ever

Leading a data day (or any session that relies heavily on data) is no easy task. From preparing an effective presentation, to delivering the session with relevant and timely content, to following-up with attendees to ensure data conversations are continuing well after the session has ended.

In our last webinar, Steve Taylor and Sara Coffin from Schoolzilla shared 10 simple strategies for leading a successful data session. Check out the video below to hear how schools are implementing these best practices to spark and maintain engagement during their data days.

 

Using Data to Pursue Equity in Schools

Schoolzilla is proud to support a growing community of educators who are committed to using data to pursue equity in their schools. There are many ways to define and measure equity. To take one example, Equal Opportunity Schools is a national nonprofit organization focused on the important issue of access to advanced courses, which can lead to higher engagement and better postsecondary outcomes for students.

At the core of EOS’s mission is the fact that students of color and students from lower-income families are less likely to enroll in Advanced Placement (AP) and International Baccalaureate (IB) courses. These “missing students” create a national “enrollment gap” that contributes to systematically worse educational outcomes for those students compared to their wealthier, White, and Asian-American peers.

Like most equity-related issues, this is a complex problem rooted in historical and structural trends. However, it’s also an immensely important problem to solve.

EOS takes a data-driven approach to helping schools confront their enrollment gaps. The first step involves a “gap analysis” (see image below) to identify the size of each school’s enrollment gap.

As you can see, EOS uses the enrollment rate of medium- and high-income White and Asian students as the benchmark for all other groups. From there, they’re able to calculate the number of “missing students” from other demographic categories. This begins to give schools some measurable enrollment goals to help close their enrollment gaps.  

EOS Gap Chart

In our experience at Schoolzilla, real change occurs (and the real work begins) when teachers and administrators are able to have data-driven conversations about their challenges and opportunities.

Using the enrollment gaps identified by EOS, teachers and school leaders can consider questions like, “What would it take for each teacher of an AP prerequisite to get five more students from these underrepresented groups to register?” and from there, develop concrete plans to make their schools more equitable.

Elizabeth Sykes of EOS says that “bringing data to the table is what enables these conversations to start and flourish.” To learn more about EOS’s approach, check them out at eoschools.org.

We’d love to learn about your school’s challenges and successes with equity. Join this conversation!

 

KPIs: An Opportunity for Holistic Priorities?

As our K-12 accountability landscape shifts away from the No Child Left Behind act, which some complained was too narrowly focused on high stakes test scores and inadvertently incentivized educators to “teach to the test”, I am increasingly seeing efforts to redefine K-12 success in more holistic terms. Whether it’s the 11 civil rights organizations that wrote an open letter to President Obama calling for a focus on 8 features, which they assert are critical to building an effective accountability system, or the California DOE, which has named 8 key priority areas and directly tied those priority areas to district funding, the zeitgeist of the moment feels clear: data should be more than just test scores.

Factors that are adjacent to student achievement, such as student engagement and parental involvement are finding their way into the strategic plans of districts across the country. In researching these emerging trends and helping my team at Schoolzilla to develop a holistic and forthcoming set of KPI dashboards, I have encountered several examples of folks in the field who seem to be using KPIs well as well as a couple of white papers that provide guidance on KPI implementation for districts.

A FEW GOOD EXAMPLES OF KPI ADOPTION IN THE FIELD…

  • The now famous early adopters of the balanced scorecard system, Monroe County Schools in Georgia started using balanced scorecards back in 2002. Monroe County also uses continuous improvement plans to stay focused. These practices, used in tandem, have led to significant gains over the past decade.  
  • The CORE districts in California, which are a collection of 10 districts representing over 1 million students have banded together to focus on 8 CORE district metrics. This has allowed these districts to blend the benefits of benchmarking across common measures with the advantages of adopting a more holistic framework. This allows CORE districts to more easily see what drives results and collaboratively scale new strategies.
  • The School District of Philadelphia puts out school progress reports that break results out into 4 tiers (Intervene, Watch, Reinforce, Model) and cover categories such as Achievement, Progress (i.e., growth), Climate, College & Career Readiness, Progress on Equity and Educator Effectiveness. These categories highlight the importance of categories that are adjacent to student achievement and play a critical role in the overall success of the district.

KPIA COUPLE OF RESOURCES TO HELP YOU ADOPT A KPI-DRIVEN APPROACH…

  • Hanover Research put out a comprehensive report on Balanced Scorecard Best Practices, which can help you structure and implement Balanced Scorecards at your district.
  • The Alliance for Excellent Education highlights 4 important considerations to take into account when creating a holistic dashboard to manage district performance in this informative whitepaper.

If you have other KPI resources you’d to share with us or would like to learn more about the best practices we have encountered in the field, please reach out via the Talk to Schoolzilla link at the bottom of this page.

Talk to Schoolzilla

 

 

 

Considering an Ed Tech Vendor? Seven Factors that Matter Most for Success

Your school is preparing its budget for next year, and you’re interested in pushing forward on a new technology initiative. I’m stoked for you!

Before you do, consider seven factors. In our 3+ years of impact and customer success at Schoolzilla, these factors consistently predict success for a school’s new vendor initiatives (e.g., data warehouse or new formative assessment system). Ultimately, addressing these factors with your prospective vendor will help the initiative be successful, give you clout internally, and most importantly, benefit your students.

In this post, I’ll walk through each factor briefly, and in subsequent posts, I’ll do a deep dive on each factor.

  1. Executive Sponsorship: Who is the leader at your organization allocating the budget and holding your team and the vendor accountable for ROI?
  2. Champion Capacity: What teammate(s) can devote time – especially up front – into learning and applying the initiative to your organization?
  3. Champion Expertise: Beyond capacity, do your internal champion(s) have the knowledge, experience, and insights with the domain / subject matter?
  4. Support Experience: When you run into a challenge, how accessible, knowledgeable, and approachable is the vendor’s support team?
  5. Product – Need Fit: Does your need (e.g., “see data in one place and get actionable insights”) match nicely with the main focus of the vendor (e.g., Schoolzilla)? Or conversely, are you trying to pigeon hole a product to meet a need that it is only tangentially related to its intended use?
  6. Trust in Product: Ultimately, can you trust the products that the vendor produces? Trust may come from various sources – e.g., prior success or deep orientation of the vendor’s processes.
  7. Culture: Are there some colleagues at all levels behind this investment? For example, if you’re purchasing a data warehouse, do your colleagues see data-driven conversations as a critical step to supporting students?

If you’d like to learn more about these factors, or would like to see rubrics developed by Schoolzilla or other school systems, please reach out.  Also, if you disagree or have other important factors, let us know. I’m happy to talk more!

Building Your Data Culture From the Bottom Up

Building a strong data-driven culture goes beyond a school’s willingness to use data to solve problems. Just like building a house, a school’s data culture needs to be built upon a solid foundation. To ensure you’re building something that is durable and sustainable, you need clear blueprints to outline your plans for developing and maintaining your school’s data culture.

Start from the bottom up with a strong foundation
Behind every great contractor is a team of people working on the ground level to get the job done. The same is true with building your data culture: you need buy-in from all your key stakeholders, executives, superintendents, principals, teachers and students.

“Data holds the key for institutions to create better outcomes for students by helping educators understand, why. Why did a student not graduate? Why did a student drop or fail a course? Why did a student not master a particular concept?” (Big Data in Education)

Having a clear understanding of your goals and values is essential to getting the buy-in of your school leaders. Your stakeholder’s time is precious and rare. If you have an hour of their lives, make it worthwhile and applicable to their school or position in that district. People often tune out information that is not immediately relevant or of interest to them.  Understand what goals they have set for their school/district/classroom, how they are measuring these goals, and what data they will subsequently be jumping out of their seats to see.

Building the framework
Without walls, your house lacks structure. Similarly, the framework of a successful data culture is built upon trust. Clean and accurate data to creates buy-in with your stakeholders. If you do foresee inaccuracies, set that expectation upfront. The two drivers here are that it can be challenging to plan with incomplete data and it can be alarming to see inaccurate data.

An attendance report that shows 20 out of 25 students might be enough information for a district-level analysis, but a teacher cannot accurately assess the culture in their classroom with this data. If there is an incorrect calculation on a recent assessment around the # of students on target it can affect how a teacher views the provided data. Reinforce that the onus is on school leaders and teachers to enter data accurately and readily so that you have a mutual stake in the reports being released. Be aware of what is cumbersome for school staff versus what is a good use of their time to gather. If you aren’t sure, ask for feedback whether in a survey or asking firsthand.

Hold it all together with a strong roof
Collaboration is the glue that holds a school’s data culture together.

“The purpose of using data is to raise questions and inform discussion rather than to dictate a course of action.” (Data-Driven Leadership, p. 120)

Data should be a conversation first. This can be done in break out groups. Groups can be assigned by grade level, subject matter, or whatever makes the most sense for your school. Avoid constraining the conversation. The value of conversations is the dynamic nature they can take which leads to a greater generation of ideas. We recommend providing prompts to begin these discussions:

  1. When you look at this report, what are you most proud of?
  2. What are you most concerned about?
  3. What questions do you have or what do you need to understand better?
  4. Which students and class periods are over performing?
  5. Which students and class periods are underperforming?

Looking for more resources to support building a data-driven culture in your school? Here’s a few of many resources available on Schoolzilla’s Data Champion HUB:

 

CTA

10 Questions to Ask Before You Build a Report for Your Schools

When building a report, it’s easy to get lost in your own exploration. But ideally, reports will be used in classrooms, main offices, parent-teacher conferences, and the central office—not just your desk. Make sure your report informs the decisions being made for students by asking the right questions up front.

  • Who will be using it?  Teachers may prefer detailed, student-level data so they can focus on their classrooms. School leaders need to slice school-level data both vertically and horizontally across grade levels and subjects. District leaders often ask for aggregate data they can drill into as necessary. (Tip: think about whether each party’s view should be restricted to his/her own classroom, school, etc. or whether staff should be able to view each other’s data.)
  • What action should they be equipped to take with the data you provide?  Reports, at their best, both inspire and enable action. Your office managers should be able to call truant students’ homes? Include telephone numbers. Principals should be able to coach their teachers mid-semester? Include both classroom performance and growth so they can tailor conversations around trends, not just scores.
  • When and where will they be using it? Think about protecting student information when reports will be used publicly or in meetings. Consider font size, simplicity, and mobile-responsiveness when reports will be used on the go.
  • How often will they want to use it? If it’s everyday data like attendance for office managers, that report is likely to be a must-have, so give them all the details! If it’s annual data (like most state tests), it’s likely to be high stakes, so build in context for in-depth analysis.
  • Where does the data live and how will this report get refreshed? The reports you build are as only as good as the data they convey. If you need fresh data often, consider connecting to a live source like a data warehouse instead of static (and time-consuming) spreadsheets.
  • How are they going to feel when they look at it? Planning a staff meeting? Share low scores in with specific individuals in private beforehand so they aren’t put on the spot– or display data in aggregate and have those conversations later. Avoid bright reds and greens unless you want to convey strong concerns and big wins.
  • Is it intuitive? Not everyone lives and breaths data, so build in guides where others might get confused. Small “click here” text boxes will make a world of difference for those not used to exploreable reports. A short explanation of a RIT score will engage parents whose kids just took NWEA MAP for the first time.
  • What can you take out? Before you publish, edit heavily. After all, if a teacher can’t make sense of it within five minutes over his 7:00am coffee, it won’t get used.
  • Is the data clean? Even if you build a spectacular report, dirty data will render it “broken” to your viewers– especially if you’re debuting it for the first time. Make sure they can trust what they see by reviewing data quality before you share and monitoring regularly.
  • How will you know how to make it better? Formalizing a way for people to share feedback will not only help you improve your reports, it’ll give you well-earned buy-in from your colleagues. If you listen well and respond to their needs, your colleagues will start reaching for your report and asking for even more data insights.

For those of you working on behalf of schools, what would your #11, #12, and #13 be? I’d love to hear how your thoughts might apply to Schoolzilla’s standard reports. Check them out here.

Data Visualizations that Enable Discovery in Schools

Viewers usually come to data visualizations with a question. Good visualizations answer that question. Great ones answer that question in a way that sparks more questions. The best visualizations answer the question, spark more questions, and answer those too.

Dan Murray, Director of Strategic Innovation at Interworks and Tableau “Zen Master”, is an expert at this. He’s built Tableau dashboards for a range of organizations wanting to use BI data more successfully, all with the goal of “enabling discovery” for the viewer. At Schoolzillla, we’ve seen similar success at school districts that do the same for teachers and principals. For example, take this Chronic Absence Toolkit, built for district leaders:

Toolkit (1)

For a superintendent to get the most out of this report, it was important that he/she be able to explore the data independently. Just see how Dan’s top three “enabling discovery” tips applied:

  • Use filters and parameters: Filters allow you to narrow the scope of the data (e.g. by school year) and reach a more precise answer to your question. Similarly, parameters allow the viewer to explore the data using the factors that matter most to him/her (e.g. demographics).

filter parameter

 

gender parameter

(Notice how we narrowed the data to the 2014-15 school year and split the report by gender to compare chronic absence rates between male and female students.)

  • Tell more with tooltips: Tooltips allow you to offer lots of granularity without overcrowding the view. And for viewers who need to recognize individual data points before they trust the overall visualization, tooltips are a nice way to ground them. (Districts who have done this will tell you that data quality is especially important here: if the data’s incorrect, many viewers will decide the entire report is “broken”. Don’t waste your first impression with poor data quality!)
  • Pull it all together into a dashboard: Your data tells a story if you compile different perspectives into the same dashboard. This dashboard allows you to look at average daily attendance (ADA) against chronic absence rates at the same time so you know how chronically absent students are affecting your ADA rates. While each metric is important, they become infinitely more powerful when shown in the same frame.

If you’re interested in exploring this report in more detail (including a student-level attendance dashboard used by office managers across the country) request access here.

And if you’d like to try these tricks out on your own, Dan’s releasing a new edition of his Tableau how-to, Tableau Your Data!: Fast and Easy Visual Analysis with Tableau Software, a great resource for anyone learning to build reports in Tableau Desktop.

For teachers and principals, simple, exploreable reports using these tips can enable discovery and most importantly, empower action on behalf of your students.

A Data Champion’s Reading List

In the month since Data Champion Summit, I’ve spent a lot of time reflecting on this year’s conferencethinking about the insightful conversations between Data Champions at the lunch table, remembering the powerful panel discussions with St. Louis Public Schools, KIPP Bay Area, and Harvard (just a few of many), and visiting the Data Champion HUB to find more information about the sessions I couldn’t attend.

One common theme throughout Summit was the collaboration amongst Data Champions. Every session provided an opportunity for Data Champions to share information, from what’s working in their district to how they designed custom reports to solve a problem. And that’s not all, they even exchanged book recommendations!

This post summarizes the book titles swapped by Data Champions throughout the conference (listed in no particular order). Want to share your favorites? Continue the conversation here on the HUB.

Happy reading!

How districts can use Title I and Title III funds to implement systems to collect, manage, and analyze assessment data

6736158045_6eb22f6d83_zAt Schoolzilla, we sometimes receive questions from districts about which funding pools they can use to fund their data efforts. To that end, we thought it’d be helpful to share a few pointsfrom the US Secretary of Education made in a guidance letter sent to Chief State School Officers on February 2, 2016. This letter is a follow-up to the Testing Action Plan released in October 2015 and illustrates how districts can use Title I and Title III funds to implement “systems to collect, manage, and analyze assessment data” aka comprehensive data platforms, like Schoolzilla.

Please see the excerpt below or read the letter in full, here.

Guidance from the Secretary of Education on how to use Title I and Title III funds to improve data use in your district:

  1. A district might reserve ESEA Title I-A funds off the top of its Title I allocation to help educators in Title I schools learn to manage and analyze student data in order to improve instruction and decision-making for school improvement efforts.
  2. A Title I school operating a schoolwide program, to the extent it is consistent with its comprehensive needs assessment, might develop and implement a data system to track student progress on classroom- or district-based formative and interim assessments to provide educators with comprehensive information about each student’s progress
  3. A district might use funds under ESEA Title III to analyze data from its annual English language proficiency assessment in order to tailor supports for individual English learners.

A district might reserve ESEA Title I-A funds off the top of its Title I allocation to provide targeted information to teachers in Title I schools to better support the needs of low-achieving students by breaking down assessment results into discrete areas of strength and deficit and designing instructional modules to address specific deficits.

Edtech Trends: Seeing K-12 Education Through a Different Lens

16660796639_5bba104e7f_z

For the past year, EdSurge has been researching key trends that are driving the K-12 edtech market through the lenses of its community of educators, administrators, entrepreneurs, investors, and policy makers. Schoolzilla is excited to have our CEO, Lynzi Ziegenhagen, featured as one of the subject matter experts spotlighting the importance of teaching social emotional learning to prepare students with the life skills needed to succeed in college and careerLynzi comments, “social-emotional measures are becoming more widespread and are even starting to be used in actual accountability measures.” 

Today in the first chapter of The State of Edtech, EdSurge has identified their top eight trends: infrastructure, learning models, computer science, student assessments, data privacy, professional development, edtech business models.

This project aims to let you try on different lenses in looking at K-12 education in the US. We will give you perspectives from different stakeholders on the trends and forces shaping how money is invested, how tools are created and how schools are designing teaching and learning experiences.” (The State of EdTech, 2016).

Learn more about K-12 edtech trends identified by EdSurge here.

200 Data Champions Connect, Develop, & Take Action: DCS ’16 Highlights

Riddle me this: Where can you find exhilarating trivia, over 200 Data Champions, intense corn hole tournaments, and a live student band?

Answer: Schoolzilla’s 2nd annual Data Champion Summit! (We even had to move venues this year after doubling in size from last year’s Summit!)

Thanks to the Charles and Helen Schwab Foundation’s generous support, the Doubletree Berkeley Hotel was the destination hotspot this last week Feb. 16-18, 2016 to connect with K-12 data enthusiasts. One attendee described #DataSummit16 as a gathering of like-minded people at the intersection of data and education with space to discuss shared issues and possible strategies to tackle those issues. Truly a community.”

What could compel all of these intelligent, fun-loving, and compassionate Data Champions to show up at DCS 2016 with smiles on their faces?

Maybe it was the sweet notebook and T-shirt swag? Or the spiffy buttons that you could proudly deck out your lanyards with? Or the breathtaking view of the San Francisco skyline above the Berkeley Marina waterfront?

DSC_0740 CbbJO7uW4AEjVk3

More likely, it was the shared bond of being with people who really got you, your passion for helping kids, and your hunger for data. Data Champions continually noted how refreshing and energizing [it was] to be at a conference so perfectly matched to what I do.” 

Tuesday, Feb. 16th, 2016 | Welcome Reception with Trivia 

With Data Champions arriving from all parts of the country, there was no rest for the weary as DCS 2016 kicked off with brain-boggling trivia questions and enviable prizes (everything from color-changing coffee mugs to gift certificates).

When I arrived on Tuesday, I immediately felt like I was an integral part of something.”

Wednesday, Feb. 17th (Part 1) | Let the learning begin!

DSC_0076Wednesday morning, everyone arrived bright-eyed and ready to enhance their technical skills, develop professional leadership skills, or take a deep dive into particular data domains.

“It was such a fantastic opportunity to catch up on technical skills, think about some of the bigger questions, and connect with and be inspired by other folks and the work that they’re doing as well!”

Check out Wednesday’s session highlights and resources on the Hub!

Wed., Feb. 17th (Part 2) | Data Block Party!

After a day jam-packed with thought-provoking sessions and insightful discussions, it was time to unwind at the Data Block Party!

Wednesday evening shenanigans included:

  • High-tension Jenga showdowns
  • Intense corn hole rivalries
  • Fabulous prizes (FitBit, OpenTable certificates, and Beats headphones!)
  • And, to keep students at the core of why we do the critical work we do, an amazing performance from the Oakland East-side All Star Ensemble, a local student band from Oakland Tech High School!

DSC_0031edit  DSC_0040edit

Thurs., Feb. 18th | Sending off our Data Champions with new tools and insights on using data to change students’ lives

Thursday morning, we were back at it, pushing each other to answer hard questions and develop new ways of looking at shared challenges.

Thursday’s sessions and resources are shared on our community Hub. A few highlights below:

As a scientist by training, I found myself being drawn to the science-fair-like sight of all these Data-Driven Educators and Data Bosses collaborating and sharing dashboard best practices at the Data Champion Reports Showcase!

Looking back, how did DCS 2016 achieve its goals of helping attendees Connect, Develop, & Take Action?

 

Connect
DSC_0999“I really value the collaborative aspect of the Data Champions Summit. I love to connect with folks doing similar work and talk about similar challenges and potential solutions.”

Develop
“I walked away with more advanced knowledge of Tableau, troubleshot a couple critical issues we’ve been experiencing with a few of your Schoolzilla folk, met at least three folks I’ll be following-up with, and just generally had a great time.”

Take Action
“The energy, enthusiasm, and ideas for using data to make better schools was just what I needed to help craft a plan for our district that will endure.” 

See everyone next year!

DCS brings our community of Data Champions together to have critical data conversations about how we can most effectively leverage data to change student lives. “Data is not the answer. It’s a hint, a way to start the conversation.”

Strengthened by our diverse experiences, perspectives, geographies, and school system contexts, it’s evident that we are Better Together as a community.

fe707f16-5656-4783-adf6-bfb2c6ebb3de

Product Spotlight: Chronic Absence Dashboards

“Across all grades, students who missed more than 4 days at the beginning of the school year were over 16 times as likely to be chronically absent than students who were absent fewer than 2 days.” (Olson, 2014)

“Nationally, children from families with low socioeconomic status with strong attendance gained more literacy skills than peers from families with higher socioeconomic status.” (Ready, 2010)

———————

While working with a school in CA, we heard a need from principals to better track chronically absent students. Therefore, we created the Chronic Absence Dashboards as a tool for school leaders to dive even deeper into their attendance data to visualize which students are most chronically absent and at-risk, carefully assess their interventions, and take action in contacting parents.

 “[Schoolzilla] recently gave me the world’s best custom chronic absence report and my principal loves it. The report inspired the idea of specifically tracking consecutive absences.

What problem was the district trying to solve with their Chronic Absence Dashboards?

  • A better way to track student absences: Principals wanted to better understand which students were missing school, how many days they were missing, and whether there was a pattern to their absences.
  • An easier way to analyze chronic absence data, connect with parents, and see if their interventions are working: Principals were noticing an increase in the number of students who are absent from class, but were having trouble assessing: who the students were, how many days they were missing, and whether they were missing the same day every week or month.
  • A more concrete way for school leaders to share information: Principals needed a way to visualize chronic student absences so they could inform their superintendent about which students were at the greatest risk and present their plan of action to correct the problem.

Standout Features:

View students* by attendance rate: View count and list of students who were absent within the last month, and which students were absent X (e.g. 2, 4, 10) or more days within the past two months, etc. 

Chronic Absence Report
View attendance by day: The calendar view shows if there is consistency in student absences. Are students missing the same day every week or month, or the days before a holiday and/or weekend?Attendance by Day
View Recent Attendance: From the “Recent Attendance” column, principals can see if the interventions they’ve implemented are working. Has chronic absence status decreased since they intervened? Or do they need to take further action?

Student by Attendance Rate

Contact Students’ Parent/Guardian: After analyzing the dashboards principals can immediately intervene with their chronically absent students by sending a letter home, phoning students’ parent/guardian, or scheduling an in-person meeting. By clicking on the students’ names, principals can see all of their contact information including parents’ names, phone numbers, and email addresses.

Student Contact Info

Looking for more information about Chronic Absence? Join us on Wednesday, March 9th for a webinar hosted by Schoolzilla’s own Jason Dolan and Bryn Murray. Click here to register today!

* Please note, information presented is not reflective of actual student data.

Additional Dashboards to See How Chronic Absence is Affecting Your Schools

Schoolzilla’s dashboards offer many different views of chronic absence data, enabling you to dig even deeper to see the root causes of absences and create more effective interventions. Click here to sign up for more information.

attendance

DCS Session Preview: Assessments as a powerful professional learning tool for teachers

With Schoolzilla’s Data Champion Summit just a week away, we’re gearing up for an amazing conference packed with robust professional learning and networking opportunities. To deliver the most relevant and impactful sessions, Schoolzilla has teamed up with other experts in the field to provide deep dives into specific domains of school data and management. Here’s a sneak peak at one of our featured sessions from the experts at Achievement Network (ANet).


Do you want to transform your data meetings into powerful professional learning opportunities for teachers? Do you want to help teachers see assessments and data as tools to help them build their own understanding of the standards and reflect on their teaching practice?

Tests are designed to measure what students have learned, but they can also be  a powerful learning tool for teachers and leaders, in which they can deepen their understanding of the standards and reflect on their instruction. In their session titled, Flipping the way we think about assessments: Assessments as a powerful professional learning tool for teachers, ANet will help Data Champions uncover connections between assessments, standards, and instruction.

This session will focus on one purpose of assessments and data that can often be overlooked: their ability to help teachers deepen their own understanding of the standards and reflect on their own teaching.

 

Dual purpose

At the Data Champion Summit 2016, ANet will provide attendees with the opportunity to learn more about using assessments more effectively to impact learning not only for students, but for teachers, too. Please join us on Thursday, February 18th from 1:30—2:45pm and discover how you can learn the most from your assessments!

If you aren’t able to attend the Data Champion Summit (or even if you’re already registered) and want to get a jumpstart on learning more, Schoolzilla’s Formative Assessment dashboards are a great place to start!

 

Meet Your Presenters:

  • Carlon Myrick, Director of New Partnerships with Achievement Network, former instructional leader, and ANet coach
  • Tim Suba, Director of New Partnerships with Achievement Network, former instructional leader, and ANet coach

More About ANet: Achievement Network (ANet) is an edu­ca­tion non­profit that helps schools boost student learn­ing with great teach­ing that’s grounded in stan­dards, informed by data, and built on the suc­cess­ful prac­tices of edu­ca­tors around the coun­try.

 

2015 Year in Review (Infographic)

Happy New Year! Before we dive right into 2016, we wanted to take a look back and reflect on 2015’s highlights. Here are some fun numbers from 2015!

Schoolzilla_Infographic

We can’t wait to see where this year takes us. Happy 2016!

Using Data Conversations to Accelerate Impact and Improve Outcomes

Sometimes people look at data alone, but often educators and school leaders engage with data as part of a “data conversation” with one or more teammates working together to unpack what the data means and decide what to do about it. By facilitating conversations about data, school leaders can foster an environment where educators are exploring the data, gaining deeper understanding about what it means and why it’s important, and building an instant interconnectedness amongst school leaders, teachers, and their data.

In this blog post (which first appeared on the Getting Smart blog), Schoolzilla Vice President of Impact and People, Leo Bialis-White, PhD, shares how educators and school leaders can foster a culture that is receptive to data conversations.


Schoolzilla-feat-964x670Data provides hints, not answers. But when brought together with context and conversation, data can become actionable insights that translate into powerful changes for students.

Numbers and scores provide little insight unless there’s a strategy for analyzing the data, a means for sharing it among the right colleagues, and a system for making informed decisions for change. Sometimes people look at data alone, but often educators and school leaders engage with data as part of a “data conversation” with one or more teammates working together to unpack what the data means and decide what to do about it.

As an educator or school leader, how can you foster a culture that is receptive to data conversations? How can you facilitate better conversations around data? How can you use tools and resources for greater impact? In short, what makes data meaningful and actionable?

Creating a data-friendly culture.

“The key to creating positive, data-driven cultural change in your school is to build love and trust around data. Teachers have to know that you’re there to help them get better.”
— Doug Rawlins, Principal, Panhandle Elementary School, From Schoolzilla Case Study

Analyzing data and effectively using it to make informed decisions takes teamwork, consistent and open communication with teachers and students, and a deep understanding of how to use data, when, and why.

Imagine for a moment that you’re responsible for assessing your district’s data. Every week you spend hours and hours creating reports to show each student’s progress and challenges. You know how important the information is, how useful it can be for impacting student achievement, but no one is looking at your reports. No one is analyzing the information or using it to make decisions. Should you continue to exert effort if it’s not doing anything productive for kids? What other levers can you pull for change?

Many educators have access to data insights, information and reports that provide them with detailed information about their students, but as shown in the example, not everyone knows what do with their data. What prompts educators to use data? For some, the answer is simple: “I need it and depend on it”. These educators spend hours working in spreadsheets trying to make the most data-driven decisions possible. For others, it’s because “My principal wants to see it”, or “Our school had a data day”, or even “My school’s data coach walked me through it”. While the answers vary, each encompasses the same underlying theme: I look at data because I need to make decisions with colleagues.
Schoolzilla-banner-1As district administrators, part of developing a data-driven culture is engaging your teams in the data, so that your reports aren’t just theoretically valuable, but are authentically used. By facilitating conversations about data, you’re fostering an environment where educators are exploring the data, gaining deeper understanding about what it means and why it’s important, and building an instant interconnectedness amongst school leaders, teachers, and their data.

Levers to drive data conversations.

“Now that [the data] is there and it’s available for everyone, [teachers] are able to really dive in and not spend time analyzing, but spend time interpreting and using data to plan. We had much more meaningful conversations in the very beginning part of the year because the data was so readily available.”
— Jan Faraguna, Director of Analytics, Rocketship Education, From Schoolzilla Case Study

Technology has the potential to provide a platform for making data conversations a seamless part of everyday activities. Educators are enabled with data that is visible, accurate, explorable, complete, and timely. The capability to share data among district leaders and teachers creates a forum for discussion. Educators can write notes about what they see, synthesizing the information, generating feedback, and developing a strategic plan to take action.Schoolzilla-banner-3Developing a collaborative environment where school leaders can openly discuss their data cultivates deeper relationships amongst colleagues and builds understanding about why decisions are being made, as well as an educator’s value in contributing to the solution and willingness to change practice for formative improvement. Here are strategies I have learned from working with schools at Schoolzilla that you can use to fuel data conversations:

  • Data Kudos: Create a system to congratulate colleagues in your district about a data success; this encourages them to feel successful while gaining buy-in from your educators.
  • Data Reflections: Encourage educators to consistently reflect on their data, so they understand it, own it, and act on it. One technique is to schedule meetings with your teachers or school leaders, sending out questions ahead of time, so they can reflect on what the data is telling them and set goals for the next quarter.
  • Data Inbox: Share key pieces of data with your stakeholders. If there’s a report that is crucial to educators, share it with them, whether it’s through email, school mail, or even on a bulletin board in the staff lounge.
  • Create a Shared Language: Infuse data into your everyday conversations to help educators understand data as the missing piece of the puzzle. Encourage educators to look for evidence, corroboration, and triangulation by answering these key questions:
    • “What did I see?”
    • “What data support or refute that observation?”
    • “What’s my hypothesis of why that occurred?”
  • Plug into a Network: Some people who are trying to champion data at their school are isolated. They don’t have anyone to discuss what’s working, what’s not, and what they could be doing differently. Connect with other data-driven leaders by starting a Professional Learning Community, or PLC, within your school to focus on data reflection and action.

There are many resources to help connect data-minded educators to share and solve problems collaboratively. Schoolzilla’s Data Champion Summit empowers data champions to connect, build relevant, timely skills that can be leveraged immediately to address current challenges, and take action. Data Champion Summit offers a unique opportunity to help schools engage with their teams by helping those teams have great data conversations.

Making your data conversations actionable.

“Once [data] is easy to see, it’s easy to know, and do something about it.”
— Richard Bowman, Chief Information and Strategy Officer, Santa Fe Public Schools

In a recent case study, Chris Haid explored how data helped reduce summer learning loss at KIPP Chicago. After administering the fall assessment, Haid reflected on his data and saw that third grade students had fallen into the summer reading slump. For the administration of KIPP Chicago, it did not seem plausible that students would regress in their studies with only six to eight weeks off for summer break. But the data was conclusive—there was a definite loss. This data prompted his team to take a closer look at how they were structuring class time after the year-end spring assessment.  Acting on the data, they made the decision to place extra emphasis on delivering more purposeful, objective-driven teaching following the spring assessment; and ensured that teachers were instructionally ready from day one with all operational systems up and running so they could dive right into purposeful teaching and counter the effects of summer learning loss. The results of these data-driven decisions were both powerful and tangible for KIPP Chicago, “We saw less summer loss this year, nearly none in almost every class.” Haid said.
Schoolzilla-banner-2It’s not about the data, it’s what you decide to do with it. There are key steps to getting your district data-ready. The combination of strong data tools and fostering a robust data culture results in data conversations, and ultimately action leading to positive change for students.

Leo Bialis-White, PhD is the Vice President of Impact and People at Schoolzilla, PBC. Follow Schoolzilla on Twitter @Schoolzilla.

Flip Your Thinking About Assessments

3571102858_2e511c605f_oWhat can you learn from a test before seeing your results? That’s the question that ANet founder John Maycock challenges educators to think about in this recent post. Don’t get us wrong, as a data company, we believe in the power of measurable outcomes. But it’s important for all of us to remember that the purpose of tests isn’t to produce test scores, it’s to validate the difficult and nuanced work of teachers and students prior to the test.

Toward that end, Maycock suggests that teachers take the same assessments that they administer to their students—not to measure their outcomes, but to more intimately understand what the assessments are actually testing. By doing so, teachers may be able to advance their own understanding of certain standards and make better instructional decisions for their students.
Read on to learn what else you can do to “flip” your thinking about assessments.

5 strategies to make your school system more “data-ready”

rep370180_349066_1423610272039-845x684For the last two years, I’ve been a data engineer at Schoolzilla, and currently spend my days helping to define the technical vision for our achievement products.  Prior to joining the team here, I worked in Research and Evaluation at the KIPP Foundation across the Bay in San Francisco, supporting KIPP schools around the country to turn data into insight, and insight into action.  My experiences at both KIPP and Schoolzilla have  led me to think a lot about how school systems can get the most out of their work with data.  Here are my top tips for school systems looking to become more “data-ready”.

1. Start with goals.
Data is a means to an end, not an end in itself. Your school or district won’t get much out of stronger data practices if it isn’t already goal-driven. Do your teachers, parents, and students have a growth mindset? Are SMART goals being set on a regular basis organization wide.

2. Lead with questions, not metrics.
“Are our students climbing the mountain to and through college?” It’s far easier to hook someone with a question that they care about than by showing them a table or chart that reports a metric. That was a key learning that led to the formulation of KIPP’s Six Essential Questions.

If you ask a good question, then you’ll likely have someone asking you for the data to answer that question. If you start with a bag of metrics, you probably see eyes glaze over. Also, a thoughtful, mission-driven question will outlast a well-designed metric. Metrics may change as the specific thing to measure—or the best way to measure it—evolves as you make progress towards that overarching goal.

3. Think about the data you wish you had, rather than the data you already have.
Just because you have data on a particular dimension, doesn’t mean rep370180_349066_1423609909558-845x684it should be integrated or presented. As an example, data that has very little variability across classrooms or over time isn’t going to be very useful. You may not be able to easily collect or measure the data that would be ideal for your organization, but it’s important to have a clear vision of what that would look like so that you can always be moving toward it.

4. Invest in systems that play nice.
Some companies build walled gardens; others make it easy to get your data out. If you want to get the most of your data, you’ll need to have a scalable, automated way to get it out of systems.

  • Are external student IDs a part of the exports or does the vendor only include a unique student identifier that is used in that product?
  • Do the data exports include everything you care about or do they only contain a small subset of the data in the system?
  • Are they structured and formatted in a way that will be easy to use?
  • Does the product have a CSV export? What about an API or an automated file drop?

5. Start narrow in terms of audience and scope.
The dream is all your data in one place, presented in a way that is perfectly tailored to each stakeholder. The reality is that it’s close to impossible to accomplish that all at once and the path to the “data-driven dream” is smoother if you start by serving a particular audience especially well. Further, you’ll learn things along the way that will move the goalposts anyway. Time is our most important resource and it’s better to cater to one group of stakeholders really well, than all stakeholders somewhat poorly. It’s better to really nail the collection, organization, presentation and use of one domain of data when you’re starting out, rather than trying to shoot the moon.

Q&A with Caroline Galindo: What you need to know about this year’s Data Champion Summit!

IMG_6728-180x180

Caroline Galindo Impact Team Lead, Schoolzilla

In less than two months, Data Champions nationwide will join us in Berkeley, CA for this year’s Data Champion Summit. What makes this the perfect opportunity for K-12 data enthusiasts, and how does this year’s summit differ from last years? Caroline Galindo, Impact Team Lead for Schoolzilla, shares all the important details.

Q: What is a Data Champion and what makes a great one?
A: Data Champions are the people in school systems who collect data; make sure data is clean; cull insight from data; and share that insight with the appropriate stakeholders. Any of those pieces can be a huge job—it’s why Schoolzilla exists, and it’s why Data Champions rarely work alone.

Great Data Champions work hard to stay focused on their stakeholders’ needs, and by extension, their students. They understand that strong relationships are just as important as their technical and number skills—they’re what helps them understand stakeholders’ goals and questions. It takes an incredibly wide range of skills to be a great Data Champion, and we are constantly inspired by the folks in our community.

Q: The theme of this year’s Data Champion Summit is “Better Together”. Can you share what this theme means to Schoolzilla and for attendees?
A: “Better Together” is one of Schoolzilla’s core values. We know we can achieve greater success when working together; that’s why we’re committed to collaborating within teams, across teams, and with school systems.

“Better Together” also reflects what we’ve learned over time from our great Data Championsthat culling actionable, transformative insights from data is a system-wide effort. Data evolves when Data Champions, CAOs, Grade Level Leads, Superintendents, etc., work together to have data-informed conversations based on a deep understanding of how people work, as well as their questions, priorities, and goals.

Data Champion Summit ‘16 provides the opportunity for Data Champions to collaborate, learn new skills, and gather resources to foster a data-driven culture.

Q: For returning Data Champion Summit attendees, what new sessions are available that weren’t offered last year?
A: We’ve been working hard to develop new content for this year’s Data Champion Summit. Our New Tableau sessions teach folks everything they need to know about Tableau 9. Our Product sessions include Interventions Data Block and Zillametrics (neither existed last year!). And in the spirit of Better Together, we’ve also added a Leadership strand specifically designed with system influencers in mind, as well as a Deep Dives strand around specific content areas to help answer the key question: “I have all this data and insight, but now what?”.

Q: What excites you most about the 2016 Data Champion Summit?
A: Rarely do we have the opportunity to have all of our Data Champions in one place. With a vast network of Data Champions and leaders at this year’s DSC, we’re thrilled about the opportunity to facilitate connections. We also have quite a few former Data Champions at Schoolzilla, and it’s been really fun to create a conference that our former (and current!) selves would love. We can’t wait to hear about what you think of this year’s Data Champion Summit (and if you’re not registered, there’s still time, just click here).

 

Talking to Parents About Data – Continuing the Conversation

On Monday, October 25, 2015, Schoolzilla’s VP of Impact, Dr. Leo Bialis White, hosted a webinar, Talking to Parents About Data, featuring Arleta Lopez, Assistant Principal at Clemente Charter School in Maywood, CA, and Dr. Sarah Wheeler, school psychologist in Piedmont Unified School District.  You can download an audio recording of the webinar, or check out selected bits of the conversation below:

Leo Bialis-White: To start with the basics, why is it important to share data with parents?

Sarah Wheeler: One of the things I try to remind myself is that parents know a lot less about what goes on during the school day than we think.  There’s so many things, often really positive things that we do and that their students accomplish that they just don’t know about. Data can be a good way to make sure that they’re staying informed.  And then the other piece too is that parents only have their children, so that’s their view.  It can help– especially when you present it in the right way– to show parents how their child is doing in comparison to big samples of children or to other children in the school.  

Because often, parents really have a hard time– they know where their child is, but they don’t know what that means developmentally, or if that’s what the expectation is, so they need to see that in comparison to other children.

Leo: Which data is most important?  Which data do parents really need to have and why is that?

Arleta Lopez: I think the data that parents really need to have is the data that shows them where their child needs improvement or support.  That’s the number one question, how is my child doing? Where can I help him or her?  Parents get happy obviously, to see where their child doing well, whether they have strengths in reading, writing, math or whatever it may be.  But the number one question that I get is where does my child need help.

Sarah: I would add too, just progress data, data over time, is really huge for parents to see, whether it’s showing successful progress or a child that’s not making progress.  Whether it’s academics, if it’s coming up to school on time, whatever it is.  Showing them that data over time and then connecting that to interventions or changes in what’s happened is really helpful. It’s helpful to show a parent, you know, your child was absent five times last month but only one time this month, and so the changes that you’ve been doing to get them up early, that’s making a difference. That really connects things to what they do and their impact.

Leo: Sarah, I’ve heard you say a couple of things around giving people context, how they’re doing in comparison to other students, how they’re doing relative to the past.  It feels like giving the numbers some meaning is really important?

Sarah: When you’re doing something like presenting to the parents of a student with special needs, there are dozens of data points.  So I think about what is the story that I want to tell parents with that data, and then select key data points that help illustrate that story.  I want them to walk away from this meeting understanding that the reading interventions we’ve done with their student have really made a difference and now we want to do the same thing with math, so how do I show them the data on their child that supports that story?  Cause otherwise, it’s just numbers…

I like to call out that it can be uncomfortable to talk about a child in terms of numbers, that some of it is confusing for me, that some of the things that I show them are things that help me understand the data, and that’s why I use them, like charts and visuals.  I try to normalize that it can feel kind of strange to hear your kid talked about like this. We’re always looking at the whole picture of a child, and here is some information that is not the whole story, but adds a little piece. So again, helping them contextualize that the data isn’t everything, but it’s an important piece, and we’ll talk about what else we know about the child that helps us understand the data in a bigger context.

To listen to the rest of Monday’s conversation, download the recording here.

Talking to Parents About Data

By this point in the school year, schools have lots of data that can support student learning, from formative assessments to newly released PARCC and SBAC results to grades, attendance and behavior data.  Fall parent-teacher conferences present an opportunity to share and discuss these data with the people who know students best–their parents.  Unfortunately, parents and teachers alike at times find these meetings frustrating, shallow, and overly focused on what’s not going well.  

From my time working as a school psychologist and from interviewing educators in the Schoolzilla community, we’ve compiled the following tips to help make your conversations with parents about data achieve their transformative potential, fostering stronger relationships with parents and jumpstarting progress for their students.

  1. Make sure the conversation flows two ways. While parents might not be collecting data about their child in the same ways schools do, they have critically important knowledge about who their child is and has been and how he or she experiences and interacts with the world outside of school.  While this information may never appear in a student profile report, it will be critical in supporting your students to reach their potential. Provide a venue for parents to share it!
  2. Start with strengths. Whenever meeting with parents about their child, it’s likely you’ll have information to share about both strengths and challenges. Starting with strengths helps parents to understand that you see what’s great about their child and that you have high expectations for his or her success.  You can use data to show progress and growth against learning objectives, even when those objectives haven’t yet been met. Often, the most effective interventions come from leveraging strengths to bolster areas of improvement.
  3. Profiles of students are always better than a single data point.  There are many types of data that support student learning and success– it’s about so much more than test scores!  Wherever possible, using a student profile that includes multiple types of data, including for example, data about attendance, behavior, grades, participation and more, will allow parents to get a more comprehensive sense of how their child is experiencing school.
  4. Explain what tests are meant to capture. When discussing test scores, provide the context of what that specific test is designed to measure.  For example, when presenting the results of formative assessments, describe how the test results are used to check students’ understanding and plan further instruction, and shouldn’t be interpreted as a measure of innate ability or as the final word on a student’s mastery of a given subject.
  5. Foster basic assessment literacy.  Assessment score reports can be very difficult to interpret if you’re not used to looking at them.  Make sure that parents understand what is meant by percentiles and how to interpret raw vs. scaled scores if that’s relevant to the results you’re showing them.  Even more important, put the scores in context for their student specifically– what growth is in evidence? What do the results show about what the student should focus on going forward?

To further explore this topic, Schoolzilla hosted a webinar on this topic with some folks who are approaching it in in new ways. 

Featuring:

  • Norma Moreno, Principal, Clemente Charter School, Ingenium Schools
  • Dr. Sarah Wheeler, School Psychologist, Piedmont Unified School District

Listen to the recording of the webinar here.

Dr. Leo Bialis-White is Schoolzilla’s Vice President of Impact.  He has a PhD in School Psychology from the University of California at Berkeley.

Schoolzilla welcomes St. Louis Public Schools!

SLPS black and whiteIn September 2015, Schoolzilla was honored to welcome St. Louis Public Schools (SLPS) into our customer community.  We’ll be working with SLPS to implement a “one-stop-shop” KPI dashboard aligned to the district’s Transformation Plan.

By combining data from dozens of disparate sources into a live, flexible dashboard, Schoolzilla will enable SLPS to monitor its most critical inputs and outputs, celebrate and expand on successes, and quickly identify and address challenges on the road to ensuring a world-class education for all of its 25,000 students.

Under the leadership of Superintendent Dr. Kelvin Adams, SLPS is undergoing a period of historic change.

The district’s comprehensive Transformation Plan— which includes a move to a portfolio management model, as well as S.M.A.R.T goals for everything from day-to-day operations to student reading growth to staff support and retention– creates a direct alignment between district level work and individual student outcomes, focusing efforts across the district on the most strategic levers for improvement.

In order to align, monitor, and support administrators’ and educators’ work to put the Transformation Plan into action, SLPS knew they needed an easy-to-use, centralized dashboard.

SLPS mockup

They call this dashboard the “Excellent Schools Transformation Tool”, or ESTT:

“The ESTT is designed to give us live data throughout the school year to monitor progress and course correct with more conviction and specificity. This tool will be used to analyze the effectiveness of our district offices and ultimately the performance of our schools—holding us all equally responsible for providing a world-class school choice for our students.”

After a competitive RFP process, St. Louis Public Schools selected Schoolzilla, PBC as the partner to develop and maintain the ESTT. We couldn’t be more excited, or honored, to serve SLPS, their staff, students, and community.

Deputy Superintendent of Academics David Hardy said of the partnership: “We are absolutely thrilled to have Schoolzilla as a partner in our district’s transformation.  Their commitment to making sure we have the information necessary to make sustainable change for our kids is not only powerful but inspiring.  Not every partner operates the way Schoolzilla does and I wish more would!”

To test drive dashboards inspired by our partnership with St. Louis Public Schools, sign up for access to our dashboard library, and check out the “District Profile” reports.

Stopping the School-to-Prison Pipeline with Reclaiming Futures

Reclaiming Futures Logo with La Jolla Tag

Based at Portland State University, Reclaiming Futures is a national organization whose work focuses on improving juvenile justice through research-based interventions. As they broaden their impact to include working directly within K-12 school systems, they are partnering with Schoolzilla to develop a suite of research-based, interactive dashboards designed to support the needs of students who are at risk for becoming involved in the juvenile justice system. Each dashboard is designed for a particular stakeholder in students’ school lives, including teachers, counselors, principals, and other support staff.

Below is a conversation that Schoolzilla Senior Impact Manager Adam Rosenzweig had with Reclaiming Future’s Executive Director, Evan Elkin.

AR: What’s the goal of Reclaiming Futures?

EE: Reclaiming Futures operates at the intersection of public health and social justice. Our overarching goal is to help youth-serving systems, like the juvenile justice, education, and child welfare systems, improve behavioral health outcomes and achieve greater equity for youth. 

AR: Say more about equity.

EE: When we say equity, we mean fair and equal treatment in the system and also equal access to health and well-being. We work within systems where the playing field is not level for youth of color and where there are significant negative collateral consequences associated with structural racism, and we’ve recently sharpened our focus on strategies to address these racial and ethnic disparities in the systems where we work.

AR: What is Reclaiming Futures really good at?

EE: Our strategy – and, I think, our greatest impact in the jurisdictions where we work – is to bring about cross-system and cross-silo collaboration. In the places we work, we ask our sites to form leadership teams comprised of key decision makers from across a range of professional disciplines, representing key agencies and systems (like judges, probation chiefs, treatment clinic directors, etc.), and then we coach, support, educate, inspire, and otherwise cajole them into reaching consensus on a set of tangible and achievable reform goals.

Those site-based interdisciplinary groups are then invited to interact with the individuals and groups from other sites across the country in what we call our “learning collaborative.”  What has emerged from this strategy is a peer community, which we have intentionally constructed to disseminate and support the work – the mission and also the practical hands-on aspects of the work. It’s quite effective as a catalyst.

AR: Why were you interested in pursuing this partnership with Schoolzilla?

EE: Recently, we started working to adapt our approach for a school setting, and we’ve created a comprehensive school reform framework that addresses school discipline, school climate, and behavioral health.

These are complex and interrelated domains that require schools to take a critical lens to their work in order to achieve and sustain tangible outcomes. The data we invite schools to look at will be quite challenging. To support this work, our sites will need a continuous data-driven feedback loop.

We chose Schoolzilla because of how in touch they are with the school experience on the ground and, honestly, because of the elegance and power of the dashboards. We knew we needed user-friendly, intuitive, and smart dashboards to achieve success with this project.

AR: What would you like educators to know about student discipline as they begin the new school year?

EE: I think the tricky thing about school discipline is appreciating the complexity of thechallenge schools face in re-engineering their approach – particularly in schools with significant behavioral challenges where, most days, teachers may be just trying to keep the peace long enough to get some teaching done.

We know there is no quick fix, but we believe that attention to the root causes of misbehavior, greater mindfulness about the impact of the discipline decisions we make on the most vulnerable students, and a culture shift toward a more tolerant and inclusive approach will pay huge dividends for our schools.

AR: To help our community better understand your work, would you describe one of Reclaiming Futures’ other recent partnerships or projects?

EE: We’ve recently entered into a partnership with the W. Haywood Burns Institute and another national group based in Oakland called Impact Justice to develop a new framework and a data-centered strategy for behavioral health practitioners and their justice system partners to examine the key decision points around substance use and mental health treatment where racial bias can be introduced. We’re really excited about this project because it’s another opportunity to do work that is data driven and also critically important to the well-being of vulnerable youth.


 

We’re excited about this partnership because of its potential to advance the use of data to improve outcomes for some of the most vulnerable students in our schools. If you would like to learn more about this work, or if you have suggestions for partnerships that Schoolzilla should pursue, please contact us at partners@schoolzilla.com. To explore some of Schoolzilla’s current behavior dashboards, click here.

3 Ways To More User-Friendly Data

We recently sat down with designer Mayra Vega to her get advice on creating data dashboards that people will actually use.

She told us that getting people to use the reports you create starts with reorienting your concept of user needs from nouns to verbs.

Thinking of a need as a noun fast-tracks your thinking straight to what you will build for your user, often skipping over crucial considerations about what you are trying to help the user do in the first place.

In conceptualizing needs as verbs, you will consider how a user’s needs will be met by taking user experience into consideration. This approach will also surface deeper insights into what your user is trying to accomplish with your report.

Use the Needs Madlib below as a guide for thinking of needs as verbs.

madlib_best

Dig deeper into user needs with one of the three user research approaches below.

1. Watch  

Observing your users as they navigate a report gives you a lens into where the obstacles they face exist and how your report can best fit their mental model or existing process. It may seem simpler to just ask users where they are having trouble, but Mayra says that there is more to gain from asking users to show as well as tell.

“Oftentimes what they say is not exactly what they’re doing, and when you’re watching what they’re doing, you’re learning a lot about the places where they get tripped up.”

Key questions to keep in mind: What is the user doing? How is that helpful for the user? Why?

Below is a picture of a parent-teacher conference that we took from one of our observations when we wanted to create a report for parent-teacher conferences. We learned from this observation that teachers prefer to print out paper copies of the report for parents to look at during the meeting. Since most teachers print their materials in black and white, not color, we decided to grayscale this report to make it printer friendly.

2. Ask

Merely watching your users in action is not enough. Asking “why” during your observation and interviewing them about their process afterward are integral steps for understanding their experience.

A few things to keep in mind when interviewing…

  • Don’t ask them to solve the problem.
  • Practice lots of listening. The best interviewers listen more than they speak.
  • Don’t ask binary questions. Instead say, “Tell me about a time when…”
  • Keep digging deeper by asking why.
  • Don’t ask only “yes” or “no” questions. Open-ended questions will yield more useful insights.
  • Keep questions short and simple: only ten words to a question and one question at a time.
  • Interviewing in pairs will enable you to make sure you capture the most insights. Have someone take notes while you pose questions.

3. Do

Try using the report that you have created as your intended users would, with their needs in mind.

“You really want to put yourself in your users’ shoes and understand and gain empathy for the things that they do,” Mayra says, adding, “When you gain that empathy, you start noticing areas that you can help them with.”

If you were going to create a report for a board of directors, for example, you could read the board packet to get an idea of how much information they have to read through before going to a board meeting. This approach will give you an insight into the nature of the information board members are looking at, the difficulties they face in processing it, and how you can improve that experience with your report.

Mayra gave a presentation on this topic at our last Schoolzilla User Summit. Check out Mayra’s full presentation, where she goes into more depth and discusses the prototype and usability testing processes for making user-centered reports HERE.

More resources for making user-centered reports:

5 Data-Driven Tips to Tackle Summer Learning Loss

The pain of summer learning loss has long been felt by educators across the country, with research on it dating back over 100 years.1 At Schoolzilla, we wanted to understand how educators are using data to gain insight into summer learning loss and what strategies they use to combat it.

We recently sat down with Chris Haid of KIPP Chicago and Roberto Vargas of Chicago International Charter School (CICS) to see how data helped them mitigate summer learning loss at their schools. Here are some tips they shared:

  1. Conduct your fall assessments immediately

First, it’s important to get a clear picture of the loss. For this reason, Haid recommends conducting your fall tests as soon as possible. Changing the time tests are administered helped teachers at KIPP Chicago get a better picture of where students were in the fall.

“We do the fall test sooner now — in the first or second week of school — to see what’s going on, but as far as instructional planning, we rely on the spring test [from the previous year],” Haid said.

  1. Use data to inform resourcing conversations

Vargas used NWEA MAP data to create a summer learning loss dashboard for CICS that illustrated the amount of loss and which subjects it occurred in.

The dashboard gives teachers a clearer view of where students are at the end of the summer and where they should be to get back on track for the school year. It uses students’ current RIT score as well as their target growth and target RIT score. Vargas explained that, with this dashboard, teachers have been able to group students whose test scores declined and create more effective teaching strategies for those students.

“Our staff will look at it and break the data down and say, ‘What’s going on in third grade that reading is so low? How can we get more resources into the third-grade classrooms to help them improve those scores?’”

Haid agreed that having visuals that clearly demonstrate the summer learning loss problem is key. “Having some really telling visuals drove all of our school leaders and regional team to the same conclusions and helped us focus our energies on what we could do, rather than if we had a problem or not.”

We’ve added a version of Vargas’s summer learning loss report to our NWEA MAP analytics suite. Click here to test drive the report!

summer loss report

  1. Take full advantage of the time after spring assessments

For the administration of KIPP Chicago, it did not seem plausible that students would regress in their studies with only six to eight weeks off for summer break. But the data was conclusive — there was a definite loss.

This data prompted educators to take a look at how they were structuring class time after the year-end spring assessment. School leaders realized that if purposeful teaching dropped off after the spring assessment, students would be less engaged during the final weeks of school, essentially extending their summer break. So extra emphasis was put on more purposeful, objective-driven teaching following the spring assessment.

  1. Plan for absolute operational readiness on day one

The operations team at KIPP Chicago asked themselves: “Are we instructionally ready from day one?” They saw that there was room for improvement, Haid said. So they put a greater focus on getting all operational systems up and running — with no delay when school doors opened — so that all tools were available for teachers to dive right into purposeful teaching and counter the effects of summer learning loss.

  1. Give teachers a window into summer activities

Vargas has since built out his dashboard to collect data on summer activities. Information on any summer programming students have taken part in, and on the curriculums they may have been exposed to, is now stored in the dashboard so that teachers have a sense of their students’ level of academic engagement during the break.

Data with an impact

The results of these data-driven decisions have been powerful and tangible for KIPP Chicago and CICS.

“We saw way less summer loss this year, nearly none in almost every class.” Haid said.

“We’ve seen a lot of improvement this year in some of our schools that were struggling last year; the report has been a big help,” Vargas said.

See the summer learning loss report! 

For those of you who have made it this far, here are some free online resources designed to help students stay sharp this summer:

edX courses offered by the nation’s top universities

Learn programming with Khan Academy

SAT practice

Math practice with TenMarks

 

http://www.whatkidscando.org/archives/whatslearned/WhatIfSummerLearning.pdf

CTA

Schoolzilla Gets a Fresh Face: Data Wall!

Schoolzilla’s powerful data warehouse and dashboard platform just got a makeover. Meet Data Wall, our new, more intuitive and visual interface.

The good news: Our data warehousing and visualization technology will continue to automatically pull all your data into one secure place and allow you to create customized data dashboards. The better news: Now you can more easily curate, navigate, and share your most important dashboards using Data Wall.

Click here to register for a demo account and test drive our dashboards!

Use Data Wall’s core features to:

  • Set clear and measurable priorities with Featured Reports. ​Mark certain reports as “featured” for your organization. These reports will show up at the top of every user’s Data Wall.

  • Allow users to personalize their experience with Favorite Reports. Any user can “favorite” the reports they find most useful to easily find them again.

  • Navigate your data with ease using Dashboard Collections. Group reports together by theme (e.g., Parent/Teacher Conference, Intervention Meetings, etc.) so that teachers, school leaders, and administrators can find the information they need when they need it.

  • Make dashboards actionable with Dashboard Descriptions. Now you can annotate visualizations to help users focus on the relevant trends in their data and think about what to do next.

Click here to register for a demo account and test drive our dashboards!

The Data Doctor Is IN

Do you work in a school district’s central office and have a spreadsheet headache you’d like help with? Schoolzilla has partnered with a funder to offer 25 complimentary 1-hour consultations where you can learn spreadsheet tools and tricks. Spend less time cleaning and organizing data and more time getting actionable insights.

Read more

Six Ways to Make Sense of Your Common Core Assessment Data

PARCC and SBAC analysis

As schools await their Common Core test results, educators, instructional leaders and data analysts across the country have been developing thoughtful ways to understand their first Smarter Balanced Assessment Consortium (SBAC) and Partnership for Assessment of Readiness for College and Careers (PARCC) data.

Schoolzilla reached out to some of these thought leaders to understand how they were planning to approach their Common Core data. This guide is based on the recommendations they shared for how schools can analyze, understand, and act on this new data

1. Define what a “good score” is.

In the first year of a new assessment, you can’t compare your data to historical results. How can you identify the bright spots and growth areas in your data without a baseline of comparison?

First, brace for a drop in proficiency.

States that have already implemented Common Core standards-aligned exams have found that student proficiency rates have dropped significantly. Most states are expecting similar performance declines on Smarter Balanced and PARCC tests due to more challenging content and more demanding test questions. Based on the cut scores Smarter Balanced approved last fall, only 33 percent of students are projected to reach the proficiency mark in 11th grade math.

This drop in proficiency means that it’s hard to interpret your scores.  Lower scores could mean less student learning; or, they could just reflect a change in the achievement measuring stick. But, in the absence of comparable historical results, there are other ways to put your data in context. You can find other points of comparison that help your families, teachers, and leaders see where your school is making progress.

Use norms.

District, state, and national norms can provide additional measuring sticks for schools. With 18 states administering Smarter Balanced and 11 states administering the PARCC tests, results will allow for more comparisons across states. Smarter Balanced released nationally normed data from its 2014 field test and is expected to do the same with the 2015 results. This data will allow analysts to visualize how their networks, districts, and schools performed relative to national averages.

Look to peers.

In addition to using national norms, instructional leaders told us they plan to compare their performance against high performing schools.

As Elise Darwish, Chief Academic Officer of Aspire Public Schools said, “The first thing I want to do is understand what ‘good’ schools’ data looks like with these new assessments. I’ll be looking at Aspire schools that have been strong in the past, so I can use their scores as a rough benchmark. I’ll also ask other school systems if they’ll share their results so we can compare.”

District_SBAC_Communications_Report

Compare to other exams. 

Analyzing Smarter Balanced and PARCC results alongside other summative assessment sources, such as NWEA MAP and historical results from previous state assessments, will create a more comprehensive, meaningful portrait of student performance.

 

parcc_scale_score

 

2. Go deeper.

In addition to snapshots of overall student performance by scale score and achievement level, schools want detailed performance reports to show strengths and weaknesses on particular areas of each test.

Both consortia will report overall scores, as well as performance levels on the particular claims/sub-claims that make up each test. Although data at the question level will not be available at first, claim-level data will help teachers and instructional leaders understand how students did on performance tasks and higher-level content assessed by the Smarter Balanced and PARCC tests.

Looking at claim- or standard-level data for your classrooms or schools is crucial  to making your data actionable. Comparing performance across claims can help you find educators who have best practices to share. It can also help set instructional priorities for the next year, instead of feeling like you’re conducting a post-mortem that’s all about last year’s scores.

Classroom_Snapshot_Claim-LEvel

3. Help families interpret their child’s results.

According to a recent survey conducted by the Public Policy Institute of California, a majority of public school families in California (55%) say they have heard nothing at all about the Smarter Balanced Assessment System. Only eight percent say they have heard a lot about the tests.

Teachers and data analysts we spoke to emphasized their desire to create reports that foster dialogue and help families make sense of their child’s scores on these new tests.  Denver Public Schools Parent/Student Portal Manager Juan Pablo Parodi explained: “We did a lot of user interviews with our parents and learned that assessment information is often meaningless to them because of the context in which they are presented with it.  We learned that in order for assessments to matter to parents, we needed to present the data in a simple, digestible way that allowed them to quickly grasp whether or not their student was on track, and could inform more constructive conversations with their students and teachers.”

4. Analyze achievement gaps.

One of the most striking findings from the SBAC field test data is the way that it continues to illuminate achievement gaps for students of color and low-income students. These gaps are not new, but it is striking to see them surface repeatedly and dramatically, especially in a wide, nationally representative sample. On the SBAC field test, for example, black fourth graders scored more than six-tenths of a standard deviation below the total group of fourth graders in math. Analyzing how Common Core results differ by race, income level, primary language, and special education classification can help you find and focus on the most critical achievement gaps in your student population.

5. Compare student achievement data with classroom observations.

Common Core standards are designed to encourage educators to make their classrooms more student-centered and their instruction more rigorous. As teaching practice expert Charlotte Danielson told Education Week, “[The Common Core] requires instructional strategies on teachers’ parts that enable students to explore concepts and discuss them with each other, to question and respectfully challenge classmates’ assertions.”

Your results will provide an opportunity to ask a related question: What student and teacher behaviors are present in  classrooms where students performed best on Common Core assessments?

Lander Arrieta, a consultant who worked with Duval County on its Common Core implementation, explained, “The first thing I’d want to do is visit classrooms where students scored well and see what those teachers are doing—are they leading student-centered classrooms and facilitating rigorous conversations between students?”

If your district uses a formal evaluation system, you may want reports that compare student results with teacher evaluations on specific instructional competencies.  With or without formal observations, walk-throughs with your “bright spot” teachers can help you think about what instructional strategies you want to help everyone on your team develop.

6. Analyze data from computer-adaptive testing.

Computer-adaptive testing creates a number of valuable metrics about a student’s test-taking experience that are unavailable through paper testing. For example, data that may become available from Smarter Balanced includes the time a student spends on a question, as well as the number of times the student changed an answer. Both consortia will also gather data about the types of accommodations available to students, as well as which assistive tools a student actually used during testing.

This data can add insight into each student’s test-taking process, informing an understanding of how the new testing format impacted results, and allowing educators access to evidence about students’ testing stamina and perseverance (or lack thereof) on more rigorous question types. Although this data will not be available initially, future analysis of statistics like testing duration, time per question, and assistive tool usage holds considerable promise for educators and education leaders.

We’d love to hear your thoughts, questions, and concerns about how you plan to analyze your Common Core results as well. Stay tuned for details on how to join the Data Champion Hub—our online community for K-12 data advocates to engage in discussions and share best practices.