ETLA

Tool Evaluation Rubric

Based on ISTE Coaching Standard 4.3  Β·  EdTech Leaders Alliance

πŸ‘‹ Getting Started β€” Coach's Guide

Review the how-to steps and conversation starters before your session, then dismiss when you're ready.

πŸ“‹ How to Use This Tool
πŸ’¬ Conversation Starters
1

Before the Conversation

  • Pick the tool the teacher is weighing
  • Share the rubric ahead of time
  • Ask the teacher what student outcome they're aiming for
  • Let the teacher know you'll each score on your own first
2

During the Conversation

  • Score quietly first, then share
  • Compare row by row, starting with the non-negotiables
  • Stop on any "β€” STOP β€”" row scored a 1 and decide what to do
  • Talk through any row where you scored differently
3

After the Conversation

  • Decide together: pilot, pass, or keep looking
  • If piloting, pick one class or small group first
  • Set a date to look at student work and revisit the score
  • Print the completed report to capture your decision
πŸ’‘ Tip: Once you dismiss this guide, a "Coach's Playbook" tab will appear on the right edge of the screen β€” tap it anytime during the evaluation to pull up conversation starters without losing your place.

Use these prompts to keep the conversation curious, not corrective. Read through them before you begin. You can also access these anytime during the evaluation via the Coach's Playbook button.

🀝  Open with Trust
"What student moment are you hoping this tool will help with?"
"Before we score, what's your gut take on it?"
πŸ”„  Pivot from Engagement to Learning
"If we watched a student use this for ten minutes, what would we hope to see them thinking about?"
"Does this tool help students think more critically, or does it just make the task easier to finish?"
πŸ”  Surface a Different Score Without Judgment
"I scored that one a 2 because of X. What pulled you to a 3?"
"Help me see what you're seeing on this row."
🎯  Make the Decision Real
"What would success look like in two weeks if we tried this?"
"What's one signal we'll watch for in student work?"
πŸ‘£  Name a Next Step
"What feels like the right first move for you β€” not the perfect one?"
"What support from me would make this a fair test?"

πŸ“‹ Evaluation Session Details

πŸ”’

Before using this rubric: This evaluation is designed for coaches and teachers to assess pedagogical fit. It assumes the tool has already been reviewed β€” or will be reviewed β€” by your tech team for safety, privacy, and interoperability. A tool should only proceed to this rubric after clearing those foundational checks.

Rubric Evaluation

0 of 6 scored

Evaluation Summary & Recommendation

Complete all 6 rows to generate a final score and adoption recommendation

β€”
out of 18

Score each row above to see the breakdown here.

Awaiting Scores
Complete the rubric to see your recommendation
Score all six rows above. The recommendation and next steps will appear here once complete.

πŸ”’ Tech Team Safety & Interoperability Rubric

These criteria are intended for your technology team. A tool should pass these checks before or alongside the coach/teacher evaluation.

All rows below are non-negotiable stop criteria. A score of 1 on any of these should be resolved with the vendor or disqualify the tool from further evaluation. Scores of 2 require a deliberate decision before moving forward.
Student Data Privacy
COPPA / CIPA / FERPA compliant Β· Clear data collection and sharing policy Β· Third-party logins (Google, Apple) handled safely Β· Parental consent if required
1
Privacy or AUP is unclear or has major concerns with student data.
β›” STOP β€” Do not proceed
2
Privacy policy covers basic security needs.
3
Privacy policy reflects best practice for student data safety.
Data Security in Transit
Run the URL through ssllabs.com Β· Review the SSL grade returned
1
Data is not safe in transit (grade D or F).
β›” STOP β€” Do not proceed
2
Data is protected, but the key exchange is weak (grade C).
3
Data is fully encrypted in transit (grade A or B).
Ads and Distractions
Are ads present? Β· Are ads static or do they change? Β· Do ads block valuable screen space? Β· Do students need to close ads to keep working?
1
Ads are not okay, intrusive, or unpredictable, and pull focus from learning.
β›” STOP β€” Do not proceed
2
Ads are static and predictable. They show in the app but don't fully block learning.
3
No advertisements at all.
Cost and In-App Purchases
Does the cost fit the budget? Β· Are there in-app purchases?
1
Cost is high and there are in-app purchases.
β›” STOP β€” Do not proceed
2
Free or fits the budget, but has in-app purchases.
3
Free or fits the budget, with no in-app purchases.
Age-Appropriate Content
Content is high quality Β· Content fits the grade level Β· Content lines up with classroom goals and standards
1
Content is not right for students at this grade level.
β›” STOP β€” Do not proceed
2
Content is questionable for students at this grade level.
3
Content fits students at this grade level.
User-Generated Content & Teacher Controls
Is shared content okay (images, text, links)? Β· Can users comment on others' work? Β· Can chat or comments be monitored?
1
Content isn't okay and there are no teacher controls.
β›” STOP β€” Do not proceed
2
Content is mixed, or teacher controls are limited.
3
Content is okay and teacher controls are clear.
Rostering and Account Setup
Does the tool need student data? Β· Does it support auto-rostering through SSO or SIS?
1
No auto-rostering at all.
β›” STOP β€” Do not proceed
2
Auto-rostering exists, but the setup is hard.
3
No student data needed, or rostering is fully supported.

πŸ’¬ Coach's Playbook

Keep the conversation curious, not corrective

Use these prompts at any point during the evaluation to guide the conversation.

🀝Open with Trust
"What student moment are you hoping this tool will help with?"
"Before we score, what's your gut take on it?"
πŸ”„Pivot: Engagement β†’ Learning
"If we watched a student use this for ten minutes, what would we hope to see them thinking about?"
"Does this tool help students think more critically, or does it just make the task easier to finish?"
πŸ”Surface a Different Score
"I scored that one a 2 because of X. What pulled you to a 3?"
"Help me see what you're seeing on this row."
🎯Make the Decision Real
"What would success look like in two weeks if we tried this?"
"What's one signal we'll watch for in student work?"
πŸ‘£Name a Next Step
"What feels like the right first move for you β€” not the perfect one?"
"What support from me would make this a fair test?"