Skip to main content

Admin-Only Feature Evaluation Framework

Overview

The Feature Evaluation Framework gives platform administrators a structured way to assess and prioritize feature ideas using proven frameworks like OST, Kano, RICE, and WSJF. You move through six gates that force clear thinking about problems, solutions, and tradeoffs before committing resources. This framework transforms gut-feel decisions into evidence-based prioritization backed by quantifiable scores.

Step-by-Step Guide

Creating Your First Evaluation

  1. Navigate to Feature Evaluations - From the admin menu, select Feature Evaluation Dashboard (/admin/featureevaluationdashboard). You see a “New Evaluation” button and a list of existing evaluations (empty if this is your first time).
  2. Start Gate 1: Intake - Click “New Evaluation” to open the wizard. Fill in the required fields: feature name (255 characters max), feature description, and problem statement. Add proposed solution and target users if you have them. Select urgency level (1-5 scale). Click “Save & Continue.”
  3. Complete Gate 2: OST Framework - Define desired outcomes as a list. Add key results that prove you achieved those outcomes. Document opportunity areas. List solution options with pros and cons for each. Click “Save & Continue.”
  4. Complete Gate 3: Classification - Choose a Kano category (Basic, Performance, or Delighter). Select MoSCoW priority (Must Have, Should Have, Could Have, or Won’t Have). Write justification text explaining your choices. Click “Save & Continue.”
  5. Complete Gate 4: RICE Scoring - Enter Reach (estimated users affected as a positive integer). Set Impact (1-3 scale where 1 is minimal, 2 is moderate, 3 is massive). Enter Confidence (0-100 percentage). Add Effort (person-weeks as a positive decimal). The system calculates your RICE score automatically: (Reach × Impact × Confidence%) / Effort. Click “Save & Continue.”
  6. Complete Gate 5: WSJF Sequencing - Enter Fibonacci values (1, 2, 3, 5, 8, 13, or 21) for User/Business Value, Time Criticality, and Risk Reduction/Opportunity Enablement. Enter Job Size using the same Fibonacci scale. The system calculates WSJF score automatically: (UserBusinessValue + TimeCriticality + RiskReduction) / JobSize. Click “Save & Continue.”
  7. Complete Gate 6: PR/FAQ - Write a press release draft (optional rich text). Add FAQs as question-answer pairs. Define success metrics as a list. Document risks and mitigations as pairs. Make your final decision: GO, NO-GO, DEFER, or Needs More Info. Click “Submit Evaluation.”

Uploading Supporting Documents

  1. Add Evidence at Any Gate - At any point in the wizard, click “Upload Document.”
  2. Select Your File - Choose a PDF, PNG, JPG, XLSX, or DOCX file up to 10MB. Add an optional description explaining what the document contains.
  3. View All Documents - See a list of all documents with their gate association, file name, upload date, and download link. Documents stay accessible throughout the evaluation.

Reviewing and Comparing Evaluations

  1. View the Dashboard - Return to Feature Evaluation Dashboard to see all evaluations ranked by WSJF score (primary) then RICE score (secondary).
  2. Filter and Sort - Use filter controls to show evaluations by status (Draft, In Progress, Completed, Archived). Sort by different score columns to change your view.
  3. Open a Scorecard - Click any evaluation to view a complete scorecard showing all gate data, computed scores, and the final decision.
  4. Navigate Between Gates - Click the gate progress indicator to jump to any previously completed gate. Review or edit that gate’s data. Changes update scores in real time.
  5. Archive When Done - Mark completed evaluations as archived. They move to the archived view but remain viewable for reference.

Common Questions

Q: What happens if I close the browser before finishing all six gates? A: Your progress auto-saves every 30 seconds of inactivity. Session data persists for 30 days. When you return, the system restores your incomplete evaluation exactly where you left off. Q: Can multiple admins work on the same evaluation simultaneously? A: Yes, but be aware that if the same evaluation is open in multiple tabs or by multiple admins, last save wins (optimistic concurrency). The most recent changes overwrite earlier ones. Coordinate with your team to avoid conflicts. Q: How do I know which features to build first? A: The dashboard ranks evaluations by WSJF score (primary), then RICE score (secondary). Features at the top of the ranked list deliver the highest value relative to effort. Focus your resources there first. Q: What if I disagree with the calculated scores? A: Scores reflect the inputs you provided. Review your Reach, Impact, Confidence, Effort, and WSJF component values. If the score seems wrong, revisit those gates and adjust your estimates. The scores recalculate automatically. Q: Can non-admin users see or contribute to feature evaluations? A: No. This framework is admin-only. Non-admin users cannot access Feature Evaluation sections, view evaluations, or make API requests to evaluation endpoints. They see no navigation links and receive 403 Forbidden errors if they attempt direct access.

Troubleshooting

Issue: File upload fails with size limit message Solution: The system enforces a 10MB limit per document. Compress your file or split large documents into smaller pieces. PDFs often compress well without losing quality. Issue: RICE or WSJF score shows as zero or undefined Solution: Check that you completed all required fields in Gates 4 and 5. Missing values prevent score calculation. Return to those gates and fill in any empty fields. Scores update automatically once all inputs are provided. Issue: Cannot find the “New Evaluation” button Solution: Verify you are logged in as an admin. Only users with ADMIN role see Feature Evaluation functionality. If you are an admin but still cannot see it, log out and log back in to refresh your session permissions. Issue: Changes to a completed gate don’t appear in the scorecard Solution: After editing a gate, click “Save & Continue” to persist your changes. If you navigate away without saving, changes are lost. The auto-save captures work in progress but does not replace explicit saves when moving between gates. Innovation Evaluation Wizard - If you validated a corporate initiative and want to assess features within it, the Innovation Evaluation Wizard (/innovationevaluationwizard) provides stage-gated evaluation for internal innovation portfolios. It complements the Feature Evaluation Framework by handling portfolio-level decisions. Admin Playbook Review - After you decide GO on a feature, use Admin Playbook Review (/admin/adminplaybookreview) to assess implementation quality. This feature connects prioritization decisions to execution monitoring, closing the loop from evaluation to delivery. PRD Dashboard - Features that pass through the evaluation framework often need detailed specifications. PRD Dashboard (/prddashboard) tracks Product Requirements Documents across versions, helping you maintain alignment between strategic decisions and technical execution.