Brief Confidence Assessment & Improvement Loop
1. Overview
Your brief gets scored across 7 quality dimensions the moment you submit it. The system tells you exactly what’s missing and what to upload to strengthen weak areas - then you can improve your score through up to 3 iterations before your BRS generates. This loop ensures your BRS builds from a solid foundation and saves time by catching gaps early.2. Step-by-Step Guide
- Submit your project brief - After you complete the brief submission wizard, the system immediately transitions your project to confidence assessment mode. You’ll see a status indicator showing “Assessing Brief Quality.”
- Wait for Sherpa review - The AI evaluates your brief across 7 dimensions (Problem, Solution, Market, Technical, Execution, Metrics, Risks for Fiftyknots projects). A Sherpa reviews the AI assessment within 24 hours to ensure accuracy and add personal context.
-
Review your confidence report - You’ll receive an email with your overall confidence score (0-100) and grade (A-F). Click the link to view the full report on the Confidence Report page. The report shows:
- Overall confidence score with grade badge
- 7-dimension breakdown with traffic light indicators (green = ready, amber = needs work, red = critical gap)
- Top 3-5 recommendations ranked by impact, each showing what’s missing, what to upload, and estimated point improvement
- Upload improvement documents - If your score is below the ready threshold (75% for Fiftyknots, 80% for Acumen), click “Upload Documents” to add materials to your data room vault. Upload architecture diagrams, market research, financial models, or any documents the recommendations suggest. You’ll receive an acknowledgment email confirming receipt.
- Get re-assessed - The system automatically re-evaluates your brief with the new documents. You can iterate up to 3 times, with each iteration showing which gaps you’ve closed and which remain.
- Proceed to BRS generation - Once your score meets the threshold, you’ll receive a congratulatory email and your project automatically transitions to BRS generation. If you’re under time pressure, you can click “Proceed Anyway” to override the threshold and move forward with an advisory note about unresolved gaps.
3. Common Questions
Q: What happens if I don’t upload anything after receiving my confidence report?A: The system gives you 7 days per iteration to respond. If you don’t upload documents or take action within 7 days, your project automatically proceeds to BRS generation with your current confidence score. The BRS will include an advisory note about the gaps. You won’t get stuck in the loop indefinitely. Q: Can I see what changed between iterations?
A: Yes. Each re-assessment shows your new score alongside the previous score, highlights which dimensions improved, and displays updated recommendations focusing on remaining gaps. The full history is available in your project dashboard. Q: What if I disagree with the AI’s assessment of my brief?
A: Your assigned Sherpa reviews every AI assessment before you see it. They can edit recommendations, adjust priorities, and add personal notes to provide context. If you still have concerns after reviewing the Sherpa’s notes, you can proceed to BRS generation anyway using the “Proceed Anyway” option. Q: Do I have to hit the ready threshold to move forward?
A: No. You can explicitly request to proceed at any time by clicking “Proceed Anyway.” The system will show you a confirmation explaining the risks and specific critical gaps, and ask you to acknowledge that your BRS may have limitations. Your choice is recorded for audit purposes. Q: How long does each assessment take?
A: The AI assessment completes within 2 minutes of submission or document upload. Sherpa review typically happens within 24 hours, though assessments auto-release if not reviewed in that window. You’ll receive an email as soon as your report is ready.
4. Troubleshooting
Issue: My score didn’t improve after uploading documentsSolution: Check that your uploaded documents directly address the recommended gaps. The AI evaluates content relevance - uploading generic materials won’t raise scores. Review the specific “suggested inputs” in each recommendation (like “system architecture diagram” or “competitive analysis spreadsheet”) and ensure your uploads match those types. If you’re on your third iteration and still not seeing improvement, consider using “Proceed Anyway” and addressing remaining gaps during the BRS feedback phase. Issue: I uploaded documents but didn’t get a re-assessment
Solution: Re-assessments trigger automatically when you upload to your data room vault while in BRIEF_IMPROVING state. If you uploaded elsewhere or your project was in a different state, the system may not have detected the upload. Navigate to your project dashboard, confirm your project shows “Brief Improving” status, then upload directly through the confidence report page’s “Upload Documents” button. Issue: The confidence report link in my email doesn’t work
Solution: Confidence report links expire after your project moves past the improvement loop. If you’ve already proceeded to BRS generation, access your historical confidence reports through your project dashboard under “Assessment History” instead of using the email link. Issue: I hit the 3-iteration limit but my score is still low
Solution: The system automatically proceeds to BRS generation after 3 iterations to prevent indefinite blocking. Your BRS will include an advisory section noting the unresolved gaps, and your Sherpa will work with you during the BRS feedback phase to address those areas. You can also add documents to your data room at any time - they’ll inform later stages even if they didn’t boost your confidence score.