Scouttlo
All ideas/devtools/Automated QA management and analytics platform with intelligent root cause analysis and retest optimization
GitHubB2Bdevtools

Automated QA management and analytics platform with intelligent root cause analysis and retest optimization

Scouted 6 hours ago

6.8/ 10
Overall score

Turn this signal into an edge

We help you build it, validate it, and get there first.

Go from idea to plan: who buys, what MVP to launch, how to validate it, and what to measure before spending months.

Extra context

Learn more about this idea

Get a clearer explanation of what the opportunity means, the current problem behind it, how this idea solves it, and the key concepts involved.

Share your email to view this expanded analysis.

Score breakdown

Urgency8.0
Market size7.0
Feasibility7.0
Competition5.0
Pain point

Test cases in QA cycles remain failing or stuck in retest loops despite multiple fixes and iterations

Who'd pay for this

Software development companies, QA teams, and SaaS product teams

Source signal

"17 TCs have been tested, had fixes applied, retested, and are still not fully passing after ≥2 iterations"

Original post

QA Run 3: TCs stuck in retest loop (≥2 iterations, still not fully passing)

Published: 6 hours ago

Repository: SMC-Consulting/voice-agent-qa Author: feyazbek ## Summary Audit of [Human QA Test Run 3](https://github.com/orgs/SMC-Consulting/projects/5) as of 2026-04-21. **17 TCs** have been tested, had fixes applied, retested, and are **still not fully passing** after ≥2 iterations. 16 are in `Retest` status; 1 is marked `Done` but latest run failed. **Highest-iteration outliers (4 runs):** TC-724 (security: deactivation bypass) and TC-827 (end-user booking ER-4). --- ## Dashboard & Configuration (7) | TC | Runs | Latest | Blocker | |----|------|--------|---------| | [TC-700: Website — Homepage Load & Navigation](https://github.com/SMC-Consulting/voice-agent-qa/issues/652) | 3 | FAIL | #915/#1116 fix not deployed | | [TC-722: Configuration — LLM Model Selection](https://github.com/SMC-Consulting/voice-agent-qa/issues/671) | 2 | ❌ Fail | New blockers #1136 (API key 422), #1137 (drag-reorder 500) | | [TC-724: Configuration — User Management](https://github.com/SMC-Consulting/voice-agent-qa/issues/673) | 4 | Fail (Security) | Deactivation does not block access — stale JWT + re-login both work | | [TC-732: Configuration — Audit Log Viewer](https://github.com/SMC-Consulting/voice-agent-qa/issues/681) | 3 | PARTIAL PASS | Recording 422; 3 new bugs (BUG-005/006/008) | | [TC-734: Configuration — Business Hours Setup](https://github.com/SMC-Consulting/voice-agent-qa/issues/683) | 3 | Partial Pass | Asia/Kolkata still listed as deprecated Asia/Calcutta | | [TC-737: Configuration — SLA Policy Management](https://github.com/SMC-Consulting/voice-agent-qa/issues/686) | 3 | Partial Pass | Bug 3 (form reset) not fixed; business-hours dropdown still empty | | [TC-739: Configuration — Email Channel OAuth Connection](https://github.com/SMC-Consulting/voice-agent-qa/issues/688) | 3 | ⚠️ Partial | Google OAuth still blocked; 2 UX bugs | ## Help Center / Widget / Meetings (6) | TC | Runs | Latest | Blocker | |----|------|--------|---------| | [TC-816: Help Center — Submit Contact Form / Ticket](https://github.com/SMC-Consulting/voice-agent-qa/issues/739) | 3 | Partial Pass (4/5 ER) | No confirmation email from `/conversations` (#1324) | | [TC-819: Widget — Voice Call via Browser](https://github.com/SMC-Consulting/voice-agent-qa/issues/742) | 3 | PARTIAL | CRITICAL cross-tenant Freshservice fallback (#1328) | | [TC-825: Meeting Scheduler — Connect Calendar](https://github.com/SMC-Consulting/voice-agent-qa/issues/748) | 3 | PARTIAL PASS | MS regression #1343; Sat=Open hidden (#1175) | | [TC-826: Meeting Scheduler — Create Booking Link](https://github.com/SMC-Consulting/voice-agent-qa/issues/749) | 3 | PARTIAL PASS | Double-event on Google #1347; booker missing #1348; business hours #1344 | | [TC-827: Meeting Scheduler — Book a Meeting (End-User)](https://github.com/SMC-Consulting/voice-agent-qa/issues/750) | 4 | FAIL | ER-4 fails in both flows | | [TC-828: Analytics — Voice Analytics Dashboard](https://github.com/SMC-Consulting/voice-agent-qa/issues/751) | 3 | PARTIAL PASS | BUG-001 duration-clamp regression; ER-4 fails | ## Ops Console / Profile (4) | TC | Runs | Latest | Blocker | |----|------|--------|---------| | [TC-843: Ops Console — LLM Cost Tracking](https://github.com/SMC-Consulting/voice-agent-qa/issues/755) | 3 | Partial Pass | Pivot drag-drop broken; 4 UI bugs | | [TC-848: User Profile — Connected Login Methods](https://github.com/SMC-Consulting/voice-agent-qa/issues/760) | 2 | FAIL | 3/6 bugs still failing, 1 new bug | | [TC-849: User Profile — Passkey Registration & Login](https://github.com/SMC-Consulting/voice-agent-qa/issues/761) | 3 | FAIL | Pydantic v1 `parse_raw` on v2 model blocks registration | | [TC-851: User Profile — Tenant Settings (Company Info)](https://github.com/SMC-Consulting/voice-agent-qa/issues/763) | 2 | Partial Pass | Branding propagation not implemented | --- ## Methodology - Source: Project 5 "Human QA Test Run 3" (205 items total) - Selection criteria: `Test Execution` table has ≥2 runs AND the latest run result is not a clean `PASS` AND at least one prior run was FAIL/PARTIAL/BLOCKED - Status distribution of the 17: `Retest` × 16, `Done` × 1 (TC-722, closed prematurely despite Run 2 failing) ## Snapshot date 2026-04-21