Executive sales dashboard with visual generative AI

Bruno Tavares · CommercialAI analyticsCriticality MediumAutonomy: Suggests actions

38Overall

Automatic evaluation

Generated by Aieval · opinionated analysis

Business Value40

AI Quality32

Security22

Privacy60

Opinion

Visually impressive in the demo, but the scenario is insufficient to move forward. The combination of no integration with internal systems, narratives inconsistent across business variations, and security fragility (exposed key + public dashboard) disqualifies the case from the start. The low score reflects the gap between the visual effect and the technical foundation. We recommend returning it for structural adjustments before any new presentation.

Aieval qualifies and recommends — the final decision is always human.

Gaps

Use case does not include any integration with internal systems (CRM, ERP, DW)
Data enters via manual upload — no source of truth, no data governance
Success KPIs are missing
AI-generated narratives are not reviewed before reaching leadership

Risks

Visually impressive demo, but inconsistent across business variations (regions, BUs, currencies) — the same dataset produces different narratives on each run
Security fragility found: vendor API key exposed in the frontend; dashboard URL public with no authentication
Risk of executive decisions based on hallucinated insights, with no traceability to the original number
External sharing of sales data without a contractual no-training clause

Recommendations

Do not move forward until the security fragility is addressed (rotate key, move calls to backend, enforce SSO)
Integrate with the official source (DW) before any pilot — eliminate manual uploads
Force narrative consistency: temperature zero + schema-bound prompt + numeric validation against the original data
Re-evaluate whether generative AI adds value — deterministic dashboards with traditional BI solve 80% of the scope

Discovery

Answers collected during intake

Problem: Leadership wants a 'wow' dashboard with AI-generated narratives based on monthly sales spreadsheets.
Objective: Replace monthly reports with a dashboard of AI-generated charts and insights, showcased at a board meeting.
Impacted users: Commercial leadership (12 people)
Vendor / model: Vendor Y (visualization SaaS with embedded LLM) · Generative LLM + auto-generated chart layer
Data used: Sales Excel spreadsheets (manual upload), Quarterly targets in PDF
Integrations: —
KPIs: No KPI defined
Estimated cost: $95,000
Risk flags: Uses PII: NoCustomer-facing: NoProduction access: NoExternal sharing: Yes