INI-007
·Aprovada p/ DiscoveryCopilot platform evaluation for Engineering
Lucas Pereira · TechnologyVendor evaluationCriticality MediumAutonomy: Assistive
71Overall
Automatic evaluation
Business Value72
AI Quality78
Security60
Privacy75
Opinion
Well-structured vendor evaluation. Recommended discovery with a 30-dev pilot before enterprise contract.
Aieval qualifies and recommends — the final decision is always human.
Gaps
1- Developer acceptable use policy
Risks
2- Exposure of proprietary code to vendor
- Suggestions with incompatible licenses
Recommendations
3- Validate sensitive-repo exclusion settings
- Training on critical review of suggestions
- Controlled 30-dev pilot with DORA metrics for 90 days
Discovery
Answers collected during intake
- Problem
- Evaluate corporate contracting of Copilot.
- Objective
- Measure productivity gain and IP risks.
- Impacted users
- 350 developers
- Vendor / model
- GitHub Copilot Enterprise · Code assistant
- Data used
- Internal repositories (code)
- Integrations
- GitHub Enterprise, IDEs
- KPIs
- Suggestion acceptance · PRs/dev · DORA metrics
- Estimated cost
- $150,000
- Risk flags
- Uses PII: NoCustomer-facing: NoProduction access: NoExternal sharing: Yes