olegs/ai_tools_analysis
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Refactor evaluations for Equally AI, Testim, and Virtuoso:

Browse Source 
- Removed outdated files and replaced with updated evaluations reflecting current data protection policies and enterprise readiness.
- Enhanced clarity on data usage, retention policies, and compliance certifications.
- Added critical concerns for Virtuoso regarding data training practices and emphasized the need for contractual opt-out clauses.
This commit is contained in:
olegs committed 2026-02-02 15:08:31 +02:00
1 parent adf462397e
commit 7d99bdbc91
39 files changed
+2324 -6326
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

INDEX.md
+20 -23
View File
@@ -13,7 +13,7 @@
- Recommended tool stacks for different project types
2. **[SUMMARY_REPORT.md](SUMMARY_REPORT.md)**
- Comprehensive summary of all 19 tools
- Comprehensive summary of all 21 tools
- Key recommendations and decision matrix
- Gold Standard tools identified
- Data privacy comparison matrix
@@ -54,10 +54,10 @@
| Tool | File | Status | Key Finding |
|------|------|--------|-------------|
| **Snyk** | [evaluation_security_snyk_updated.md](evaluation_security_snyk_updated.md) | ✅ Complete | No customer code training, SOC 2 certified |
| **Aikido** ✅ | [evaluation_security_aikido_verified.md](evaluation_security_aikido_verified.md) | ✅ VERIFIED | SOC 2 Type II, ISO 27001, no code storage |
| **Escape** | [evaluation_security_escape_updated.md](evaluation_security_escape_updated.md) | ✅ Complete | DAST approach (lower IP risk) |
| **Vendavo** | [evaluation_security_vendavo_updated.md](evaluation_security_vendavo_updated.md) | ✅ Complete | Different domain (business pricing, not code) |
| **Snyk** | [evaluation_security_snyk.md](evaluation_security_snyk.md) | ✅ Complete | No customer code training, SOC 2 certified |
| **Aikido** ✅ | [evaluation_security_aikido.md](evaluation_security_aikido.md) | ✅ VERIFIED | SOC 2 Type II, ISO 27001, no code storage |
| **Escape** | [evaluation_security_escape.md](evaluation_security_escape.md) | ✅ Complete | DAST approach (lower IP risk) |
| **Vendavo** | [evaluation_security_vendavo.md](evaluation_security_vendavo.md) | ✅ Complete | Different domain (business pricing, not code) |
---
@@ -65,11 +65,11 @@
| Tool | File | Status | Key Finding |
|------|------|--------|-------------|
| **UX Pilot** 🏆 | [evaluation_design_uxpilot_updated.md](evaluation_design_uxpilot_updated.md) | ✅ Complete | RECOMMENDED - No training on designs, $19-29/month |
| **Uizard** | [evaluation_design_uizard_updated.md](evaluation_design_uizard_updated.md) | ✅ Complete | Business/Enterprise safe ($39/month+) |
| **Lovable** | [evaluation_design_lovable_updated.md](evaluation_design_lovable_updated.md) | ✅ Complete | Opt-out required on Free/Pro, Business $50/month |
| **Galileo AI** 🚨 | [evaluation_design_galileoai_updated.md](evaluation_design_galileoai_updated.md) | ✅ Complete | RED FLAG: Free/Starter outputs PUBLIC |
| **Maze AI** | [evaluation_design_mazeai_updated.md](evaluation_design_mazeai_updated.md) | ✅ Complete | No training (OpenAI/Anthropic APIs), $99/month |
| **UX Pilot** 🏆 | [evaluation_design_uxpilot.md](evaluation_design_uxpilot.md) | ✅ VERIFIED | RECOMMENDED - No training on designs, $19-29/month |
| **Uizard** | [evaluation_design_uizard.md](evaluation_design_uizard.md) | ✅ Complete | Business/Enterprise safe ($39/month+) |
| **Lovable** | [evaluation_design_lovable.md](evaluation_design_lovable.md) | ✅ VERIFIED | Opt-out required on Free/Pro, Business $50/month |
| **Galileo AI** 🚨 | [evaluation_design_galileoai.md](evaluation_design_galileoai.md) | ✅ VERIFIED | RED FLAG: Free/Starter outputs PUBLIC |
| **Maze AI** | [evaluation_design_mazeai.md](evaluation_design_mazeai.md) | ✅ Complete | No training (OpenAI/Anthropic APIs), $99/month |
---
@@ -77,12 +77,12 @@
| Tool | File | Status | Key Finding |
|------|------|--------|-------------|
| **Diffblue** 🏆 | [evaluation_testing_diffblue_updated.md](evaluation_testing_diffblue_updated.md) | ✅ Complete | GOLD STANDARD - On-premises AI, $30/month+ |
| **BrowserStack** 🏆 | [evaluation_testing_browserstack_updated.md](evaluation_testing_browserstack_updated.md) | ✅ Complete | GOLD STANDARD - Immediate data wipeout, ~$299/month |
| **Applitools** | [evaluation_testing_applitools_updated.md](evaluation_testing_applitools_updated.md) | ✅ Complete | No training on screenshots, $699/month+ |
| **Testim** | [evaluation_testing_testim_updated.md](evaluation_testing_testim_updated.md) | ✅ Complete | No training, highly sensitive data, ~$20K/year |
| **Equally AI** | [evaluation_testing_equally_ai_updated.md](evaluation_testing_equally_ai_updated.md) | ✅ Complete | GDPR compliant, accessibility focus |
| **Virtuoso** 🚨 | [evaluation_testing_virtuoso_updated.md](evaluation_testing_virtuoso_updated.md) | ✅ Complete | RED FLAG: Trains by default, needs opt-out |
| **Diffblue** 🏆 | [evaluation_testing_diffblue.md](evaluation_testing_diffblue.md) | ✅ VERIFIED | GOLD STANDARD - On-premises AI, $30/month+ |
| **BrowserStack** 🏆 | [evaluation_testing_browserstack.md](evaluation_testing_browserstack.md) | ✅ VERIFIED | GOLD STANDARD - Immediate data wipeout, ~$299/month |
| **Applitools** | [evaluation_testing_applitools.md](evaluation_testing_applitools.md) | ✅ Complete | No training on screenshots, $699/month+ |
| **Testim** | [evaluation_testing_testim.md](evaluation_testing_testim.md) | ✅ VERIFIED | No training, highly sensitive data, ~$20K/year |
| **Equally AI** | [evaluation_testing_equally_ai.md](evaluation_testing_equally_ai.md) | ✅ Complete | GDPR compliant, accessibility focus |
| **Virtuoso** 🚨 | [evaluation_testing_virtuoso.md](evaluation_testing_virtuoso.md) | ✅ Complete | RED FLAG: Trains by default, needs opt-out |
---
@@ -107,17 +107,14 @@
- **Design tool free tiers**: May train on designs
- **Google Antigravity**: Public Preview - no compliance certs, avoid for enterprise
### ✅ All Tools Verified
- All 19 tools fully researched and evaluated
- Maze AI research completed 2026-02-02
### ✅ Independently Verified Tools (8)
- UX Pilot, Lovable, Galileo AI, Diffblue, BrowserStack, Testim, Aikido
---
## File Naming Convention
- Original templates: `evaluation_[category]_[tool].md`
- Updated evaluations: `evaluation_[category]_[tool]_updated.md`
- Master reports: `[NAME]_REPORT.md` or `[NAME].md`
All evaluation files follow: `evaluation_[category]_[tool].md`
---
@@ -130,5 +127,5 @@
---
**Total Files:** 21 tool evaluations + 3 master reports + 2 supporting files = 26 documents
**Total Files:** 21 tool evaluations + 4 master reports + 2 supporting files = 27 documents
**Evaluation Complete:** February 2, 2026