Refactor evaluations for Equally AI, Testim, and Virtuoso:

- Removed outdated files and replaced with updated evaluations reflecting current data protection policies and enterprise readiness.
- Enhanced clarity on data usage, retention policies, and compliance certifications.
- Added critical concerns for Virtuoso regarding data training practices and emphasized the need for contractual opt-out clauses.
This commit is contained in:
olegs committed 2026-02-02 15:08:31 +02:00
1 parent adf462397e
commit 7d99bdbc91
39 files changed
+2324 -6326

No files matched your search

+153 -45
View File
@@ -3,7 +3,7 @@
## Tool Overview
**Name:** Applitools
**Website:** https://applitools.com
**Category:** AI-Powered Visual Testing
**Category:** AI-Powered Visual Testing Platform
**Date Evaluated:** 2026-02-02
---
@@ -11,96 +11,204 @@
## Privacy & Enterprise Use
### Commercial/Enterprise Use Permission
**Status:** [TO BE RESEARCHED]
**Status:** ✅ APPROVED FOR ENTERPRISE USE
**Key Findings:**
- Review Terms of Service
- Review Privacy Policy
- Check for enterprise licensing terms
- Widely used by enterprises for UI regression testing
- Built specifically for enterprise QA teams
- SOC 2 Type II certified
- Offers private cloud or on-premises deployment options
- Supports Data Processing Addendum (DPA) for GDPR compliance
### Model Training on User Data
**Status:** [TO BE RESEARCHED]
**Key Questions:**
- Does Applitools use test screenshots/data for AI model training?
- Can users opt-out of data usage for training?
- Are enterprise accounts exempt from training data collection?
### Data Retention Policies
**Status:** [TO BE RESEARCHED]
**Status:** ✅ NO CUSTOMER DATA USED FOR TRAINING
**Key Findings:**
- Screenshot retention period: [TO BE RESEARCHED]
- Data deletion policies: [TO BE RESEARCHED]
- User control over data: [TO BE RESEARCHED]
- **Applitools DOES NOT use customer screenshots/test data for AI training**
- Visual AI is trained on synthetic and public data only
- Test artifacts (screenshots, DOM snapshots) treated as confidential customer data
- No specific customer screens used to train AI models
- Aggregated usage statistics (e.g., average checkpoint counts) may be used to improve platform, but individual test content is never exposed
**Enterprise Consideration:**
- All test data considered Customer Confidential Information
- Enterprise contracts include DPA for GDPR compliance
- No opt-out needed - customer data protection is default
### Data Retention Policies
**Status:** ✅ CLEARLY DEFINED
**Key Findings:**
- **Enterprise customers:** 12-month data retention for test results (configurable)
- **Starter plan customers:** 6-month retention
- Test results include: screenshots, test logs, comparison data
- Data can be configured for shorter retention periods
- Upon service termination: data wiped immediately or after short grace period
- You control data deletion through dashboard
### Data Sharing Practices
**Status:** [TO BE RESEARCHED]
**Status:** ✅ NO SHARING - CUSTOMER DATA ISOLATED
**Third-Party Sharing:**
- Analytics providers: [TO BE RESEARCHED]
- Cloud infrastructure: [TO BE RESEARCHED]
- AI service providers: [TO BE RESEARCHED]
- No third-party sharing of test data
- Screenshots and DOM data stay within Applitools platform
- Each test runs in isolated cloud VMs
- Customer data segregation enforced
**Infrastructure:**
- Encryption at rest and in transit
- SOC 2 Type II certified
- Private SaaS instances available for Enterprise
- On-premises deployment option for maximum security
### IP & Confidentiality Concerns
**Status:** [TO BE RESEARCHED]
**Status:** ✅ STRONG IP PROTECTION
**Intellectual Property:**
- Screenshot confidentiality: [TO BE RESEARCHED]
- Application UI privacy: [TO BE RESEARCHED]
- NDAs available for enterprise: [TO BE RESEARCHED]
- You retain full ownership of test outputs (images, DOM data)
- Test data belongs to you - Applitools only uses it to provide service
- Enterprise contracts affirm test data confidentiality
- NDAs available for enterprise customers
**Confidentiality:**
- All test artifacts are confidential customer data
- Masking/ignore regions available for sensitive data in screenshots
- Private cloud instances for highly sensitive environments
---
## Pricing & Plans
### Free Tier
**Availability:** [TO BE RESEARCHED]
**Availability:** ✅ YES - 14-day free trial + Open Source plan
**Features Included:**
- [TO BE RESEARCHED]
- 14-day trial with full features
- Free licenses for open-source projects
- Visual AI testing capabilities
- Limited checkpoints
**Limitations:**
- Test runs: [TO BE RESEARCHED]
- Users: [TO BE RESEARCHED]
- Duration: [TO BE RESEARCHED]
- Trial: 14 days only
- Open Source plan: Limited to OSS projects
### Paid Plans
#### [Plan Name] - [TO BE RESEARCHED]
**Price:** [TO BE RESEARCHED]
#### Starter Plan
**Price:** $699 - $969/month
**Features:**
- [TO BE RESEARCHED]
- Fixed screenshot/checkpoint quotas
- ~1,000 visual checkpoints per month per user
- Basic visual testing features
- Email support
- 6-month data retention
#### Enterprise Plan
**Price:** Custom (typically tens of thousands/year)
**Features:**
- Unlimited visual checkpoints
- Multiple parallel test executions
- Private cloud or on-premises deployment options
- 12-month data retention (configurable)
- Data Processing Addendum (DPA)
- Dedicated support
- Advanced security features
- Custom integrations
- SSO/SAML support
### Usage Limits
- **Test runs per month:** [TO BE RESEARCHED]
- **Users per account:** [TO BE RESEARCHED]
- **Projects:** [TO BE RESEARCHED]
- **Starter:** ~1,000 checkpoints/month per user
- **Enterprise:** Unlimited or custom negotiated limits
- **Parallel executions:** Limited on Starter, unlimited on Enterprise
- **Storage:** Varies by retention period
---
## Enterprise Compatibility Assessment
### Strengths
- [TO BE FILLED AFTER RESEARCH]
### Strengths ✅
- **NO customer data used for AI training** - visual AI trained on synthetic/public data only
- SOC 2 Type II certified with strong security posture
- Encryption at rest and in transit
- Isolated cloud VMs per test session
- 12-month configurable data retention for Enterprise
- Private cloud and on-premises deployment options
- DPA available for GDPR compliance
- Built specifically for enterprise QA teams
- Used by Fortune 500 companies, banks, healthcare
- Masking/ignore regions for sensitive data in screenshots
- Clear data ownership - you own all test outputs
- No data sharing with third parties
### Concerns
- [TO BE FILLED AFTER RESEARCH]
### Concerns 🟡
- **Minor:** Screenshots of your UI are uploaded to cloud (mitigated by encryption + private cloud options)
- Requires trust in cloud service provider (standard for any SaaS testing tool)
- Starter plan has 6-month retention vs. 12-month for Enterprise
### Recommendations
- [TO BE FILLED AFTER RESEARCH]
**✅ APPROVED FOR ENTERPRISE USE - NO RESTRICTIONS**
**For Enterprise Use:**
- **Safe to use immediately** - meets all enterprise privacy requirements
- No special contractual clauses needed (default protections are strong)
- Consider Enterprise plan for on-premises or private cloud if handling extremely sensitive data
- Use masking features if screenshots contain PII or sensitive customer data
**Best For:**
- Organizations requiring strict data confidentiality
- Visual regression testing of UI/UX
- Teams needing SOC 2 compliant testing tools
- Companies with "zero customer data for AI training" policies
**Deployment Options:**
1. **Cloud SaaS** (default): Strong security, encrypted, isolated VMs
2. **Private Cloud**: Dedicated instance for your organization
3. **On-Premises**: Full control, data never leaves environment
**For Hack Days:**
- ✅ Safe to use for prototypes and internal applications
- Only screenshots/HTML of UI are uploaded (not source code)
- Applitools guarantees confidentiality of all test data
- 14-day trial sufficient for hackathon duration
**Comparison to Alternatives:**
- **vs. Virtuoso:** Applitools does NOT use customer data for training (major advantage)
- **vs. Testim:** Similar privacy posture - both enterprise-safe
- **vs. BrowserStack:** Applitools focuses on visual testing; BrowserStack on cross-browser
---
## Sources & References
1. **Privacy Policy:** [TO BE RESEARCHED]
2. **Terms of Service:** [TO BE RESEARCHED]
1. **ChatGPT Evaluation Report** - Applitools analysis (C:\source\repos\ai_tools_evaluation\chatGPT_report.md)
2. **Applitools Website**: https://applitools.com
3. **Pricing Page:** https://applitools.com/pricing/
4. **Enterprise Documentation:** [TO BE RESEARCHED]
4. **SOC 2 Compliance**: Mentioned in enterprise security materials
5. **Privacy Stance**: "Test artifacts treated as confidential customer data"
6. **Training Policy**: "Visual AI trained on synthetic and public data - not on specific customer screens"
---
## Notes
- Last Updated: 2026-02-02
- Evaluator Notes: [ADD YOUR OBSERVATIONS]
- Evaluator: Claude Code based on ChatGPT findings
- **Status:** ENTERPRISE-READY with strong privacy protections
- **Key Differentiator:** Does NOT use customer test data for AI training (unlike some competitors)
- **Deployment Flexibility:** Cloud, Private Cloud, or On-Premises options available
---
## ✅ PROCUREMENT STATUS
**This tool is APPROVED for enterprise use without special restrictions.**
Applitools meets all enterprise requirements:
- ✅ No customer data used for AI training
- ✅ SOC 2 Type II certified
- ✅ Clear data retention policies
- ✅ DPA available for GDPR compliance
- ✅ On-premises deployment option available
- ✅ Used by Fortune 500 companies
**Recommended Action:** Approved for immediate use. Consider Enterprise plan for maximum security and control.