ai_tools_analysis/evaluation_testing_applitools.md

# Applitools - Enterprise Compatibility Evaluation

## Tool Overview
**Name:** Applitools
**Website:** https://applitools.com
**Category:** AI-Powered Visual Testing Platform
**Date Evaluated:** 2026-02-02

---

## Privacy & Enterprise Use

### Commercial/Enterprise Use Permission
**Status:** ✅ APPROVED FOR ENTERPRISE USE

**Key Findings:**
- Widely used by enterprises for UI regression testing
- Built specifically for enterprise QA teams
- SOC 2 Type II certified
- Offers private cloud or on-premises deployment options
- Supports Data Processing Addendum (DPA) for GDPR compliance

### Model Training on User Data
**Status:** ✅ NO CUSTOMER DATA USED FOR TRAINING

**Key Findings:**
- **Applitools DOES NOT use customer screenshots/test data for AI training**
- Visual AI is trained on synthetic and public data only
- Test artifacts (screenshots, DOM snapshots) treated as confidential customer data
- No specific customer screens used to train AI models
- Aggregated usage statistics (e.g., average checkpoint counts) may be used to improve platform, but individual test content is never exposed

**Enterprise Consideration:**
- All test data considered Customer Confidential Information
- Enterprise contracts include DPA for GDPR compliance
- No opt-out needed - customer data protection is default

### Data Retention Policies
**Status:** ✅ CLEARLY DEFINED

**Key Findings:**
- **Enterprise customers:** 12-month data retention for test results (configurable)
- **Starter plan customers:** 6-month retention
- Test results include: screenshots, test logs, comparison data
- Data can be configured for shorter retention periods
- Upon service termination: data wiped immediately or after short grace period
- You control data deletion through dashboard

### Data Sharing Practices
**Status:** ✅ NO SHARING - CUSTOMER DATA ISOLATED

**Third-Party Sharing:**
- No third-party sharing of test data
- Screenshots and DOM data stay within Applitools platform
- Each test runs in isolated cloud VMs
- Customer data segregation enforced

**Infrastructure:**
- Encryption at rest and in transit
- SOC 2 Type II certified
- Private SaaS instances available for Enterprise
- On-premises deployment option for maximum security

### IP & Confidentiality Concerns
**Status:** ✅ STRONG IP PROTECTION

**Intellectual Property:**
- You retain full ownership of test outputs (images, DOM data)
- Test data belongs to you - Applitools only uses it to provide service
- Enterprise contracts affirm test data confidentiality
- NDAs available for enterprise customers

**Confidentiality:**
- All test artifacts are confidential customer data
- Masking/ignore regions available for sensitive data in screenshots
- Private cloud instances for highly sensitive environments

---

## Pricing & Plans

### Free Tier
**Availability:** ✅ YES - 14-day free trial + Open Source plan

**Features Included:**
- 14-day trial with full features
- Free licenses for open-source projects
- Visual AI testing capabilities
- Limited checkpoints

**Limitations:**
- Trial: 14 days only
- Open Source plan: Limited to OSS projects

### Paid Plans

#### Starter Plan
**Price:** $699 - $969/month
**Features:**
- Fixed screenshot/checkpoint quotas
- ~1,000 visual checkpoints per month per user
- Basic visual testing features
- Email support
- 6-month data retention

#### Enterprise Plan
**Price:** Custom (typically tens of thousands/year)
**Features:**
- Unlimited visual checkpoints
- Multiple parallel test executions
- Private cloud or on-premises deployment options
- 12-month data retention (configurable)
- Data Processing Addendum (DPA)
- Dedicated support
- Advanced security features
- Custom integrations
- SSO/SAML support

### Usage Limits
- **Starter:** ~1,000 checkpoints/month per user
- **Enterprise:** Unlimited or custom negotiated limits
- **Parallel executions:** Limited on Starter, unlimited on Enterprise
- **Storage:** Varies by retention period

---

## Enterprise Compatibility Assessment

### Strengths ✅
- **NO customer data used for AI training** - visual AI trained on synthetic/public data only
- SOC 2 Type II certified with strong security posture
- Encryption at rest and in transit
- Isolated cloud VMs per test session
- 12-month configurable data retention for Enterprise
- Private cloud and on-premises deployment options
- DPA available for GDPR compliance
- Built specifically for enterprise QA teams
- Used by Fortune 500 companies, banks, healthcare
- Masking/ignore regions for sensitive data in screenshots
- Clear data ownership - you own all test outputs
- No data sharing with third parties

### Concerns 🟡
- **Minor:** Screenshots of your UI are uploaded to cloud (mitigated by encryption + private cloud options)
- Requires trust in cloud service provider (standard for any SaaS testing tool)
- Starter plan has 6-month retention vs. 12-month for Enterprise

### Recommendations

**✅ APPROVED FOR ENTERPRISE USE - NO RESTRICTIONS**

**For Enterprise Use:**
- **Safe to use immediately** - meets all enterprise privacy requirements
- No special contractual clauses needed (default protections are strong)
- Consider Enterprise plan for on-premises or private cloud if handling extremely sensitive data
- Use masking features if screenshots contain PII or sensitive customer data

**Best For:**
- Organizations requiring strict data confidentiality
- Visual regression testing of UI/UX
- Teams needing SOC 2 compliant testing tools
- Companies with "zero customer data for AI training" policies

**Deployment Options:**
1. **Cloud SaaS** (default): Strong security, encrypted, isolated VMs
2. **Private Cloud**: Dedicated instance for your organization
3. **On-Premises**: Full control, data never leaves environment

**For Hack Days:**
- ✅ Safe to use for prototypes and internal applications
- Only screenshots/HTML of UI are uploaded (not source code)
- Applitools guarantees confidentiality of all test data
- 14-day trial sufficient for hackathon duration

**Comparison to Alternatives:**
- **vs. Virtuoso:** Applitools does NOT use customer data for training (major advantage)
- **vs. Testim:** Similar privacy posture - both enterprise-safe
- **vs. BrowserStack:** Applitools focuses on visual testing; BrowserStack on cross-browser

---

## Sources & References

1. **ChatGPT Evaluation Report** - Applitools analysis (C:\source\repos\ai_tools_evaluation\chatGPT_report.md)
2. **Applitools Website**: https://applitools.com
3. **Pricing Page:** https://applitools.com/pricing/
4. **SOC 2 Compliance**: Mentioned in enterprise security materials
5. **Privacy Stance**: "Test artifacts treated as confidential customer data"
6. **Training Policy**: "Visual AI trained on synthetic and public data - not on specific customer screens"

---

## Notes
- Last Updated: 2026-02-02
- Evaluator: Claude Code based on ChatGPT findings
- **Status:** ENTERPRISE-READY with strong privacy protections
- **Key Differentiator:** Does NOT use customer test data for AI training (unlike some competitors)
- **Deployment Flexibility:** Cloud, Private Cloud, or On-Premises options available

---

## ✅ PROCUREMENT STATUS

**This tool is APPROVED for enterprise use without special restrictions.**

Applitools meets all enterprise requirements:
- ✅ No customer data used for AI training
- ✅ SOC 2 Type II certified
- ✅ Clear data retention policies
- ✅ DPA available for GDPR compliance
- ✅ On-premises deployment option available
- ✅ Used by Fortune 500 companies

**Recommended Action:** Approved for immediate use. Consider Enterprise plan for maximum security and control.