- Removed outdated files and replaced with updated evaluations reflecting current data protection policies and enterprise readiness. - Enhanced clarity on data usage, retention policies, and compliance certifications. - Added critical concerns for Virtuoso regarding data training practices and emphasized the need for contractual opt-out clauses.
179 lines
5.4 KiB
Markdown
179 lines
5.4 KiB
Markdown
# Testim (Tricentis) - Enterprise Evaluation
|
|
|
|
**Tool:** Testim (part of Tricentis)
|
|
**Category:** Testing (AI-assisted Test Automation)
|
|
**Evaluation Status:** ✅ INDEPENDENTLY VERIFIED (Claude Research - February 2026)
|
|
**Recommendation:** ✅ **APPROVED** - Enterprise-ready with strong data protection
|
|
|
|
---
|
|
|
|
## Executive Summary
|
|
|
|
Testim is an AI-powered test automation platform acquired by Tricentis. Independent verification confirms that **customer data is NOT used for AI model training**, with clear data handling policies and comprehensive security certifications.
|
|
|
|
---
|
|
|
|
## Data Training Policy
|
|
|
|
### ✅ VERIFIED: NO TRAINING ON CUSTOMER DATA
|
|
|
|
**Source:** [Testim AI Data Usage Policy](https://help.testim.io/docs/ai-data-usage-policy)
|
|
|
|
**Key Findings:**
|
|
|
|
1. **No AI model training on customer data:**
|
|
> "Customer data is not used to train Microsoft Azure OpenAI Service models."
|
|
> "User prompts are used for the chat sessions only and not used for model training purposes, or any other purposes."
|
|
|
|
2. **Prompt content protection:**
|
|
> "The prompt content is not used for model training purposes."
|
|
|
|
3. **Data isolation:**
|
|
> Data is "isolated from other data" and cannot be traced back to user or company
|
|
|
|
---
|
|
|
|
## Data Retention
|
|
|
|
### Retention Periods
|
|
| Data Type | Retention Period |
|
|
|-----------|-----------------|
|
|
| User prompts | Up to 24 hours |
|
|
| Session data | Duration of chat session |
|
|
| Test artifacts | Per customer agreement |
|
|
|
|
### Key Protections
|
|
- Pseudo-random session IDs prevent tracing
|
|
- Microsoft temporary storage for abuse monitoring only
|
|
- All data stored and processed in US
|
|
|
|
---
|
|
|
|
## AI Technology
|
|
|
|
### Smart Locators
|
|
- AI runs in **real-time**, not trained on customer apps
|
|
- Uses pattern recognition for element identification
|
|
- 95%+ self-healing capability
|
|
- No customer app data retained for training
|
|
|
|
### Copilot Features
|
|
- Powered by Microsoft Azure OpenAI Service
|
|
- Enterprise-level data privacy compliance
|
|
- Code of Conduct for Azure OpenAI Service adherence
|
|
|
|
---
|
|
|
|
## Security Certifications
|
|
|
|
### ✅ Comprehensive Certification Portfolio
|
|
|
|
**Source:** [Tricentis Security Center](https://security.tricentis.com/)
|
|
|
|
| Certification | Scope |
|
|
|--------------|-------|
|
|
| ISO/IEC 27001 | Information Security Management |
|
|
| ISO/IEC 27701 | Privacy Information Management |
|
|
| ISO 9001 | Quality Management |
|
|
| ISO/IEC 42001 | AI Management (Copilot products) |
|
|
| SOC 2 Type 2 | All cloud products including Testim |
|
|
|
|
### AI-Specific Compliance
|
|
- Adheres to OECD AI principles
|
|
- Transparency, privacy adherence, human control
|
|
- Fair application and accountability
|
|
- Microsoft Azure OpenAI Code of Conduct
|
|
|
|
---
|
|
|
|
## Privacy Framework
|
|
|
|
### Data Processing Agreement
|
|
- Applies to all Tricentis products including Copilot solutions
|
|
- Global data protection laws compliance
|
|
- Data Processing Addendum available
|
|
|
|
### GDPR Compliance
|
|
- Microsoft Azure OpenAI enterprise-level compliance
|
|
- Multi-jurisdictional AI compliance program
|
|
- Data processed in accordance with regional requirements
|
|
|
|
---
|
|
|
|
## Pricing Structure
|
|
|
|
| Plan | Price | Features |
|
|
|------|-------|----------|
|
|
| Community | FREE | Single user, limited tests |
|
|
| Professional | Contact | Team features, increased limits |
|
|
| Enterprise | ~$20K/year | Unlimited usage, full features |
|
|
| Private Cloud | Custom | Dedicated infrastructure |
|
|
|
|
### Enterprise Features
|
|
- SSO integration
|
|
- RBAC (Role-Based Access Control)
|
|
- Audit logs
|
|
- Test export capability
|
|
- Private cloud options
|
|
|
|
---
|
|
|
|
## Verification Sources
|
|
|
|
### Primary Sources (Independently Verified)
|
|
1. [Testim AI Data Usage Policy](https://help.testim.io/docs/ai-data-usage-policy)
|
|
2. [Tricentis Privacy Policy](https://www.tricentis.com/legal-information/privacy-policy)
|
|
3. [Tricentis Security Center](https://security.tricentis.com/)
|
|
4. [Tricentis Trust Page](https://www.tricentis.com/trust)
|
|
|
|
### Key Quotes
|
|
> "Customer data is not used to train Microsoft Azure OpenAI Service models."
|
|
|
|
> "User prompts are used for the chat sessions only and not used for model training purposes."
|
|
|
|
> "Protecting customers' data is central to what Tricentis does."
|
|
|
|
---
|
|
|
|
## Enterprise Recommendation
|
|
|
|
### ✅ APPROVED FOR ENTERPRISE USE
|
|
|
|
**Why Testim is enterprise-ready:**
|
|
|
|
1. **Explicit no-training policy** - Clear documentation
|
|
2. **Short data retention** - 24-hour maximum for prompts
|
|
3. **Comprehensive certifications** - ISO 27001, SOC 2, ISO 42001 (AI)
|
|
4. **Part of Tricentis** - Established enterprise vendor
|
|
5. **OECD AI principles** - Responsible AI commitment
|
|
|
|
### Best For
|
|
- ✅ AI-assisted test automation
|
|
- ✅ Self-healing tests
|
|
- ✅ Natural language test authoring
|
|
- ✅ Enterprise teams needing compliance
|
|
|
|
---
|
|
|
|
## Comparison to Alternatives
|
|
|
|
| Tool | Training Policy | Certifications | Rating |
|
|
|------|----------------|----------------|--------|
|
|
| **Testim** | ✅ No training | ISO 27001, SOC 2, ISO 42001 | ✅ High |
|
|
| Applitools | ✅ No training | SOC 2, ISO 27001 | ✅ High |
|
|
| Virtuoso | 🚨 Trains by default | SOC 2 | ⚠️ Caution |
|
|
|
|
---
|
|
|
|
## Conclusion
|
|
|
|
Testim provides **clear, documented data protection** with explicit statements that customer data is not used for AI training. The comprehensive certification portfolio (including AI-specific ISO 42001) demonstrates serious commitment to enterprise security.
|
|
|
|
**For Hackathon:** ✅ Can use with enterprise code - explicit no-training policy.
|
|
|
|
---
|
|
|
|
**Verification Date:** February 2, 2026
|
|
**Verified By:** Claude Code (Independent Research)
|
|
**Confidence Level:** HIGH (Official documentation verified)
|