Files
ai_tools_analysis/evaluation_testing_testim_verified.md
T
olegs eeacc30b48 Refactor evaluations and documentation for AI tools
- Updated README.md to reflect independently verified evaluations by Claude as of February 2026, including new sections for verified tools and their privacy policies.
- Revised SUMMARY_REPORT.md to include independent verification status for tools, updated file inventory, and added a summary of verified evaluations.
- Created detailed evaluation files for independently verified tools: UX Pilot, Lovable, Galileo AI, Diffblue Cover, BrowserStack, Testim.
- Enhanced evaluation content with verified sources, key findings, and recommendations for enterprise use.
- Emphasized data privacy policies and compliance for each tool, highlighting critical issues and recommendations for enterprise users.
2026-02-02 13:59:50 +02:00

179 lines
5.4 KiB
Markdown

# Testim (Tricentis) - Enterprise Evaluation
**Tool:** Testim (part of Tricentis)
**Category:** Testing (AI-assisted Test Automation)
**Evaluation Status:** ✅ INDEPENDENTLY VERIFIED (Claude Research - February 2026)
**Recommendation:** ✅ **APPROVED** - Enterprise-ready with strong data protection
---
## Executive Summary
Testim is an AI-powered test automation platform acquired by Tricentis. Independent verification confirms that **customer data is NOT used for AI model training**, with clear data handling policies and comprehensive security certifications.
---
## Data Training Policy
### ✅ VERIFIED: NO TRAINING ON CUSTOMER DATA
**Source:** [Testim AI Data Usage Policy](https://help.testim.io/docs/ai-data-usage-policy)
**Key Findings:**
1. **No AI model training on customer data:**
> "Customer data is not used to train Microsoft Azure OpenAI Service models."
> "User prompts are used for the chat sessions only and not used for model training purposes, or any other purposes."
2. **Prompt content protection:**
> "The prompt content is not used for model training purposes."
3. **Data isolation:**
> Data is "isolated from other data" and cannot be traced back to user or company
---
## Data Retention
### Retention Periods
| Data Type | Retention Period |
|-----------|-----------------|
| User prompts | Up to 24 hours |
| Session data | Duration of chat session |
| Test artifacts | Per customer agreement |
### Key Protections
- Pseudo-random session IDs prevent tracing
- Microsoft temporary storage for abuse monitoring only
- All data stored and processed in US
---
## AI Technology
### Smart Locators
- AI runs in **real-time**, not trained on customer apps
- Uses pattern recognition for element identification
- 95%+ self-healing capability
- No customer app data retained for training
### Copilot Features
- Powered by Microsoft Azure OpenAI Service
- Enterprise-level data privacy compliance
- Code of Conduct for Azure OpenAI Service adherence
---
## Security Certifications
### ✅ Comprehensive Certification Portfolio
**Source:** [Tricentis Security Center](https://security.tricentis.com/)
| Certification | Scope |
|--------------|-------|
| ISO/IEC 27001 | Information Security Management |
| ISO/IEC 27701 | Privacy Information Management |
| ISO 9001 | Quality Management |
| ISO/IEC 42001 | AI Management (Copilot products) |
| SOC 2 Type 2 | All cloud products including Testim |
### AI-Specific Compliance
- Adheres to OECD AI principles
- Transparency, privacy adherence, human control
- Fair application and accountability
- Microsoft Azure OpenAI Code of Conduct
---
## Privacy Framework
### Data Processing Agreement
- Applies to all Tricentis products including Copilot solutions
- Global data protection laws compliance
- Data Processing Addendum available
### GDPR Compliance
- Microsoft Azure OpenAI enterprise-level compliance
- Multi-jurisdictional AI compliance program
- Data processed in accordance with regional requirements
---
## Pricing Structure
| Plan | Price | Features |
|------|-------|----------|
| Community | FREE | Single user, limited tests |
| Professional | Contact | Team features, increased limits |
| Enterprise | ~$20K/year | Unlimited usage, full features |
| Private Cloud | Custom | Dedicated infrastructure |
### Enterprise Features
- SSO integration
- RBAC (Role-Based Access Control)
- Audit logs
- Test export capability
- Private cloud options
---
## Verification Sources
### Primary Sources (Independently Verified)
1. [Testim AI Data Usage Policy](https://help.testim.io/docs/ai-data-usage-policy)
2. [Tricentis Privacy Policy](https://www.tricentis.com/legal-information/privacy-policy)
3. [Tricentis Security Center](https://security.tricentis.com/)
4. [Tricentis Trust Page](https://www.tricentis.com/trust)
### Key Quotes
> "Customer data is not used to train Microsoft Azure OpenAI Service models."
> "User prompts are used for the chat sessions only and not used for model training purposes."
> "Protecting customers' data is central to what Tricentis does."
---
## Enterprise Recommendation
### ✅ APPROVED FOR ENTERPRISE USE
**Why Testim is enterprise-ready:**
1. **Explicit no-training policy** - Clear documentation
2. **Short data retention** - 24-hour maximum for prompts
3. **Comprehensive certifications** - ISO 27001, SOC 2, ISO 42001 (AI)
4. **Part of Tricentis** - Established enterprise vendor
5. **OECD AI principles** - Responsible AI commitment
### Best For
- ✅ AI-assisted test automation
- ✅ Self-healing tests
- ✅ Natural language test authoring
- ✅ Enterprise teams needing compliance
---
## Comparison to Alternatives
| Tool | Training Policy | Certifications | Rating |
|------|----------------|----------------|--------|
| **Testim** | ✅ No training | ISO 27001, SOC 2, ISO 42001 | ✅ High |
| Applitools | ✅ No training | SOC 2, ISO 27001 | ✅ High |
| Virtuoso | 🚨 Trains by default | SOC 2 | ⚠️ Caution |
---
## Conclusion
Testim provides **clear, documented data protection** with explicit statements that customer data is not used for AI training. The comprehensive certification portfolio (including AI-specific ISO 42001) demonstrates serious commitment to enterprise security.
**For Hackathon:** ✅ Can use with enterprise code - explicit no-training policy.
---
**Verification Date:** February 2, 2026
**Verified By:** Claude Code (Independent Research)
**Confidence Level:** HIGH (Official documentation verified)