217 lines
7.7 KiB
Markdown
217 lines
7.7 KiB
Markdown
# Testim (Tricentis Testim) - Enterprise Compatibility Evaluation
|
|
|
|
## Tool Overview
|
|
**Name:** Testim (now part of Tricentis)
|
|
**Website:** https://testim.io
|
|
**Category:** AI-Assisted Test Automation Platform
|
|
**Date Evaluated:** 2026-02-02
|
|
|
|
---
|
|
|
|
## Privacy & Enterprise Use
|
|
|
|
### Commercial/Enterprise Use Permission
|
|
**Status:** ✅ APPROVED FOR ENTERPRISE USE
|
|
|
|
**Key Findings:**
|
|
- AI-assisted test automation platform (now part of Tricentis)
|
|
- Built for Agile teams and enterprise environments
|
|
- Allows recording and running functional UI tests
|
|
- Web IDE and cloud test execution
|
|
- Designed for enterprise scale with SSO, role-based access, audit logs
|
|
|
|
### Model Training on User Data
|
|
**Status:** ✅ NO CUSTOMER DATA USED FOR TRAINING
|
|
|
|
**Key Findings:**
|
|
- **Testim DOES NOT use your application code/data to train general models**
|
|
- "Smart Locators" AI uses algorithms that run on-the-fly on your app's DOM during tests
|
|
- AI is not trained on your application data - it analyzes DOM in real-time
|
|
- All test data treated as "highly sensitive" per security whitepaper
|
|
- No customer data repurposed for AI training globally
|
|
|
|
**Enterprise Consideration:**
|
|
- Security whitepaper confirms: "All customer data is highly sensitive and transmitted securely"
|
|
- Test artifacts never exposed to other users
|
|
- Strict access controls - only your team can see your test projects
|
|
|
|
### Data Retention Policies
|
|
**Status:** ⚠️ NOT EXPLICITLY PUBLIC (Enterprise Negotiable)
|
|
|
|
**Key Findings:**
|
|
- Test history (logs, screenshots) stored in secure cloud database
|
|
- Available on your dashboard until you delete it
|
|
- No fixed retention period published
|
|
- Enterprise customers can negotiate data retention durations
|
|
- You control deletion through dashboard
|
|
|
|
### Data Sharing Practices
|
|
**Status:** ✅ NO SHARING - ISOLATED ENVIRONMENTS
|
|
|
|
**Third-Party Sharing:**
|
|
- No sharing with third parties
|
|
- Each customer's environment isolated
|
|
- Test projects only accessible to your team (and Testim support with permission)
|
|
- Data never exposed to other users
|
|
|
|
**Infrastructure:**
|
|
- Encryption at rest and in transit
|
|
- Secure cloud database storage
|
|
- Strict access controls
|
|
- Only your team + Testim support (with explicit permission) can access your tests
|
|
|
|
### IP & Confidentiality Concerns
|
|
**Status:** ✅ STRONG IP PROTECTION
|
|
|
|
**Intellectual Property:**
|
|
- You own the test scripts you create
|
|
- You can export tests as code if you leave
|
|
- Test export option available (can export tests as code)
|
|
- Testim doesn't claim ownership of your test artifacts
|
|
|
|
**Confidentiality:**
|
|
- All test data encrypted at rest and in transit
|
|
- Testim assumes all customer data is "highly sensitive"
|
|
- No sharing between customer accounts
|
|
- NDAs likely available for enterprise (not explicitly mentioned but standard)
|
|
|
|
---
|
|
|
|
## Pricing & Plans
|
|
|
|
### Free Tier
|
|
**Availability:** ✅ YES - Community Free Plan
|
|
|
|
**Features Included:**
|
|
- Limited free tier (after trial)
|
|
- Single-user access
|
|
- Limited parallel test runs
|
|
- Basic test authoring
|
|
|
|
**Limitations:**
|
|
- Test runs: Limited (likely 1 concurrent test)
|
|
- Users: Single-user
|
|
- Low monthly test executions
|
|
- Limited integrations
|
|
|
|
### Paid Plans
|
|
|
|
#### Team/Enterprise Plans
|
|
**Price:** Custom pricing ("Contact Us")
|
|
**Estimated Range:** ~$20k/year for unlimited usage (per community sources)
|
|
|
|
**Features:**
|
|
- Test grids for cross-browser testing
|
|
- Multiple parallel test executions
|
|
- Integrations with CI/CD tools
|
|
- Advanced features (Smart Locators, self-healing)
|
|
- SSO and role-based access control
|
|
- Audit logs
|
|
- Priority support
|
|
- Web, Mobile, and Salesforce test packages
|
|
|
|
#### Private Cloud/On-Premise Option
|
|
**Price:** Custom (for large customers)
|
|
**Features:**
|
|
- Tricentis often offers on-prem for large customers
|
|
- Maximum security for sensitive environments
|
|
|
|
### Usage Limits
|
|
- **Free/Community:** 1 concurrent test, low monthly executions
|
|
- **Enterprise:** Unlimited test runs on cloud
|
|
- **Parallel executions:** Many parallel executions on paid plans
|
|
- **Storage:** Per account, not publicly specified
|
|
|
|
---
|
|
|
|
## Enterprise Compatibility Assessment
|
|
|
|
### Strengths ✅
|
|
- **NO customer data used for AI training** - AI runs in real-time, not trained on your data
|
|
- All test data treated as "highly sensitive"
|
|
- Encryption at rest and in transit
|
|
- Isolated customer environments
|
|
- SSO, role-based access control, audit logs
|
|
- Built for Agile teams and enterprise use
|
|
- Test export capability (you own your tests)
|
|
- Part of Tricentis (established enterprise testing vendor)
|
|
- Private cloud/on-prem options available for sensitive orgs
|
|
- Smart Locators and self-healing reduce maintenance
|
|
|
|
### Concerns 🟡
|
|
- **Minor:** Test data stored in Testim's cloud (mitigated by encryption + private cloud option)
|
|
- Data retention period not publicly specified (enterprise can negotiate)
|
|
- Requires trust in cloud service provider (standard for SaaS testing tools)
|
|
- No published pricing (must contact sales)
|
|
|
|
### Recommendations
|
|
|
|
**✅ APPROVED FOR ENTERPRISE USE - NO RESTRICTIONS**
|
|
|
|
**For Enterprise Use:**
|
|
- **Safe to use immediately** - meets enterprise privacy requirements
|
|
- No customer data used for AI training
|
|
- Strong encryption and access controls
|
|
- Consider private cloud/on-prem for extremely sensitive environments
|
|
- Negotiate data retention terms in enterprise contract
|
|
|
|
**Best For:**
|
|
- Organizations requiring strict data confidentiality
|
|
- Functional UI test automation
|
|
- Teams needing AI-assisted self-healing tests
|
|
- Companies with "zero customer data for AI training" policies
|
|
- Agile teams needing fast test authoring
|
|
|
|
**Deployment Options:**
|
|
1. **Cloud SaaS** (default): Secure cloud with encryption, isolated environments
|
|
2. **Private Cloud/On-Prem**: Available for large enterprise customers requiring maximum control
|
|
|
|
**For Hack Days:**
|
|
- ✅ Safe to use for prototypes and internal applications
|
|
- Community free plan sufficient for testing during hackathon
|
|
- Only front-end of application accessed during test execution (similar to any cloud test tool)
|
|
- Test scripts and results kept confidential in your workspace
|
|
|
|
**Comparison to Alternatives:**
|
|
- **vs. Virtuoso:** Testim does NOT use customer data for training (major advantage)
|
|
- **vs. Applitools:** Both are enterprise-safe; Testim focuses on functional tests, Applitools on visual tests
|
|
- **vs. BrowserStack:** Testim provides test authoring + execution; BrowserStack provides test infrastructure
|
|
|
|
---
|
|
|
|
## Sources & References
|
|
|
|
1. **ChatGPT Evaluation Report** - Testim analysis (C:\source\repos\ai_tools_evaluation\chatGPT_report.md)
|
|
2. **Testim Website**: https://testim.io
|
|
3. **Security Whitepaper**: "All customer data highly sensitive and transmitted securely"
|
|
4. **Privacy Policy**: https://testim.io/privacy-policy/
|
|
5. **Terms of Service**: https://testim.io/terms-of-service/
|
|
6. **Pricing**: Custom pricing, community estimates ~$20k/year for unlimited
|
|
7. **Training Policy**: "Smart Locators AI runs on-the-fly - does not use your app for training"
|
|
|
|
---
|
|
|
|
## Notes
|
|
- Last Updated: 2026-02-02
|
|
- Evaluator: Claude Code based on ChatGPT findings
|
|
- **Status:** ENTERPRISE-READY with strong privacy protections
|
|
- **Key Differentiator:** AI self-healing runs in real-time, not trained on customer data
|
|
- **Ownership:** Now part of Tricentis (established enterprise testing company)
|
|
|
|
---
|
|
|
|
## ✅ PROCUREMENT STATUS
|
|
|
|
**This tool is APPROVED for enterprise use without special restrictions.**
|
|
|
|
Testim meets all enterprise requirements:
|
|
- ✅ No customer data used for AI training
|
|
- ✅ All data treated as "highly sensitive"
|
|
- ✅ Encryption at rest and in transit
|
|
- ✅ Isolated customer environments
|
|
- ✅ SSO, RBAC, audit logs
|
|
- ✅ Private cloud/on-prem options available
|
|
- ✅ Test export capability (you own your tests)
|
|
|
|
**Recommended Action:** Approved for immediate use. Consider private cloud for maximum security if handling extremely sensitive data.
|