olegs/ai_tools_analysis
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
7d6bc20276a9bdab5a0510875c1116dac9c0f1a2
ai_tools_analysis/evaluation_testing_testim_updated.md
T
olegs 6c65691b2e initial
2026-02-02 13:41:43 +02:00

7.7 KiB
Raw Blame History

Testim (Tricentis Testim) - Enterprise Compatibility Evaluation

Tool Overview

Name: Testim (now part of Tricentis) Website: https://testim.io Category: AI-Assisted Test Automation Platform Date Evaluated: 2026-02-02

Privacy & Enterprise Use

Commercial/Enterprise Use Permission

Status: ✅ APPROVED FOR ENTERPRISE USE

Key Findings:

  • AI-assisted test automation platform (now part of Tricentis)
  • Built for Agile teams and enterprise environments
  • Allows recording and running functional UI tests
  • Web IDE and cloud test execution
  • Designed for enterprise scale with SSO, role-based access, audit logs

Model Training on User Data

Status: ✅ NO CUSTOMER DATA USED FOR TRAINING

Key Findings:

  • Testim DOES NOT use your application code/data to train general models
  • "Smart Locators" AI uses algorithms that run on-the-fly on your app's DOM during tests
  • AI is not trained on your application data - it analyzes DOM in real-time
  • All test data treated as "highly sensitive" per security whitepaper
  • No customer data repurposed for AI training globally

Enterprise Consideration:

  • Security whitepaper confirms: "All customer data is highly sensitive and transmitted securely"
  • Test artifacts never exposed to other users
  • Strict access controls - only your team can see your test projects

Data Retention Policies

Status: ⚠️ NOT EXPLICITLY PUBLIC (Enterprise Negotiable)

Key Findings:

  • Test history (logs, screenshots) stored in secure cloud database
  • Available on your dashboard until you delete it
  • No fixed retention period published
  • Enterprise customers can negotiate data retention durations
  • You control deletion through dashboard

Data Sharing Practices

Status: ✅ NO SHARING - ISOLATED ENVIRONMENTS

Third-Party Sharing:

  • No sharing with third parties
  • Each customer's environment isolated
  • Test projects only accessible to your team (and Testim support with permission)
  • Data never exposed to other users

Infrastructure:

  • Encryption at rest and in transit
  • Secure cloud database storage
  • Strict access controls
  • Only your team + Testim support (with explicit permission) can access your tests

IP & Confidentiality Concerns

Status: ✅ STRONG IP PROTECTION

Intellectual Property:

  • You own the test scripts you create
  • You can export tests as code if you leave
  • Test export option available (can export tests as code)
  • Testim doesn't claim ownership of your test artifacts

Confidentiality:

  • All test data encrypted at rest and in transit
  • Testim assumes all customer data is "highly sensitive"
  • No sharing between customer accounts
  • NDAs likely available for enterprise (not explicitly mentioned but standard)

Pricing & Plans

Free Tier

Availability: ✅ YES - Community Free Plan

Features Included:

  • Limited free tier (after trial)
  • Single-user access
  • Limited parallel test runs
  • Basic test authoring

Limitations:

  • Test runs: Limited (likely 1 concurrent test)
  • Users: Single-user
  • Low monthly test executions
  • Limited integrations

Paid Plans

Team/Enterprise Plans

Price: Custom pricing ("Contact Us") Estimated Range: ~$20k/year for unlimited usage (per community sources)

Features:

  • Test grids for cross-browser testing
  • Multiple parallel test executions
  • Integrations with CI/CD tools
  • Advanced features (Smart Locators, self-healing)
  • SSO and role-based access control
  • Audit logs
  • Priority support
  • Web, Mobile, and Salesforce test packages

Private Cloud/On-Premise Option

Price: Custom (for large customers) Features:

  • Tricentis often offers on-prem for large customers
  • Maximum security for sensitive environments

Usage Limits

  • Free/Community: 1 concurrent test, low monthly executions
  • Enterprise: Unlimited test runs on cloud
  • Parallel executions: Many parallel executions on paid plans
  • Storage: Per account, not publicly specified

Enterprise Compatibility Assessment

Strengths ✅

  • NO customer data used for AI training - AI runs in real-time, not trained on your data
  • All test data treated as "highly sensitive"
  • Encryption at rest and in transit
  • Isolated customer environments
  • SSO, role-based access control, audit logs
  • Built for Agile teams and enterprise use
  • Test export capability (you own your tests)
  • Part of Tricentis (established enterprise testing vendor)
  • Private cloud/on-prem options available for sensitive orgs
  • Smart Locators and self-healing reduce maintenance

Concerns 🟡

  • Minor: Test data stored in Testim's cloud (mitigated by encryption + private cloud option)
  • Data retention period not publicly specified (enterprise can negotiate)
  • Requires trust in cloud service provider (standard for SaaS testing tools)
  • No published pricing (must contact sales)

Recommendations

✅ APPROVED FOR ENTERPRISE USE - NO RESTRICTIONS

For Enterprise Use:

  • Safe to use immediately - meets enterprise privacy requirements
  • No customer data used for AI training
  • Strong encryption and access controls
  • Consider private cloud/on-prem for extremely sensitive environments
  • Negotiate data retention terms in enterprise contract

Best For:

  • Organizations requiring strict data confidentiality
  • Functional UI test automation
  • Teams needing AI-assisted self-healing tests
  • Companies with "zero customer data for AI training" policies
  • Agile teams needing fast test authoring

Deployment Options:

  1. Cloud SaaS (default): Secure cloud with encryption, isolated environments
  2. Private Cloud/On-Prem: Available for large enterprise customers requiring maximum control

For Hack Days:

  • ✅ Safe to use for prototypes and internal applications
  • Community free plan sufficient for testing during hackathon
  • Only front-end of application accessed during test execution (similar to any cloud test tool)
  • Test scripts and results kept confidential in your workspace

Comparison to Alternatives:

  • vs. Virtuoso: Testim does NOT use customer data for training (major advantage)
  • vs. Applitools: Both are enterprise-safe; Testim focuses on functional tests, Applitools on visual tests
  • vs. BrowserStack: Testim provides test authoring + execution; BrowserStack provides test infrastructure

Sources & References

  1. ChatGPT Evaluation Report - Testim analysis (C:\source\repos\ai_tools_evaluation\chatGPT_report.md)
  2. Testim Website: https://testim.io
  3. Security Whitepaper: "All customer data highly sensitive and transmitted securely"
  4. Privacy Policy: https://testim.io/privacy-policy/
  5. Terms of Service: https://testim.io/terms-of-service/
  6. Pricing: Custom pricing, community estimates ~$20k/year for unlimited
  7. Training Policy: "Smart Locators AI runs on-the-fly - does not use your app for training"

Notes

  • Last Updated: 2026-02-02
  • Evaluator: Claude Code based on ChatGPT findings
  • Status: ENTERPRISE-READY with strong privacy protections
  • Key Differentiator: AI self-healing runs in real-time, not trained on customer data
  • Ownership: Now part of Tricentis (established enterprise testing company)

✅ PROCUREMENT STATUS

This tool is APPROVED for enterprise use without special restrictions.

Testim meets all enterprise requirements:

  • ✅ No customer data used for AI training
  • ✅ All data treated as "highly sensitive"
  • ✅ Encryption at rest and in transit
  • ✅ Isolated customer environments
  • ✅ SSO, RBAC, audit logs
  • ✅ Private cloud/on-prem options available
  • ✅ Test export capability (you own your tests)

Recommended Action: Approved for immediate use. Consider private cloud for maximum security if handling extremely sensitive data.

Reference in new issue View Git Blame Copy Permalink