Skip to main content

Common Workflows

Practical examples of typical TDMP tasks and workflows.

Generating your first dataset​

Goal: Create test data for a new feature.

  1. Create or open a project
  2. Add or select a schema
  3. Define constraints (optional)
  4. Set record count
  5. Click "Generate Dataset"
  6. Monitor generation progress
  7. Download when complete

See Generating Datasets for detailed steps.

Setting up CI/CD automation​

Goal: Generate fresh test data before each test run.

  1. Create a dedicated project for automation
  2. Configure and test your constraint set
  3. Get API credentials (Settings → Tokens)
  4. Note project ID, schema ID, and constraint set ID
  5. Use API to trigger generation in your pipeline
  6. Poll for completion status
  7. Download generated files

See API Overview for code examples.

Sharing schemas with your team​

Goal: Make a schema available to other testers.

  1. Create a project and invite team members
  2. Link schema to the project
  3. Create example constraint sets
  4. Notify team members of schema name and location

Team members will see the schema when creating datasets in the project.

Goal: Generate data with relationships (e.g., users and their orders).

Approach 1 - Sequential generation:

  1. Generate parent data (users) with unique IDs
  2. Note the ID range
  3. Generate child data (orders) with constraints referencing parent IDs
  4. Import parent data first, then child data

Approach 2 - Separate projects:

  1. Maintain one project for users, one for orders
  2. Keep constraint sets that reference known ID ranges
  3. Regenerate both when needed

Troubleshooting failed generations​

Common issues:

  • Conflicting constraints: Review rules for contradictions (e.g., min > max)
  • Invalid schema: Verify schema matches current data structure
  • Complex constraints: Start with simpler rules and add complexity gradually
  • Large record counts: Try smaller batches first (100 records) to test configuration

See FAQ for more troubleshooting tips.

Exporting to external systems​

Goal: Send generated data to S3, database, or other services.

  1. Configure integration in Integrations page
  2. Test the connection
  3. When generating a dataset, select the integration as destination
  4. Data is automatically exported upon completion

See Integrations for supported services.

Monitoring team activity​

Goal: Track usage and identify patterns (Admins only).

  1. Go to Analytics to see generation volume and trends
  2. Go to Admin → Audit Logs to see user actions
  3. Review most-used schemas and constraint sets
  4. Identify opportunities for shared resources

Working offline with exports​

Goal: Use generated data in local environment without TDMP access.

  1. Generate dataset with required format (CSV, JSON, XML, SQL)
  2. Download all files
  3. Import into local database or test framework
  4. Re-generate periodically to refresh data

Note dataset name and settings for reproducibility.