TestRail

This guide explains how to extract test cases from TestRail and convert them into TestDriver YAML test files. By automating this process, you can ensure that your TestRail test cases are directly translated into actionable tests for TestDriver.

Workflow overview

Export Test Cases from TestRail: Use the TestRail API to fetch test cases.
Convert Test Cases to TestDriver YAML: Transform the test cases into YAML test files.
Save and Organize Test Files: Store the generated YAML files in a structured directory.
Run Tests with TestDriver: Execute the tests using the TestDriver CLI.

Step 1: Export test cases from TestRail

Prerequisites

TestRail API Key: Obtain your API key from TestRail.
TestRail Base URL: Your TestRail instance URL (for example, https://yourcompany.testrail.io).
Node.js: Ensure Node.js is installed on your system.

Script: Export test cases from TestRail

The following script fetches TestRail test cases and extracts the title and steps.

Install dependencies:

npm install axios yaml fs

Node.js script (`export-testrail-test-cases.js`):

const axios = require("axios");
const yaml = require("yaml");
const fs = require("fs");
const path = require("path");

// TestRail credentials
const TESTRAIL_BASE_URL = "https://yourcompany.testrail.io";
const TESTRAIL_USERNAME = "your-email@example.com";
const TESTRAIL_API_KEY = "your-api-key";
const TESTRAIL_PROJECT_ID = 1; // Replace with your TestRail project ID

// Output directory
const OUTPUT_DIR = "./testdriver_tests";

// Ensure the output directory exists
if (!fs.existsSync(OUTPUT_DIR)) {
  fs.mkdirSync(OUTPUT_DIR, { recursive: true });
}

// Fetch TestRail test cases
async function fetchTestRailTestCases() {
  try {
    const response = await axios.get(
      `${TESTRAIL_BASE_URL}/index.php?/api/v2/get_cases/${TESTRAIL_PROJECT_ID}`,
      {
        auth: {
          username: TESTRAIL_USERNAME,
          password: TESTRAIL_API_KEY,
        },
        headers: {
          "Content-Type": "application/json",
        },
      },
    );

    const testCases = response.data.map((testCase) => ({
      id: testCase.id,
      title: testCase.title,
      steps: testCase.custom_steps || "No steps provided", // Replace `custom_steps` with the field ID for test steps if applicable
    }));

    // Process each test case
    testCases.forEach((testCase) => createYamlFile(testCase));
    console.log(`Exported ${testCases.length} test cases to ${OUTPUT_DIR}`);
  } catch (error) {
    console.error("Error fetching TestRail test cases:", error.message);
  }
}

// Create a YAML file for each test case
function createYamlFile(testCase) {
  const steps = testCase.steps.split("\n").map((step) => ({
    prompt: step.trim(),
  }));

  const yamlContent = {
    version: "4.2.18",
    steps,
  };

  const fileName = `test_${testCase.id}.yaml`;
  const filePath = path.join(OUTPUT_DIR, fileName);

  fs.writeFileSync(filePath, yaml.stringify(yamlContent), "utf8");
  console.log(`Created file: ${filePath}`);
}

// Run the script
fetchTestRailTestCases();

Step 2: Convert test cases to TestDriver YAML

The script above generates a YAML file for each TestRail test case. Each file contains the steps as prompt entries.

Example

testdriver/test_123.yaml

version: 6.0.0
steps:
  - prompt: Navigate to the login page.
  - prompt: Enter valid credentials.
  - prompt: Click the "Log In" button.
  - prompt: Verify the dashboard is displayed.

Step 3: Save and organize test files

The generated YAML files will be saved in the testdriver/ directory.
Ensure the directory is part of your TestDriver project structure.

Step 4: Run tests with TestDriver

Use the TestDriver CLI to execute the generated test files.

Run a Single test file:

npx testdriverai@latest run testdriver/test_123.yaml

Best practices

Field Mapping: Ensure the correct TestRail field ID (for example, custom_steps) is used for test steps.
Secure Credentials: Store TestRail API credentials in environment variables or secrets.
Review Generated Files: Manually review the YAML files to ensure they align with your testing requirements.
Organize Tests: Use a structured directory (for example, testdriver/) to manage your test files.

Summary

By following this guide, you can automate the process of importing test cases from TestRail into TestDriver test files. This ensures that your test steps are directly translated into actionable tests, streamlining your testing workflows and improving coverage.

Overview

Get Started

Examples

Guide

Reference

Workflow overview

Step 1: Export test cases from TestRail

Prerequisites

Script: Export test cases from TestRail

Install dependencies:

Node.js script (`export-testrail-test-cases.js`):

Step 2: Convert test cases to TestDriver YAML

Example

Step 3: Save and organize test files

Step 4: Run tests with TestDriver

Run a Single test file:

Best practices

Summary

​Workflow overview

​Step 1: Export test cases from TestRail

​Prerequisites

​Script: Export test cases from TestRail

​Install dependencies:

​Node.js script (export-testrail-test-cases.js):

​Step 2: Convert test cases to TestDriver YAML

​Example

​Step 3: Save and organize test files

​Step 4: Run tests with TestDriver

​Run a Single test file:

​Best practices

​Summary

Workflow overview

Step 1: Export test cases from TestRail

Prerequisites

Script: Export test cases from TestRail

Install dependencies:

Node.js script (`export-testrail-test-cases.js`):

Step 2: Convert test cases to TestDriver YAML

Example

Step 3: Save and organize test files

Step 4: Run tests with TestDriver

Run a Single test file:

Best practices

Summary