Integrating Automated Test Cases with TestRail

TestRail is a comprehensive tool to manage, track, and organize test cases. It caters the need to maintain test suites, test cases, and test results. Here, SpecFlow is used to run the test cases.

1. Open your TestRail account and create a new project.
2. Define a test suite within the project containing automated test cases. You may have multiple suites depending upon requirement. While creating a test suite you can add description to explain about the purpose of test suite.
3. The created test suite will not contain any sections or test cases.

A test case is a single test that is executed by testers on a regular basis. Sections can be used to manage related test cases into groups.

4. Create test cases in TestRail representing the automated test case.
5. This completes the creation of 1 test suite containing 1 test case.
6. You can run a single test case multiple times. However, the result might differ each time. Using TestRail you can combine the test cases within a test run and provide a combined result.
7. Enable API for your TestRail project. This can be done by going to the Administration page through Dashboard.
8. Click ‘Manage site settings’ and go to ‘API’ tab and select ‘Enable API’ checkbox.

Note: You can create a dedicated user to have the automated test cases integrate with TestRail.

9. Download the API and extract it to the folder where your solution is located.
10. Add the API to your solution by inserting TestRail.csproj file into your solution using File->Add->Existing Project.
11. Change your .Net framework to version 4.5.
12. Build the Gurock project and add reference to Gurock.TestRail assembly.
13. Add reference to the Newtonsoft JSON library.
14. Create automated test case in SpecFlow by adding the following statements in your binding.

using Gurock.TestRail;

using Newtonsoft.Json;

using Newtonsoft.Json.Linq;

15. Add the following method to the binding.

[AfterScenario]

public static void AfterScenario(){

Gurock.TestRail.APIClient client = new Gurock.TestRail.APIClient(“https://yoursite.testrail.com/”);

client.User = “user@domain.com”; //user e-mail

client.Password = “SpecFlow”; //user password

Dictionary<string, object> testResult = new Dictionary<string, object>();

if(null != ScenarioContext.Current.TestError){

testResult[“status_id”] = “5”; //failed;

testResult[“comment”] = ScenarioContext.Current.TestError.ToString();}

else

{testResult[“status_id”] = “1”; //passed}

client.SendPost(“add_result/1”, testResult); //hardcoded test id.}

16. Run the test and check TestRail getting passed.

   You may also like – How to Manage Test Cases with Test Rail?