TestRail is the only platform that empowers QA teams to build, connect, and optimize all their testing processes. TestRail’s Quality OS centralizes manual and automated test management and gives you visibility into your entire quality operation.
With complete control over your testing, you can manage your team more flexibly and build repeatable, scalable workflows that integrate with your DevOps pipelines. Lift your team out of chaos and toward faster, frictionless releases.
Пікірлер
Hi @TestRail, I have integrated the TestRail with GitHub Actions using the "Specification-First" workflow method in one of my project and its working fine. But one thing I am facing is when there are failed tests, I am not seeing the screenshots attached to these failed tests in the execution(Test Runs & Results). Could you please help me find a way to have the screenshots attached for these failed tests. I am using the Robot Framework for Automation Testing, installed "TestRail CLI" and passing parse_robot -f reports.xml in the TestRail cli command. Thanks
i have 2 doubts 1 - how can i do this on cypress? 2 - on cypress integration, how can i send screenshots with a sucess state?
Hello! Can you tell me how to use specification-first approach via TestNg? I found only in JUnit way...
0:50 is there a way to create/customize a test plan template? I'd like the Description field to be pre-populated with plain text automatically.
HI -Thank you - Can you please let me know if the test cases in JIRA can be mapped to test rail ?
Advanced level: As an Test Automation Engineer, your test cases usually have multiple asserts. Let’s say, each assert should be mapped to a step in TestRail. And when an assert fails, a new screenshot with a random unique ID is created in the reports folder as well as the report.xml itself. The failed assertion isn’t necessarily the first step, that means some assertions already passed and the attachment should be added not to the first step but to step x. How can this be achieved?
An hour absolutely wonderfully spent, gonna share the link with my teammates and search for anything else qa-related by Mike Maliska. Many heartfelt thanks! As a token of appreciation from a QA: 'The phRase you never want to hear:...' ;)
Dear TestRail, I would like to ask you, how to wrap/break long sentences in one cell in the table during writing TestCases. Thank you for your answer Best Regards
I'm beginner QA, just asking if test run and execute are similar
It's no wonder qa engineera aren't writing quality automated tests now. They spend all their time trying to integrate these stupid test case repositories like TestRail and Qase. Playwright. Are you paying attention? Stick to TypeScript and quit this stupid shit.
This is so much bullshit just to get a test repo integration. Can someone please simplify this integration before I have to start a complete software company to do it?
can you share the github link, in the description for reference?
I can see the test name only not all the steps for my test case too
That minute 25:50 Left me with 2 questions. 1- What happens on TestRail when the tester is trying to ReExecute again after the previous reported bug is fixed? A new Execution log(displaying the new day) is started OR is the same as Xray by just continuing the original execution(first execution) ? 2-Does TestRail plugin support this ? kzread.info/dash/bejne/aWaYyJd_psvXYMo.html " Integrating Test Automation and Test Management with Zephyr for Jira " Thank you for this helpful video :)
Thank you for reaching out! In the scenario that a linked defect is closed/fixed, the "reference" field within the TestRail test case will maintain the defect identifier. Maintaining this linkage of defect/issue to your agile defect tracker is considered a best practice for traceability and test quality of record. See more detailed information around defect integrations here: support.testrail.com/hc/en-us/articles/7747333895700-Introduction-to-reference-and-defect-integrations TestRail does have a supporting App that complements the Jira integration. See configuration and features here: support.testrail.com/hc/en-us/articles/7746958913940-TestRail-Jira-App
WHy U guys do not allowed edit shared steps in New TEST CASe
I can see the test name only not all the steps for my test case
It would be great to get a video about the roadmap of TestRail. On which major issues are you working on? What are the next big features we can expect? etc.
Some more questions: * 6:37 Does the CSV import for parameterization tables support CSV files created with a German Excel? I.e. semicolon as column separator and are umlauts imported in the correct encoding? And can the exported files be opened in a German Excel with correct column separation and without Encoding issues? * 9:03 Training Sessions would only be a benefit for us if they are in the native language of our participants. In which languages are the Training Sessions available?
Hi there! Our sales team would be happy to answer any questions you have about how TestRail Enterprise can work for your team. You can get in touch with them here: www.testrail.com/contact-sales/
@@testrail Sure, I could do that. Or you could simply clarify it through the short official channels within your team and then answer me yourself. But of course that would mean real customer service and good community work... No, the questions weren't that important to me to get in touch with the sales team separately. Apart from that, I can guarantee without asking again that this will most probably not work without errors. Because TestRail really has no idea how to properly internationalize their software, which means that there are always encoding errors or problems with date formats, etc. at every turn. (Example: 5:52 column „poland_local“, row number 6) Conclusion: If you want to work properly with non-EN-US localization and file formats: Stay away from TestRail! If I were to ask, the answer from support would surely be the usual: "We have confirmed this issue and we already have an internal ticket open for this. While I don't have the exact timeframe on when this will be fixed. For now, I've added your feedback to the request to help the development team to prioritize the ticket." However, this will not be corrected in the foreseeable future and the ticket will be closed after about a year of waiting with the following explanation: "We are reaching out in regard to the bug that your team has reported. Product management prioritizes bug fixes based on severity and number of impacted customers. This bug is being closed due to age, so we can focus on higher priority bugs that are impacting more customers. Thanks for your patience and understanding." 🤦♂️👎😞
Danke schön 👍
Hi , Does Testrail CLI supports allure report? , do you have any example for Webdriverio framework ?
hello, thanks for this great video, I have a question, is possible to process more than 1 XML report in the CLI? I want to process many results at the same time
Thank you for reaching out! You can merge the reports before uploading the results to TestRail. Check out this example: kzread.info/dash/bejne/hIqIydupd9upm9I.html
Excellent Video, what if I have multiple projects in my organization and I only want the UI Script for one of them. Can this be done? TIA
Yes, you can add context information to the UI script to limit the execution to specific projects. Check out his document: support.testrail.com/hc/en-us/articles/7344009893908#context-information-0-1
Do you have a similar one for a java selenium based project
Unfortunately not, but we're always adding new integration videos here. Stay tuned!
When I run the command I get "Suite ID was not provided in either the result file or the command line.". How/Where do we specify that? Thank you.
Hi there! Our support team would be happy to help. You can submit a technical support ticket here: support.testrail.com/hc/en-us/requests/new?ticket_form_id=7737660359572
How to Integrate TestRail with Behave and Selenium using python? is it possible to upload testresults and screenshot?
Hi there! Our support team can help you out with your specific use case - please reach out to them at support.testrail.com/hc/en-us/requests/new
for #4, you describe recording results, but you haven't covered how to run the tests. I have added a test run, but I have no idea how to execute the test run
Thank you for reaching out! TestRail is not an automation tool. You can execute tests with your automation or CI/CD tool and integrate it with TestRail to automatically send the results.
Nice tutorial! However, I have a question. Suppose we already created a test run using existing test cases in TestRail. How can we update those test cases using TestRail CLI?
Hi there! You can view our TestRail CLI documentation here: support.testrail.com/hc/en-us/sections/12887028378772-TestRail-CLI If your question isn't answered in our documentation, please reach out to our support team and they'd be happy to help you with your unique use case. You can submit a support ticket at support.testrail.com/hc/en-us/requests/new Thanks so much!
Running trcli -y .... doesn't seeam to work with latest Python versions
Thank you for reaching out! The TestRail CLI should work with Python 3.10 and higher. Which version are you using and what error are you getting?
How do I run the srcipt to send results to testrail?@@testrail
When I run the above script wiith Python 3.12.0 I get ,command not found error in the teerminal
Confirming that we get "'trcli' is not recognized as an internal or external command," on python 3.12.0, after running pip install trcli.
@@testrail I'm getting this "Installing collected packages: typing_inspect, ruamel.yaml, rfc3339-validator, jinja2, colorama, charset-normalizer, chardet, certifi, casefy, beartype, attrs, tqdm, requests, pyserde, jsonschema, click, prance, openapi-schema-validator, jsonschema-spec, openapi-spec-validator, trcli WARNING: Failed to write executable - trying to use .deleteme logic ERROR: Could not install packages due to an OSError: [WinError 2] The system cannot find the file specified: 'C:\\Python312\\Scripts\ ormalizer.exe' -> 'C:\\Python312\\Scripts\ ormalizer.exe.deleteme'" I have Python v3.12.3, pip 24.0
It's clear how to match my test cases from code to tests in TestRail using automation_id. However, I'm facing an issue with matching them to the correct sections. Every time I run the TestRail CLI, it creates new empty sections. It seems to recognize my cases but not the sections. I find the section names like tests/api-tests/deposit/invoiceless/test.ts to be uncomfortable and not intuitive. Is there a way to have the CLI recognize my existing sections or to customize the section names for better organization? Thank you!
Thank you for reaching out! The CLI does not support your use case for now. Please, create an issue in GitHub so we can further improve the CLI features to meet your needs: github.com/gurock/trcli
Hello usually I use the Jenkins pipeline for running my regression testing this pipeline contains a few Jobs and each of the Jobs generates its own Junit XML report. And my question is how can I upload these test results to TestRail into the same Test Run? Without creating a new Test Run for each Junit file.
Thank you for reaching out! The CLI does not support your use case for now. Please, create an issue in GitHub so we can further improve the CLI features to meet your needs: github.com/gurock/trcli
For those who needed. From playwright.config ['list'], ['html', { outputFolder: 'reports', open: 'never' }], ['junit', { outputFile: './test-results/junit-report.xml', embedAnnotationsAsProperties: true }]
thanks
what if I already have test case created and I just want to run them, where do add the test case ID for the existing test cases? otherwise it will create new test cases each time I run the cli command right?
Hi, thank you for reaching out! The TestRail CLI can map the test cases and they will not be duplicated. You can add the case ID in the name of the test or set a JUnit property. Read more here: support.testrail.com/hc/en-us/articles/12609869124116#mapping-test-cases-0-1
my requirement is that I need to pass the value of the custom field in test rail to a field in the webpage. How to do that?
Hi there! Our support team can help you out with your specific use case - please reach out to them at support.testrail.com/hc/en-us/requests/new
Great presentation - сompact and sharp. Love it
But if i want to complete my test cases adding the steps (Step description and Expected Result) in the code, how can i do it? Is it possible? Because i want to add my test cases but not empty
@TestRail can you reply pls?
Hello! Im trying to merge the reports using junitparser merge --glob "reports/TEST-*" "reports/junit-report.xml" but is not working, do we have another method for that? cheers in advance
How to restore deleted section on testrails?
It dependes on your configuration and if the section has been permanently deleted. Check out this article to learn more: support.testrail.com/hc/en-us/articles/7101747563028-Moving-copying-deleting-and-restoring-test-cases#deleting-and-restoring-test-cases-0-3
How to automatically add new TestCases to Test Runs by using dynamic filtering? My TestCases, created via API are matching the dynamic filtering criterias of the Run but the Cases aren’t automatically added to the run. When I create the Case with the same settings via Web frontend, the case is added. When I edit and save the run without changes, the Cases created via API are also added. But there is always manual work to do. Is there a way to achieve this without manual rework?
Good question. Also trying to find the answer how to create test runs including dynamic filters via API.
Nice video, any plans for getting a Java-based CLI?
No plans for a Java-based CLI for now. But you can request that feature directly with our support team here: support.testrail.com/hc/en-us/requests/new
@@testrail okay, I will get in touch. Installing python sounded like an overhead to me
Is there any way I can create dynamic report /dashboard in test rail? i.e if I need to get my test runs data based on date filter every time instead of creating new report every time
Thanks for sharing