Although the ETSF test farm might be accessed independently of buildbot, the usual mode of interaction with the test farm is through the buildbot system. In the following, we suppose that you are a well-identified developer of ABINIT, hence, you have your own git branches.
There are two ways to trigger the tests on the test farm:
You will receive by mail the results of the execution of the tests, concerning each nightly worker, one for each worker. Congratulation if your compilation succeeded, all the tests succeeded, etc !
Let's now analyze what to do in case of failure. The mail from buildbot is rather self-explanatory, and one is quickly lead, through hyperlinks (“further details”) to a list of the steps that were executed by buildbot, the failing one being indicated in red.
If it is step “10 make_core”, you have to click on the “10.2 make” or “10.3 stderr” hyperlink, and you will see the usual log/err file produced by the compiler. In case you would like to have direct access on the machine, this is possible, see below.
If it is step “12 testsuite”, you have to click on the “12.4 summary” hyperlink, to identify whether tests “passed” or “failed”, and to identify the test directories where such things happened. Remember : on the reference machine “abiref”, all tests must “succeed”, while on the other machines, no one test can “fail”, but a “pass” is OK. More execution information is found in the “12.2 xreport” hyperlink.
In order to correct the test in the other series, use “12.5 All Results” hyperlink to identify precisely the tests that must be corrected.
The links “12.1 stdio” and “12.3 testsbot” are not very often used in the debugging process by standard users, but more by the maintainers.
12.1 stdio = the stdout of buildbot (Usually NOT useful for debugging) 12.2 xreport = detailed output of execution 12.3 testbot = output of the configuration use to drive // tests (Usually NOT useful for debugging) 12.4 summary = a short table, summarizing the status (succeeded, passed, failed) of the tests, per directory 12.5 All Results = all results grouped by number of "cpu" (np= 1,2,4,10,...).
In order to correct the test in the “22. abirules” or “23. buildsys” series executed with abiref_gnu_5.3_debug, the “diff” hyperlink will likely be the most useful for you to correct your source code. Perhaps you will need also to complete the information from “22.4 log” by a look to the “20.2 make” hyperlink. Do not hesitate to contact Xavier Gonze to find some reasonably elegant way to get rid of the “unused variable” or “unused arguments” problems in delicate cases.
If you have git branches, you are entitled to have interactive access to each of the workers. Moreover, you can login as “buildbot” user, and place yourself as if you were the one who just made the run reported in the mail that you received. Hence, you are directly placed in an environment ready to debug.
Host abifarm Hostname hall.abinit.org Port XXXX User USERNAME IdentityFile ~/.ssh/id_rsa_abinit
and use
ssh abifarm
