Skip to content

Commit 320e69d

Browse files
authored
Merge pull request #3227 from vkarak/feat/compare-past-results
[feat] Introduce permanent result storage and support performance results comparisons between runs
2 parents 2b3e552 + 2572d1f commit 320e69d

31 files changed

+3728
-1802
lines changed

docs/config_reference.rst

Lines changed: 56 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -60,6 +60,13 @@ It consists of the following properties, which we also call conventionally *conf
6060

6161
A list of `general configuration objects <#general-configuration>`__.
6262

63+
.. py:data:: storage
64+
65+
:required: No
66+
67+
A list of :ref:`storage configuration objects <storage-configuration>`
68+
69+
.. versionadded:: 4.7
6370

6471
.. py:data:: autodetect_methods
6572
@@ -432,6 +439,16 @@ System Partition Configuration
432439
No other test would be able to proceed.
433440

434441

442+
.. py:attribute:: systems.partitions.sched_options.unqualified_hostnames
443+
444+
:required: No
445+
:default: ``false``
446+
447+
Use unqualified hostnames in the ``local`` scheduler backend.
448+
449+
.. versionadded:: 4.7
450+
451+
435452
.. py:attribute:: systems.partitions.sched_options.use_nodes_option
436453
437454
:required: No
@@ -1602,6 +1619,31 @@ The options of an execution mode will be passed to ReFrame as if they were speci
16021619
For a detailed description of this property, have a look at the :attr:`~environments.target_systems` definition for environments.
16031620

16041621

1622+
.. _storage-configuration:
1623+
1624+
Result storage configuration
1625+
============================
1626+
1627+
.. versionadded:: 4.7
1628+
1629+
.. py:attribute:: storage.backend
1630+
1631+
:required: No
1632+
:default: ``"sqlite"``
1633+
1634+
The backend to use for storing the test results.
1635+
1636+
Currently, only Sqlite can be used as a storage backend.
1637+
1638+
1639+
.. py:attribute:: storage.sqlite_db_file
1640+
1641+
:required: No
1642+
:default: ``"${HOME}/.reframe/reports/results.db"``
1643+
1644+
The Sqlite database file to use.
1645+
1646+
16051647
General Configuration
16061648
=====================
16071649

@@ -1859,6 +1901,20 @@ General Configuration
18591901
For a detailed description of this property, have a look at the :attr:`~environments.target_systems` definition for environments.
18601902

18611903

1904+
.. py:attribute:: general.table_format
1905+
1906+
:required: No
1907+
:default: ``"pretty"``
1908+
1909+
Set the formatting of tabular output.
1910+
1911+
The acceptable values are the following:
1912+
1913+
- ``csv``: Generate CSV output
1914+
- ``plain``: Generate a plain table without any lines
1915+
- ``pretty``: (default) Generate a pretty table
1916+
1917+
18621918
.. py:attribute:: general.timestamp_dirs
18631919
18641920
:required: No

0 commit comments

Comments
 (0)