@@ -65,3 +65,31 @@ The following things are tested
6565| var | Yes | Yes | Yes | Yes | | |
6666
6767[ ^ 1 ] : ` sum ` and ` prod ` have special type promotion rules.
68+
69+ ## Additional Planned Features
70+
71+ In addition to getting full coverage of the spec, there are some additional
72+ features and improvements for the test suite that are planned. Work on these features
73+ will be guided primarily by concrete needs from library implementers, so if
74+ you are someone using this test suite to test your library, please [ let us
75+ know] ( https://github.com/data-apis/array-api-tests/issues ) the limitations you
76+ come across.
77+
78+ - Making the test suite more usable for partially conforming libraries. Many
79+ tests rely on various functions in the array library to function. This means
80+ that if certain functions aren't implemented, for example, ` asarray() ` or
81+ ` equals() ` , then many tests will not function at all. We want to improve
82+ this situation, so that tests that don't strictly require these functions can
83+ still be run.
84+
85+ - Better reporting. The pytest output can be difficult to parse, especially
86+ when there are many failures. Additionally some error messages can be
87+ difficult to understand without prior knowledge of the test internals.
88+ Better reporting can also make it easier to compare different
89+ implementations by their conformance.
90+
91+ - Better tests for numerical outputs. Right now numerical outputs are either
92+ not tested at all, or only tested against very rough epsilons. This is
93+ partly due to the fact that the spec does not mandate any level of precision
94+ for most functions. However, it may be useful to, for instance, give a
95+ report of how off a given function is from the "expected" exact output.
0 commit comments