Skip to content
This repository was archived by the owner on Nov 22, 2022. It is now read-only.

Testing

Jump to bottom
Maciej edited this page Jun 15, 2020 · 4 revisions

Data test setup.

Data tests piggy-back on top of MyPy internal utilities.

To make them work properly we need:

  • MYPY_TEST_PREFIX variable pointing to pyspark-stubs root.
  • MYPYPATH variable point to third_party/3 subdirectory.

Combined we have to run pytest in a setup equivalent to

MYPY_TEST_PREFIX=$PWD MYPYPATH=$PWD/third_party/3 pytest

See Travis configuration for details.

Speeding-up data tests.

Unfortunately data test are very slow. However, they're not computationally intensive are parallelize well.

pytest-xdist does a pretty good job here:

Clone this wiki locally