doc: migrate examples in testers chapter to admonitions (#275791)

This commit is contained in:
Daniel Sidhion 2023-12-21 03:54:32 -08:00 committed by GitHub
parent 20a9e5cfe9
commit 292ea0d917
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23

View file

@ -1,4 +1,5 @@
# Testers {#chap-testers} # Testers {#chap-testers}
This chapter describes several testing builders which are available in the `testers` namespace. This chapter describes several testing builders which are available in the `testers` namespace.
## `hasPkgConfigModules` {#tester-hasPkgConfigModules} ## `hasPkgConfigModules` {#tester-hasPkgConfigModules}
@ -6,19 +7,11 @@ This chapter describes several testing builders which are available in the `test
<!-- Old anchor name so links still work --> <!-- Old anchor name so links still work -->
[]{#tester-hasPkgConfigModule} []{#tester-hasPkgConfigModule}
Checks whether a package exposes a given list of `pkg-config` modules. Checks whether a package exposes a given list of `pkg-config` modules.
If the `moduleNames` argument is omitted, `hasPkgConfigModules` will If the `moduleNames` argument is omitted, `hasPkgConfigModules` will use `meta.pkgConfigModules`.
use `meta.pkgConfigModules`.
Example: :::{.example #ex-haspkgconfigmodules-defaultvalues}
```nix # Check that `pkg-config` modules are exposed using default values
passthru.tests.pkg-config = testers.hasPkgConfigModules {
package = finalAttrs.finalPackage;
moduleNames = [ "libfoo" ];
};
```
If the package in question has `meta.pkgConfigModules` set, it is even simpler:
```nix ```nix
passthru.tests.pkg-config = testers.hasPkgConfigModules { passthru.tests.pkg-config = testers.hasPkgConfigModules {
@ -28,6 +21,21 @@ passthru.tests.pkg-config = testers.hasPkgConfigModules {
meta.pkgConfigModules = [ "libfoo" ]; meta.pkgConfigModules = [ "libfoo" ];
``` ```
:::
:::{.example #ex-haspkgconfigmodules-explicitmodules}
# Check that `pkg-config` modules are exposed using explicit module names
```nix
passthru.tests.pkg-config = testers.hasPkgConfigModules {
package = finalAttrs.finalPackage;
moduleNames = [ "libfoo" ];
};
```
:::
## `testVersion` {#tester-testVersion} ## `testVersion` {#tester-testVersion}
Checks that the output from running a command contains the specified version string in it as a whole word. Checks that the output from running a command contains the specified version string in it as a whole word.
@ -83,7 +91,18 @@ This returns a derivation with an override on the builder, with the following ef
- Move `$out` to `$out/result`, if it exists (assuming `out` is the default output) - Move `$out` to `$out/result`, if it exists (assuming `out` is the default output)
- Save the build log to `$out/testBuildFailure.log` (same) - Save the build log to `$out/testBuildFailure.log` (same)
Example: While `testBuildFailure` is designed to keep changes to the original builder's environment to a minimum, some small changes are inevitable:
- The file `$TMPDIR/testBuildFailure.log` is present. It should not be deleted.
- `stdout` and `stderr` are a pipe instead of a tty. This could be improved.
- One or two extra processes are present in the sandbox during the original builder's execution.
- The derivation and output hashes are different, but not unusual.
- The derivation includes a dependency on `buildPackages.bash` and `expect-failure.sh`, which is built to include a transitive dependency on `buildPackages.coreutils` and possibly more.
These are not added to `PATH` or any other environment variable, so they should be hard to observe.
:::{.example #ex-testBuildFailure-showingenvironmentchanges}
# Check that a build fails, and verify the changes made during build
```nix ```nix
runCommand "example" { runCommand "example" {
@ -100,24 +119,15 @@ runCommand "example" {
''; '';
``` ```
While `testBuildFailure` is designed to keep changes to the original builder's :::
environment to a minimum, some small changes are inevitable.
- The file `$TMPDIR/testBuildFailure.log` is present. It should not be deleted.
- `stdout` and `stderr` are a pipe instead of a tty. This could be improved.
- One or two extra processes are present in the sandbox during the original
builder's execution.
- The derivation and output hashes are different, but not unusual.
- The derivation includes a dependency on `buildPackages.bash` and
`expect-failure.sh`, which is built to include a transitive dependency on
`buildPackages.coreutils` and possibly more. These are not added to `PATH`
or any other environment variable, so they should be hard to observe.
## `testEqualContents` {#tester-equalContents} ## `testEqualContents` {#tester-equalContents}
Check that two paths have the same contents. Check that two paths have the same contents.
Example: :::{.example #ex-testEqualContents-toyexample}
# Check that two paths have the same contents
```nix ```nix
testers.testEqualContents { testers.testEqualContents {
@ -137,17 +147,20 @@ testers.testEqualContents {
} }
``` ```
:::
## `testEqualDerivation` {#tester-testEqualDerivation} ## `testEqualDerivation` {#tester-testEqualDerivation}
Checks that two packages produce the exact same build instructions. Checks that two packages produce the exact same build instructions.
This can be used to make sure that a certain difference of configuration, This can be used to make sure that a certain difference of configuration, such as the presence of an overlay does not cause a cache miss.
such as the presence of an overlay does not cause a cache miss.
When the derivations are equal, the return value is an empty file. When the derivations are equal, the return value is an empty file.
Otherwise, the build log explains the difference via `nix-diff`. Otherwise, the build log explains the difference via `nix-diff`.
Example: :::{.example #ex-testEqualDerivation-hello}
# Check that two packages produce the same derivation
```nix ```nix
testers.testEqualDerivation testers.testEqualDerivation
@ -156,29 +169,28 @@ testers.testEqualDerivation
(hello.overrideAttrs(o: { doCheck = true; })) (hello.overrideAttrs(o: { doCheck = true; }))
``` ```
:::
## `invalidateFetcherByDrvHash` {#tester-invalidateFetcherByDrvHash} ## `invalidateFetcherByDrvHash` {#tester-invalidateFetcherByDrvHash}
Use the derivation hash to invalidate the output via name, for testing. Use the derivation hash to invalidate the output via name, for testing.
Type: `(a@{ name, ... } -> Derivation) -> a -> Derivation` Type: `(a@{ name, ... } -> Derivation) -> a -> Derivation`
Normally, fixed output derivations can and should be cached by their output Normally, fixed output derivations can and should be cached by their output hash only, but for testing we want to re-fetch everytime the fetcher changes.
hash only, but for testing we want to re-fetch everytime the fetcher changes.
Changes to the fetcher become apparent in the drvPath, which is a hash of Changes to the fetcher become apparent in the drvPath, which is a hash of how to fetch, rather than a fixed store path.
how to fetch, rather than a fixed store path. By inserting this hash into the name, we can make sure to re-run the fetcher every time the fetcher changes.
By inserting this hash into the name, we can make sure to re-run the fetcher
every time the fetcher changes.
This relies on the assumption that Nix isn't clever enough to reuse its This relies on the assumption that Nix isn't clever enough to reuse its database of local store contents to optimize fetching.
database of local store contents to optimize fetching.
You might notice that the "salted" name derives from the normal invocation, You might notice that the "salted" name derives from the normal invocation, not the final derivation.
not the final derivation. `invalidateFetcherByDrvHash` has to invoke the fetcher `invalidateFetcherByDrvHash` has to invoke the fetcher function twice:
function twice: once to get a derivation hash, and again to produce the final once to get a derivation hash, and again to produce the final fixed output derivation.
fixed output derivation.
Example: :::{.example #ex-invalidateFetcherByDrvHash-nix}
# Prevent nix from reusing the output of a fetcher
```nix ```nix
tests.fetchgit = testers.invalidateFetcherByDrvHash fetchgit { tests.fetchgit = testers.invalidateFetcherByDrvHash fetchgit {
@ -189,13 +201,17 @@ tests.fetchgit = testers.invalidateFetcherByDrvHash fetchgit {
}; };
``` ```
:::
## `runNixOSTest` {#tester-runNixOSTest} ## `runNixOSTest` {#tester-runNixOSTest}
A helper function that behaves exactly like the NixOS `runTest`, except it also assigns this Nixpkgs package set as the `pkgs` of the test and makes the `nixpkgs.*` options read-only. A helper function that behaves exactly like the NixOS `runTest`, except it also assigns this Nixpkgs package set as the `pkgs` of the test and makes the `nixpkgs.*` options read-only.
If your test is part of the Nixpkgs repository, or if you need a more general entrypoint, see ["Calling a test" in the NixOS manual](https://nixos.org/manual/nixos/stable/index.html#sec-calling-nixos-tests). If your test is part of the Nixpkgs repository, or if you need a more general entrypoint, see ["Calling a test" in the NixOS manual](https://nixos.org/manual/nixos/stable/index.html#sec-calling-nixos-tests).
Example: :::{.example #ex-runNixOSTest-hello}
# Run a NixOS test using `runNixOSTest`
```nix ```nix
pkgs.testers.runNixOSTest ({ lib, ... }: { pkgs.testers.runNixOSTest ({ lib, ... }: {
@ -209,19 +225,17 @@ pkgs.testers.runNixOSTest ({ lib, ... }: {
}) })
``` ```
:::
## `nixosTest` {#tester-nixosTest} ## `nixosTest` {#tester-nixosTest}
Run a NixOS VM network test using this evaluation of Nixpkgs. Run a NixOS VM network test using this evaluation of Nixpkgs.
NOTE: This function is primarily for external use. NixOS itself uses `make-test-python.nix` directly. Packages defined in Nixpkgs [reuse NixOS tests via `nixosTests`, plural](#ssec-nixos-tests-linking). NOTE: This function is primarily for external use. NixOS itself uses `make-test-python.nix` directly. Packages defined in Nixpkgs [reuse NixOS tests via `nixosTests`, plural](#ssec-nixos-tests-linking).
It is mostly equivalent to the function `import ./make-test-python.nix` from the It is mostly equivalent to the function `import ./make-test-python.nix` from the [NixOS manual](https://nixos.org/nixos/manual/index.html#sec-nixos-tests), except that the current application of Nixpkgs (`pkgs`) will be used, instead of letting NixOS invoke Nixpkgs anew.
[NixOS manual](https://nixos.org/nixos/manual/index.html#sec-nixos-tests),
except that the current application of Nixpkgs (`pkgs`) will be used, instead of
letting NixOS invoke Nixpkgs anew.
If a test machine needs to set NixOS options under `nixpkgs`, it must set only the If a test machine needs to set NixOS options under `nixpkgs`, it must set only the `nixpkgs.pkgs` option.
`nixpkgs.pkgs` option.
### Parameter {#tester-nixosTest-parameter} ### Parameter {#tester-nixosTest-parameter}