498574f238
This creates a simple mapping of all packages to github ids of all their maintainers. This is uploaded as an artifact and is then available for download on the latest commit of each branch with a merge queue. This will allow scheduled jobs to use this information for setting maintainer-related labels, to request reviewers and to implement the merge-bot. The advantage over querying this information directly via Nix in each case: The scheduled job does not need to install Nix and does not need to checkout the target branch. Compared to obtaining the maintainer information just for a single PR during Eval, this will allow retroactively changing maintainers for a package: For example, it allows to request a new maintainer as reviewer for a PR that was created before they became maintainer, but is still open - and similarly for maintainer labels and merge-bot rights. None of these extensions are implemented by this PR, yet.
Nixpkgs CI evaluation
The code in this directory is used by the eval.yml GitHub Actions workflow to evaluate the majority of Nixpkgs for all PRs, effectively making sure that when the development branches are processed by Hydra, no evaluation failures are encountered.
Furthermore it also allows local evaluation using:
nix-build ci -A eval.baseline
The two most important arguments are:
--arg evalSystems: The set of systems for whichnixpkgsshould be evaluated. Defaults to the four official platforms (x86_64-linux,aarch64-linux,x86_64-darwinandaarch64-darwin). Example:--arg evalSystems '["x86_64-linux" "aarch64-darwin"]'--arg quickTest: Enables testing a single chunk of the current system only for quick iteration. Example:--arg quickTest true
The following arguments can be used to fine-tune performance:
--max-jobs: The maximum number of derivations to run at the same time. Only each supported system gets a separate derivation, so it doesn't make sense to set this higher than that number.--cores: The number of cores to use for each job. Recommended to set this to the amount of cores on your system divided by--max-jobs.--arg chunkSize: The number of attributes that are evaluated simultaneously on a single core. Lowering this decreases memory usage at the cost of increased evaluation time. If this is too high, there won't be enough chunks to process them in parallel, and will also increase evaluation time. The default is 5000. Example:--arg chunkSize 10000
Note that 16GB memory is the recommended minimum, while with less than 8GB memory evaluation time suffers greatly.
Local eval with rebuilds / comparison
To compare two commits locally, first run the following on the baseline commit:
nix-build ci -A eval.baseline --out-link baseline
Then, on the commit with your changes:
nix-build ci -A eval.full --arg baseline ./baseline
Keep in mind to otherwise pass the same set of arguments for both commands (evalSystems, quickTest, chunkSize).
Running this command will evaluate the difference between the baseline statistics and the ones at the time of running the command.
From that difference, it will produce a human-readable report in $out/step-summary.md.
If no packages were added or removed, then performance statistics will also be generated as part of this report.