Commit Graph
566276 Commits
Author SHA1 Message Date
emilylange e15783154f chromium: improve and move recompressTarball
Recap: We need that (arguably stupid) helper function/drv because the
chromium tarball is big -- and is likely to increase even more in the
future. So big, that we eventually exceeded hydra.nixos.org's
max-output-limit (3G).  Instead of raising global hydra's limit, it was
decided that we recompress the tarball after deleting unused vendored
files from it.

I spent a lot of time on a version/prototype that does everything
(downloading, decompression, tar extraction, deleting unused files,
reproducible tar recreation and finally recompression) via stdin but
eventually had to scratch that.

GNU tar does not allow to create a tarball just from stdin, nixpkgs'
stdenv isn't built with stdin/stdout/pipes in mind, and things a lot of
other things I probably already forgot.

Nonetheless, this version improves multiple things:
- No more `mv` (used to be multiple, not just ours, since fetchzip had
  some as well)
- No more `rm` to get rid of the extracted files before recompressing.
  Instead, we simply don't extract them in the first place (thanks to
  tar's --exlude).
- No more "no space left" that happened due to `downloadToTemp = true;`.
- Multithreaded xz decompression, since that commit is still in
  staging-next.

We cannot use stdenv's unpackFile() because that does not allow us to
specify the needed --exclude (and --strip-components=1 if we don't want
to rely on glob matching).

The hash changed because we now have a static base directory ("source")
in the tarball, instead of whatever upstream provided us with (e.g.
"chromium-120.0.6099.129").
2024-01-04 01:34:15 +01:00
0x4A6FandGitHub 0b15d0fbb0 Merge pull request #278496 from r-vdp/atuin_17_2_0
atuin 17.1.0 -> 17.2.1
2024-01-03 21:07:34 +01:00
Weijia WangandGitHub c84c0891a9 Merge pull request #276015 from r-ryantm/auto-update/python310Packages.qtawesome
python310Packages.qtawesome: 1.2.3 -> 1.3.0
2024-01-03 21:07:22 +01:00
Weijia WangandGitHub 7080e16510 Merge pull request #275996 from r-ryantm/auto-update/python310Packages.python-lsp-black
python310Packages.python-lsp-black: 1.3.0 -> 2.0.0
2024-01-03 21:04:04 +01:00
Weijia WangandGitHub 0494d840a7 Merge pull request #276081 from r-ryantm/auto-update/python310Packages.stripe
python310Packages.stripe: 7.7.0 -> 7.10.0
2024-01-03 21:02:14 +01:00
Weijia WangandGitHub f3c54970ec Merge pull request #276522 from r-ryantm/auto-update/parallel
parallel: 20231122 -> 20231222
2024-01-03 20:58:17 +01:00
Weijia WangandGitHub 1ae58a6def Merge pull request #276718 from r-ryantm/auto-update/codeql
codeql: 2.15.4 -> 2.15.5
2024-01-03 20:57:45 +01:00
Weijia WangandGitHub 00ed86edf0 Merge pull request #278407 from r-ryantm/auto-update/python310Packages.flet
python310Packages.flet: 0.17.0 -> 0.18.0
2024-01-03 20:42:55 +01:00
Weijia WangandGitHub 5eee8fc90d Merge pull request #278408 from r-ryantm/auto-update/python310Packages.flet-core
python310Packages.flet-core: 0.17.0 -> 0.18.0
2024-01-03 20:42:43 +01:00
Weijia WangandGitHub 063c4a83d4 Merge pull request #278409 from r-ryantm/auto-update/python310Packages.flet-runtime
python310Packages.flet-runtime: 0.17.0 -> 0.18.0
2024-01-03 20:42:29 +01:00
Weijia WangandGitHub 71392a51bb Merge pull request #278547 from NixOS/revert-276579-auto-update/utf8cpp
Revert "utf8cpp: 4.0.3 -> 4.0.4"
2024-01-03 20:36:34 +01:00
Felix BühlerandGitHub 9842a59744 Merge pull request #278378 from arthsmn/newsraft-autoupdate
newsraft: add passthru.updateScript
2024-01-03 20:35:38 +01:00
Weijia WangandGitHub 4eaadb5b31 Revert "utf8cpp: 4.0.3 -> 4.0.4" 2024-01-03 20:35:25 +01:00
Weijia WangandGitHub 382614ec61 Merge pull request #278161 from r-ryantm/auto-update/miriway
miriway: unstable-2023-11-22 -> unstable-2024-01-01
2024-01-03 20:27:21 +01:00
Weijia WangandGitHub 699dedf945 Merge pull request #276018 from r-ryantm/auto-update/python310Packages.r2pipe
python310Packages.r2pipe: 1.8.2 -> 1.8.4
2024-01-03 20:26:12 +01:00
Weijia WangandGitHub 36a19b407a Merge pull request #276090 from r-ryantm/auto-update/python310Packages.thinc
python310Packages.thinc: 8.2.1 -> 8.2.2
2024-01-03 20:25:24 +01:00
Weijia WangandGitHub 75f01120c4 Merge pull request #276093 from r-ryantm/auto-update/python310Packages.trainer
python310Packages.trainer: 0.0.32 -> 0.0.36
2024-01-03 20:24:48 +01:00
Weijia WangandGitHub f6b945fa49 Merge pull request #276166 from r-ryantm/auto-update/python310Packages.vertica-python
python310Packages.vertica-python: 1.3.7 -> 1.3.8
2024-01-03 20:23:02 +01:00
Weijia WangandGitHub e9017c490f Merge pull request #276170 from r-ryantm/auto-update/python310Packages.weasyprint
python310Packages.weasyprint: 60.1 -> 60.2
2024-01-03 20:22:30 +01:00
Weijia WangandGitHub 1ba4222f78 Merge pull request #275546 from r-ryantm/auto-update/python310Packages.guessit
python310Packages.guessit: 3.7.1 -> 3.8.0
2024-01-03 20:19:43 +01:00
Weijia WangandGitHub 672fc37fd0 Merge pull request #275855 from r-ryantm/auto-update/python310Packages.pebble
python310Packages.pebble: 5.0.4 -> 5.0.6
2024-01-03 20:17:48 +01:00
Weijia WangandGitHub ba6ca313f3 Merge pull request #275382 from r-ryantm/auto-update/python310Packages.eccodes
python310Packages.eccodes: 2.32.1 -> 2.33.0
2024-01-03 20:16:56 +01:00
Weijia WangandGitHub 31ad141273 Merge pull request #275237 from r-ryantm/auto-update/python310Packages.dbt-redshift
python310Packages.dbt-redshift: 1.7.0 -> 1.7.1
2024-01-03 20:14:21 +01:00
Weijia WangandGitHub aaada62833 Merge pull request #275226 from r-ryantm/auto-update/python310Packages.cx-freeze
python310Packages.cx-freeze: 6.15.11 -> 6.15.12
2024-01-03 20:13:10 +01:00
Weijia WangandGitHub 9d727fda09 Merge pull request #275223 from r-ryantm/auto-update/python310Packages.cupy
python310Packages.cupy: 12.2.0 -> 12.3.0
2024-01-03 20:12:30 +01:00
Weijia WangandGitHub 9b994b9d6d Merge pull request #275206 from r-ryantm/auto-update/python310Packages.command_runner
python310Packages.command_runner: 1.5.0 -> 1.5.2
2024-01-03 20:11:52 +01:00
Weijia WangandGitHub e3bc8b94ff Merge pull request #275192 from r-ryantm/auto-update/python310Packages.bugsnag
python310Packages.bugsnag: 4.6.0 -> 4.6.1
2024-01-03 20:10:29 +01:00
Weijia WangandGitHub 47780f48a7 Merge pull request #275188 from r-ryantm/auto-update/python310Packages.bc-python-hcl2
python310Packages.bc-python-hcl2: 0.4.1 -> 0.4.2
2024-01-03 20:09:52 +01:00
Weijia WangandGitHub 07bd39026d Merge pull request #275147 from r-ryantm/auto-update/python310Packages.aiokafka
python310Packages.aiokafka: 0.8.1 -> 0.10.0
2024-01-03 20:06:15 +01:00
Weijia WangandGitHub 866cb333a5 Merge pull request #276964 from r-ryantm/auto-update/python311Packages.jpype1
python311Packages.jpype1: 1.4.1 -> 1.5.0
2024-01-03 20:02:37 +01:00
Weijia WangandGitHub 5aefed5879 Merge pull request #277123 from r-ryantm/auto-update/python310Packages.apispec
python310Packages.apispec: 6.3.0 -> 6.3.1
2024-01-03 20:01:45 +01:00
Weijia WangandGitHub e9735b8d5b Merge pull request #277130 from r-ryantm/auto-update/python310Packages.awacs
python310Packages.awacs: 2.4.0 -> 2.4.1
2024-01-03 20:01:15 +01:00
Weijia WangandGitHub 87edce3d9f Merge pull request #277133 from r-ryantm/auto-update/python310Packages.azure-mgmt-cosmosdb
python310Packages.azure-mgmt-cosmosdb: 9.3.0 -> 9.4.0
2024-01-03 20:00:24 +01:00
Weijia WangandGitHub 8dc6beab0e Merge pull request #277144 from r-ryantm/auto-update/python310Packages.cantools
python310Packages.cantools: 39.4.0 -> 39.4.2
2024-01-03 19:58:29 +01:00
Weijia WangandGitHub d5aa5f3d54 Merge pull request #277167 from r-ryantm/auto-update/python310Packages.dtw-python
python310Packages.dtw-python: 1.3.0 -> 1.3.1
2024-01-03 19:58:01 +01:00
Weijia WangandGitHub b6596c7dfe Merge pull request #277214 from r-ryantm/auto-update/python310Packages.gtts
python310Packages.gtts: 2.4.0 -> 2.5.0
2024-01-03 19:55:04 +01:00
Weijia WangandGitHub 6b237e1b0a Merge pull request #277232 from r-ryantm/auto-update/python310Packages.jwcrypto
python310Packages.jwcrypto: 1.5.0 -> 1.5.1
2024-01-03 19:54:22 +01:00
Weijia WangandGitHub 51c8f296b6 Merge pull request #277237 from r-ryantm/auto-update/python310Packages.lightning-utilities
python310Packages.lightning-utilities: 0.10.0 -> 0.10.1
2024-01-03 19:53:53 +01:00
Weijia WangandGitHub 72c5b9364d Merge pull request #277240 from r-ryantm/auto-update/python310Packages.manifestoo-core
python310Packages.manifestoo-core: 1.3 -> 1.4
2024-01-03 19:53:08 +01:00
Weijia WangandGitHub af1be81893 Merge pull request #277272 from r-ryantm/auto-update/minetest-mapserver
minetest-mapserver: 4.7.0 -> 4.8.0
2024-01-03 19:47:35 +01:00
Weijia WangandGitHub ddf97a5204 Merge pull request #277308 from r-ryantm/auto-update/newman
newman: 5.3.2 -> 6.1.0
2024-01-03 19:46:15 +01:00
Weijia WangandGitHub 9f8ad17c27 Merge pull request #277460 from r-ryantm/auto-update/python310Packages.somajo
python310Packages.somajo: 2.3.1 -> 2.4.0
2024-01-03 19:45:41 +01:00
Weijia WangandGitHub c1e77340a3 Merge pull request #277262 from r-ryantm/auto-update/riemann
riemann: 0.3.10 -> 0.3.11
2024-01-03 19:43:28 +01:00
Weijia WangandGitHub c2dafb3b6a Merge pull request #277254 from r-ryantm/auto-update/ocserv
ocserv: 1.2.2 -> 1.2.3
2024-01-03 19:42:05 +01:00
Weijia WangandGitHub 8f15338c19 Merge pull request #277252 from r-ryantm/auto-update/nb
nb: 7.9.0 -> 7.9.1
2024-01-03 19:41:13 +01:00
Weijia WangandGitHub 859c04653c Merge pull request #277248 from r-ryantm/auto-update/groonga
groonga: 13.0.9 -> 13.1.0
2024-01-03 19:40:42 +01:00
Weijia WangandGitHub 47a1962a9e Merge pull request #277246 from r-ryantm/auto-update/flowblade
flowblade: 2.12 -> 2.12.0.2
2024-01-03 19:40:13 +01:00
Weijia WangandGitHub 7436841762 Merge pull request #277075 from r-ryantm/auto-update/optifine
optifine: 1.20.1_HD_U_I5 -> 1.20.1_HD_U_I6
2024-01-03 19:38:07 +01:00
Weijia WangandGitHub c53b84f039 Merge pull request #277099 from r-ryantm/auto-update/promptfoo
promptfoo: 0.28.0 -> 0.33.2
2024-01-03 19:37:25 +01:00
Weijia WangandGitHub 32a81685fb Merge pull request #277102 from r-ryantm/auto-update/protoc-gen-connect-go
protoc-gen-connect-go: 1.12.0 -> 1.14.0
2024-01-03 19:37:06 +01:00