On Wed, Jun 11, 2025 at 09:48:26AM +0000, Job Snijders wrote:
> On Wed, Jun 11, 2025 at 09:44:10AM +0000, Job Snijders wrote:
> > On Wed, Jun 11, 2025 at 06:11:31AM +0200, Claudio Jeker wrote:
> > > I really would prefer if we did not add more log output like this.
> > > Both with and without -v the noise from rpki-client is too high.

It really isn't noisy, consider the below terminal transcript: starting with a
completely cold cache a few messages are logged, but in the subsequent 2 hours
only one message appears.

I think the best way to reduce the 'noise' of these messages will be to
encourage publication point operators to enable HTTP compression, not to
silence the message in rpki-client :-)

$ doas rm -rf /var/cache/rpki-client/.rrdp
$ for i in $(seq 1 10); do echo round $i: | ts; doas rpki-client -vp4 2>&1 | ts | tee -a /tmp/log | grep --line-buffered -e HTTP -e Process; echo; sleep 600; done
Jun 11 11:52:28 round 1:
Jun 11 11:53:24 rpki-client: https://rrdp.lacnic.net/rrdp/66b09eea-03c7-435f-bb29-5bee810bd657/211887/d51... (172.233.4.134): downloaded 61834120 bytes without HTTP compression
Jun 11 11:54:38 rpki-client: https://cloudie.rpki.app/rrdp/d92cf37b-c955-4272-bbe6-efda084ad2de/6522/036f... (185.121.168.41): downloaded 1151499 bytes without HTTP compression
Jun 11 11:54:54 rpki-client: https://rrdp.twnic.tw/rrdp/71d39673-7062-4036-b080-957aa1b854b3/snapshot/176... (103.235.88.190): downloaded 12410151 bytes without HTTP compression
Jun 11 11:55:00 rpki-client: https://rpki-repo.registro.br/rrdp/b0982bb6-6f99-448a-9f71-91a86a455e39/9378... (200.160.2.50): downloaded 68520553 bytes without HTTP compression
Jun 11 11:55:55 rpki-client: https://rpki.cnnic.cn/rrdp/d4427960-abb3-49e4-902c-d815a518b867/snapshot/301... (42.83.145.17): downloaded 8915149 bytes without HTTP compression
Jun 11 11:56:20 rpki-client: https://rpki-rrdp.us-east-2.amazonaws.com/rrdp/20aa329b-fc52-4c61-bf53-09725... (108.156.60.48): downloaded 12429193 bytes without HTTP compression
Jun 11 11:59:55 Processing time 446 seconds (412 seconds user, 600 seconds system)

Jun 11 12:09:55 round 2:
Jun 11 12:13:14 Processing time 197 seconds (295 seconds user, 394 seconds system)

Jun 11 12:23:14 round 3:
Jun 11 12:26:13 Processing time 178 seconds (348 seconds user, 280 seconds system)

Jun 11 12:36:14 round 4:
Jun 11 12:38:33 Processing time 138 seconds (288 seconds user, 187 seconds system)

Jun 11 12:48:33 round 5:
Jun 11 12:50:50 rpki-client: https://rpki.cnnic.cn/rrdp/d4427960-abb3-49e4-902c-d815a518b867/snapshot/301... (42.83.145.17): downloaded 8905280 bytes without HTTP compression
Jun 11 12:51:12 Processing time 159 seconds (279 seconds user, 187 seconds system)

Jun 11 13:01:13 round 6:
Jun 11 13:05:09 Processing time 235 seconds (312 seconds user, 512 seconds system)

Jun 11 13:15:09 round 7:
Jun 11 13:18:22 Processing time 192 seconds (269 seconds user, 405 seconds system)

Jun 11 13:28:22 round 8:
Jun 11 13:30:57 Processing time 153 seconds (260 seconds user, 271 seconds system)

Jun 11 13:40:57 round 9:
Jun 11 13:44:06 Processing time 188 seconds (309 seconds user, 358 seconds system)

Jun 11 13:54:07 round 10:
Jun 11 13:57:22 Processing time 194 seconds (386 seconds user, 299 seconds system)