[Qa-jenkins-dev] Bug#862022: Bug#862022: reproducible-builds.org: build log sent uncompressed

[Mattia Rizzolo]

On Sun, May 07, 2017 at 02:46:15PM +0000, Daniel Shahaf wrote:
> Ivo De Decker wrote on Sun, May 07, 2017 at 16:24:14 +0200:
> > there is a link with the build log which is listed as '7 MB', which is in fact
> > 240 MB. It seems the site lists the compressed size, but sends the
> > uncompressed log file.
> 
> Further information:
> 
> % wget https://tests.reproducible-builds.org/debian/logs/unstable/amd64/cross-toolchain-base-ports_10.build2.log.gz
> ⋮
> HTTP/1.1 200 OK
> Content-Type: text/plain; charset=utf-8
> % file - < cross-toolchain-base-ports_10.build2.log.gz
> /dev/stdin: ASCII text, with CRLF line terminators
> %
> 
> So, the gunzipping is not browser-side but jenkins-side.

This is only partially right: the uncrompression is done server
(jenkins) side only if the client doesn't acknowledge it is able to
receive gzip data:

mattia at warren /tmp % curl -H "Accept-Encoding: gzip" -o foo -D - https://tests.reproducible-builds.org/debian/logs/unstable/amd64/cross-toolchain-base-ports_10.build2.log.gz
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0HTTP/1.1 200 OK
Date: Sun, 07 May 2017 21:13:55 GMT
Server: Apache/2.4.10
Strict-Transport-Security: max-age=15552000
Last-Modified: Sun, 30 Apr 2017 01:09:55 GMT
ETag: "bd545-54e57f6ee2800"
Accept-Ranges: bytes
Content-Length: 775493
Vary: Accept-Encoding
Content-Type: text/plain; charset=utf-8
Content-Encoding: gzip

100  757k  100  757k    0     0   395k      0  0:00:01  0:00:01 --:--:--  395k
mattia at warren /tmp % file foo
foo: gzip compressed data, max compression, from Unix
mattia at warren /tmp % lh foo
-rw-r--r-- 1 mattia mattia 758K May  7 23:13 foo
mattia at warren /tmp % 


This is done becuase of apache also happily mapping foo.txt files to a
file that it is actually foo.txt.gz, and also for browser not understing
gzip.

That said, I agree it's a buggy behaviour when the user really requested
a file named .gz, and it should really send the gzip-compressed file.

-- 
regards,
                        Mattia Rizzolo

GPG Key: 66AE 2B4A FCCF 3F52 DA18  4D18 4B04 3FCD B944 4540      .''`.
more about me:  https://mapreri.org                             : :'  :
Launchpad user: https://launchpad.net/~mapreri                  `. `'`
Debian QA page: https://qa.debian.org/developer.php?login=mattia  `-
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 833 bytes
Desc: not available
URL: <http://lists.alioth.debian.org/pipermail/qa-jenkins-dev/attachments/20170507/b0214422/attachment.sig>