Different boot.iso download depending on accepted encoding

Issues related to applications and software problems and general support
Post Reply
gvde
Posts: 2
Joined: 2021/06/21 11:53:25

Different boot.iso download depending on accepted encoding

Post by gvde » 2022/11/24 16:31:30

When mirroring centos stream 9 using foreman/katello/pulp I have noticed frequent checksum problems with boot.iso (and maybe more but the sync aborts there).

Now I have noticed I get different files depending on whether I set http header accept-encoding to gzip or not.

For example, downloading from http://mirror.stream.centos.org/9-strea ... s/boot.iso redirects me to https://download.cf.centos.org/9-stream ... s/boot.iso. One of the IPs of download.cf.centos.org is 18.66.192.118. I do two downloads:

Code: Select all

$ curl -v --output boot1.iso --resolve download.cf.centos.org:443:18.66.192.118  https://download.cf.centos.org/9-stream/BaseOS/x86_64/os/images/boot.iso --header 'Accept-Encoding: gzip'

$ curl -v --output boot2.iso --resolve download.cf.centos.org:443:18.66.192.118  https://download.cf.centos.org/9-stream/BaseOS/x86_64/os/images/boot.iso
which results it two different files:

Code: Select all

$ ls -la boot?.iso                                                                                                                                        
-rw-r--r--  1 root  root  896532480 Nov 24 17:22 boot1.iso
-rw-r--r--  1 root  root  893386752 Nov 24 17:22 boot2.iso
Both are correct isos:

Code: Select all

boot1.iso: ISO 9660 CD-ROM filesystem data (DOS/MBR boot sector) 'CentOS-Stream-9-BaseOS-x86_64' (bootable)
boot2.iso: ISO 9660 CD-ROM filesystem data (DOS/MBR boot sector) 'CentOS-Stream-9-BaseOS-x86_64' (bootable)
The first one has the checksum in the .treeinfo file:

Code: Select all

55a560c8fc43e3f2bfae3827a6e7c31fd45c1a72b61a2e9fc68f917cfddee9d1  boot1.iso
837ad493da7d544943066b040cd2ea87c37090307e96ce0f064687beb6821c33  boot2.iso
I can see in the http response headers that the second is older then the first:

Code: Select all

HTTP/2 200 
content-type: application/octet-stream
content-length: 896532480
date: Thu, 24 Nov 2022 01:00:30 GMT
last-modified: Wed, 23 Nov 2022 13:27:09 GMT
etag: "55c9647dc6665a4486d0b2d9569a48e0-107"
x-amz-version-id: S26qMpy9o2y1pZBxGs7Q7PB0esllhPYu
accept-ranges: bytes
server: AmazonS3
x-cache: Hit from cloudfront
via: 1.1 af1bbc213b3a9ee2f125be77ca3609a0.cloudfront.net (CloudFront)
x-amz-cf-pop: MUC50-P1
x-amz-cf-id: JvoKIs6ingsYWNwi3O4W705gph81_1gtEjEnKcsdnloI1Uub3JRh_Q==
age: 55305
this is the second:

Code: Select all

HTTP/2 200 
content-type: application/octet-stream
content-length: 893386752
date: Tue, 22 Nov 2022 06:15:13 GMT
last-modified: Fri, 18 Nov 2022 13:16:06 GMT
etag: "5e9e8621cfaba576a3be45305bbce733-107"
x-amz-version-id: q8o94togmJky1WLWL3.Zt2CVQxOHepr4
accept-ranges: bytes
server: AmazonS3
x-cache: Hit from cloudfront
via: 1.1 551f2461af0b3bf4faaad831ee6e5b1e.cloudfront.net (CloudFront)
x-amz-cf-pop: MUC50-P1
x-amz-cf-id: P-GlbuHWF--HOLl3tICyYQ_DGScScTpaQDPNq-YO0REY7McJ3SyWfQ==
age: 209239
This is really messed up...

User avatar
TrevorH
Site Admin
Posts: 33191
Joined: 2009/09/24 10:40:56
Location: Brighton, UK

Re: Different boot.iso download depending on accepted encoding

Post by TrevorH » 2022/11/24 17:17:14

I would suggest reporting this as a bug. For information on filing bugs against CentOS Linux or CentOS Stream please see https://wiki.centos.org/ReportBugs
The future appears to be RHEL or Debian. I think I'm going Debian.
Info for USB installs on http://wiki.centos.org/HowTos/InstallFromUSBkey
CentOS 5 and 6 are deadest, do not use them.
Use the FAQ Luke


Post Reply