Debian Bug report logs - #688303
Please support concatenated bz2 files in zlib-functions

version graph

Package: bzip2; Maintainer for bzip2 is Anibal Monsalve Salazar <[email protected]>; Source for bzip2 is src:bzip2 (PTS, buildd, popcon).

Affects: apt

Reported by: Thijs Kinkhorst <[email protected]>

Date: Fri, 21 Sep 2012 09:30:02 UTC

Severity: wishlist

Merged with 710520

Found in version bzip2/1.0.6-4

Full log

Message #12 received at [email protected] (full text, mbox, reply):

Received: (at control) by bugs.debian.org; 26 Sep 2012 14:09:46 +0000
From [email protected] Wed Sep 26 14:09:46 2012
X-Spam-Checker-Version: SpamAssassin 3.3.1-bugs.debian.org_2005_01_02
	(2010-03-16) on buxtehude.debian.org
X-Spam-Level: 
X-Spam-Status: No, score=-8.9 required=4.0 tests=BAYES_00,DKIM_SIGNED,
	DKIM_VALID,DKIM_VALID_AU,FREEMAIL_FROM,HAS_BUG_NUMBER,RCVD_IN_DNSWL_LOW,
	SPF_PASS,VALID_BTS_CONTROL autolearn=ham
	version=3.3.1-bugs.debian.org_2005_01_02
X-Spam-Bayes: score:0.0000 Tokens: new, 15; hammy, 134; neutral, 77; spammy,
	1. spammytokens:0.953-+--(unknown) hammytokens:0.000-+--(unknown),
	0.000-+--(unknown), 0.000-+--(unknown), 0.000-+--(unknown), 0.000-+--(unknown)
Return-path: <[email protected]>
Received: from mail-lb0-f180.google.com ([209.85.217.180])
	by buxtehude.debian.org with esmtps (TLS1.0:RSA_ARCFOUR_SHA1:16)
	(Exim 4.72)
	(envelope-from <[email protected]>)
	id 1TGsJ7-0000Hz-LV
	for [email protected]; Wed, 26 Sep 2012 14:09:46 +0000
Received: by lbbge1 with SMTP id ge1so1632876lbb.11
        for <[email protected]>; Wed, 26 Sep 2012 07:09:38 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:sender:in-reply-to:references:from:date
         :x-google-sender-auth:message-id:subject:to:cc:content-type;
        bh=lyUZ6I/NFBkXC8SRa/hEIgvhMw77yxpv7g4JqY2DA2o=;
        b=rHcTD5VsN9mlA3wJaorseFu3W8Q1IUFojCi1J+O1vVxO8R3z2Wwg53lwRt3XpRpnZQ
         e7I8nD+M1DczlTx7eb0GeUFZbojtCuoHHanipcepPmxfk0DKmMF0G2zAA3feTV/8m1Js
         AxrKYMcKfaQ+L3Dm6VwrG2lkvk8J36rdlIlxsioP1aXP8DIjdymNfFU2XaAxmVhySlOt
         rVrkL0Ccn7AGWNin17Yqc6O/rJnu75+Dkrb8YwLSldsxFHfDyQY0JNnEY5MnFT2U1QV2
         gYTwuz1Yjpxn7IvCj8VxrroNLrWl7rShnzJ2z9yvD+Gck7z53GU1rox0L9ZiSP09mIl2
         4QIA==
Received: by 10.152.131.68 with SMTP id ok4mr583336lab.47.1348668577891; Wed,
 26 Sep 2012 07:09:37 -0700 (PDT)
MIME-Version: 1.0
Sender: [email protected]
Received: by 10.112.9.198 with HTTP; Wed, 26 Sep 2012 07:09:16 -0700 (PDT)
In-Reply-To: <[email protected]>
References: <[email protected]>
From: David Kalnischkies <[email protected]>
Date: Wed, 26 Sep 2012 16:09:16 +0200
X-Google-Sender-Auth: AMvrqDvqhG4vysXuFWc4XhGN8fk
Message-ID: <CAAZ6_fAQSWZO=0D1Q7OoV22_D7fVtGXgW6hhKo8Q9+xZ5JFC1w@mail.gmail.com>
Subject: Re: Bug#688303: fails on concatenated bzip2 compressed Packages files (regression)
To: Thijs Kinkhorst <[email protected]>, [email protected]
Cc: [email protected]
Content-Type: text/plain; charset=ISO-8859-1
Bcc: [email protected]
Delivered-To: [email protected]

reassign 688303 bzip2 1.0.6-4
severity 688303 wishlist
retitle 688303 Please support concatenated bz2 files in zlib-functions
thanks

On Fri, Sep 21, 2012 at 11:28 AM, Thijs Kinkhorst <[email protected]> wrote:
> The problem is that our APT archive contains a Packages.bz2 which is a
> concatenation of other bz2 files (of sub-archives). Two concatenated
> bzip2 files again form a valid bzip2 file. The b(un)zip2 command line
> utils support this and it's a documented feature.

It may be a documented feature of bzip2, but not of APT as you have noticed.
It is also not part of any documentation for a repository format, which all
say that the Packages.bz2 file is a compressed Packages file.
Nowhere is said that this could be a concatenation of different streams a
compression algorithm knows by accident how to combine into one file.
(It speaks volumes that the documentation of the higher level API mentions
 indeed the method you point to, but in the example code showing writing and
 reading a file on the very same page it is not used, nor even mentioned -
 maybe because they also see a difference between file and stream)


Anyway, we don't even use the higher level functions, we use the zlib-
compatibility functions which do not expose this "detail", so I am
reassigning this to libbz2 for them to consider implementing support for
this one way or another.


Either way, it's a bug in your archive to assume that such bz2-files would
be supported by APT or anything else working with these indexes without it
ever be documented as supported.

The reference implementation for an archive are the ones operated by
ftp-masters - it is reasonable to assume everything they don't use is
not safe to use in yours.


Best regards

David Kalnischkies

Send a report that this bug log contains spam.

Debian bug tracking system administrator <[email protected]>. Last modified: Sun Sep 22 09:19:58 2024; Machine Name: buxtehude

Debian Bug tracking system

Debbugs is free software and licensed under the terms of the GNU Public License version 2. The current version can be obtained from https://bugs.debian.org/debbugs-source/.

Copyright © 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson, 2005-2017 Don Armstrong, and many other contributors.