Debian Bug report logs - #880645
wrong content in xz-compressed dep11 Components files (outdated)

Toggle useless messages

Message #5 received at submit@bugs.debian.org (full text, mbox, reply):

From: Ilan Cohen <ilanco@gmail.com>

To: Debian Bug Tracking System <submit@bugs.debian.org>

Subject: apt: Hash Sum mismatch when running apt-get update

Date: Fri, 03 Nov 2017 10:54:49 +0200

Package: apt
Version: 1.6~alpha3
Severity: important

Dear Maintainer,

   * What led up to the situation?

Running `apt-get update` gave me the following output:

```
Hit:1 http://security.debian.org/debian-security buster/updates InRelease
Hit:2 http://ftp.us.debian.org/debian buster InRelease                                                                                                                            
Hit:3 https://download.docker.com/linux/debian stretch InRelease                                                                                                                
Ign:4 https://dl.google.com/linux/chrome/deb stable InRelease                                                                                       
Hit:5 http://ftp.us.debian.org/debian buster-updates InRelease                                      
Hit:6 https://dl.google.com/linux/chrome/deb stable Release              
Hit:7 https://mirrors.wikimedia.org/debian experimental InRelease        
Get:9 https://mirrors.wikimedia.org/debian unstable InRelease [235 kB]
Get:10 https://mirrors.wikimedia.org/debian unstable/contrib Sources [50.8 kB]
Get:11 https://mirrors.wikimedia.org/debian unstable/non-free Sources [83.8 kB]
Get:12 https://mirrors.wikimedia.org/debian unstable/main Sources [7,848 kB]
Get:13 https://mirrors.wikimedia.org/debian unstable/main amd64 Packages [7,777 kB]
Get:14 https://mirrors.wikimedia.org/debian unstable/main Translation-en [5,867 kB]
Get:15 https://mirrors.wikimedia.org/debian unstable/main amd64 DEP-11 Metadata [3,107 kB]
Get:16 https://mirrors.wikimedia.org/debian unstable/main DEP-11 64x64 Icons [6,936 kB]
Get:17 https://mirrors.wikimedia.org/debian unstable/contrib amd64 Packages [58.5 kB]
Get:18 https://mirrors.wikimedia.org/debian unstable/contrib Translation-en [50.9 kB]
Get:19 https://mirrors.wikimedia.org/debian unstable/contrib amd64 DEP-11 Metadata [2,924 B]
Get:20 https://mirrors.wikimedia.org/debian unstable/contrib DEP-11 64x64 Icons [37.7 kB]
Get:21 https://mirrors.wikimedia.org/debian unstable/non-free amd64 Packages [81.9 kB]
Get:22 https://mirrors.wikimedia.org/debian unstable/non-free Translation-en [83.8 kB]
Get:23 https://mirrors.wikimedia.org/debian unstable/non-free amd64 DEP-11 Metadata [6,384 B]
Get:24 https://mirrors.wikimedia.org/debian unstable/non-free DEP-11 64x64 Icons [1,813 B]
Err:23 https://mirrors.wikimedia.org/debian unstable/non-free amd64 DEP-11 Metadata
  Hash Sum mismatch
  Hashes of expected file:
   - Filesize:65721 [weak]
   - SHA256:0eb5ea70b4c46a7c0889e9601d16cedf3eb4ff55bf3b77ef2af2bcd3dcf48cec
   - MD5Sum:68fdfbc3bc806010ba4c9fc8d4cb133b [weak]
  Hashes of received file:
   - SHA256:5fa520cd26eac94e183632f84371643219fdf905dfd351b53bbcd7afa5c3b848
   - MD5Sum:875dd6824d698bfa73c6517307f692f5 [weak]
   - Filesize:65721 [weak]
  Last modification reported: Mon, 30 Oct 2017 21:09:03 +0000
  Release file created at: Fri, 03 Nov 2017 02:41:19 +0000
Reading package lists... Done       
E: Failed to fetch store:/var/lib/apt/lists/partial/mirrors.wikimedia.org_debian_dists_unstable_non-free_dep11_Components-amd64.yml.xz  Hash Sum mismatch
   Hashes of expected file:
    - Filesize:65721 [weak]
    - SHA256:0eb5ea70b4c46a7c0889e9601d16cedf3eb4ff55bf3b77ef2af2bcd3dcf48cec
    - MD5Sum:68fdfbc3bc806010ba4c9fc8d4cb133b [weak]
   Hashes of received file:
    - SHA256:5fa520cd26eac94e183632f84371643219fdf905dfd351b53bbcd7afa5c3b848
    - MD5Sum:875dd6824d698bfa73c6517307f692f5 [weak]
    - Filesize:65721 [weak]
   Last modification reported: Mon, 30 Oct 2017 21:09:03 +0000
   Release file created at: Fri, 03 Nov 2017 02:41:19 +0000
E: Some index files failed to download. They have been ignored, or old ones used instead.
```


   * What exactly did you do (or not do) that was effective (or
     ineffective)?

Update works when disabling xz compression with the following command: 
`apt-get update -o Acquire::CompressionTypes::Order::=gz`



-- Package-specific info:

-- apt-config dump --

APT "";
APT::Architecture "amd64";
APT::Build-Essential "";
APT::Build-Essential:: "build-essential";
APT::Install-Recommends "1";
APT::Install-Suggests "0";
APT::Sandbox "";
APT::Sandbox::User "_apt";
APT::Authentication "";
APT::Authentication::TrustCDROM "true";
APT::NeverAutoRemove "";
APT::NeverAutoRemove:: "^firmware-linux.*";
APT::NeverAutoRemove:: "^linux-firmware$";
APT::NeverAutoRemove:: "^linux-image-4\.12\.0-2-amd64$";
APT::NeverAutoRemove:: "^linux-image-4\.13\.0-1-amd64$";
APT::NeverAutoRemove:: "^linux-headers-4\.12\.0-2-amd64$";
APT::NeverAutoRemove:: "^linux-headers-4\.13\.0-1-amd64$";
APT::NeverAutoRemove:: "^linux-image-extra-4\.12\.0-2-amd64$";
APT::NeverAutoRemove:: "^linux-image-extra-4\.13\.0-1-amd64$";
APT::NeverAutoRemove:: "^linux-signed-image-4\.12\.0-2-amd64$";
APT::NeverAutoRemove:: "^linux-signed-image-4\.13\.0-1-amd64$";
APT::NeverAutoRemove:: "^kfreebsd-image-4\.12\.0-2-amd64$";
APT::NeverAutoRemove:: "^kfreebsd-image-4\.13\.0-1-amd64$";
APT::NeverAutoRemove:: "^kfreebsd-headers-4\.12\.0-2-amd64$";
APT::NeverAutoRemove:: "^kfreebsd-headers-4\.13\.0-1-amd64$";
APT::NeverAutoRemove:: "^gnumach-image-4\.12\.0-2-amd64$";
APT::NeverAutoRemove:: "^gnumach-image-4\.13\.0-1-amd64$";
APT::NeverAutoRemove:: "^.*-modules-4\.12\.0-2-amd64$";
APT::NeverAutoRemove:: "^.*-modules-4\.13\.0-1-amd64$";
APT::NeverAutoRemove:: "^.*-kernel-4\.12\.0-2-amd64$";
APT::NeverAutoRemove:: "^.*-kernel-4\.13\.0-1-amd64$";
APT::NeverAutoRemove:: "^linux-backports-modules-.*-4\.12\.0-2-amd64$";
APT::NeverAutoRemove:: "^linux-backports-modules-.*-4\.13\.0-1-amd64$";
APT::NeverAutoRemove:: "^linux-tools-4\.12\.0-2-amd64$";
APT::NeverAutoRemove:: "^linux-tools-4\.13\.0-1-amd64$";
APT::VersionedKernelPackages "";
APT::VersionedKernelPackages:: "linux-image";
APT::VersionedKernelPackages:: "linux-headers";
APT::VersionedKernelPackages:: "linux-image-extra";
APT::VersionedKernelPackages:: "linux-signed-image";
APT::VersionedKernelPackages:: "kfreebsd-image";
APT::VersionedKernelPackages:: "kfreebsd-headers";
APT::VersionedKernelPackages:: "gnumach-image";
APT::VersionedKernelPackages:: ".*-modules";
APT::VersionedKernelPackages:: ".*-kernel";
APT::VersionedKernelPackages:: "linux-backports-modules-.*";
APT::VersionedKernelPackages:: "linux-tools";
APT::Never-MarkAuto-Sections "";
APT::Never-MarkAuto-Sections:: "metapackages";
APT::Never-MarkAuto-Sections:: "contrib/metapackages";
APT::Never-MarkAuto-Sections:: "non-free/metapackages";
APT::Never-MarkAuto-Sections:: "restricted/metapackages";
APT::Never-MarkAuto-Sections:: "universe/metapackages";
APT::Never-MarkAuto-Sections:: "multiverse/metapackages";
APT::Move-Autobit-Sections "";
APT::Move-Autobit-Sections:: "oldlibs";
APT::Move-Autobit-Sections:: "contrib/oldlibs";
APT::Move-Autobit-Sections:: "non-free/oldlibs";
APT::Move-Autobit-Sections:: "restricted/oldlibs";
APT::Move-Autobit-Sections:: "universe/oldlibs";
APT::Move-Autobit-Sections:: "multiverse/oldlibs";
APT::Periodic "";
APT::Periodic::Update-Package-Lists "1";
APT::Periodic::Unattended-Upgrade "1";
APT::Update "";
APT::Update::Post-Invoke-Success "";
APT::Update::Post-Invoke-Success:: "/usr/bin/test -e /usr/share/dbus-1/system-services/org.freedesktop.PackageKit.service && /usr/bin/test -S /var/run/dbus/system_bus_socket && /usr/bin/gdbus call --system --dest org.freedesktop.PackageKit --object-path /org/freedesktop/PackageKit --timeout 4 --method org.freedesktop.PackageKit.StateHasChanged cache-update > /dev/null; /bin/echo > /dev/null";
APT::Update::Post-Invoke-Success:: "if /usr/bin/test -w /var/cache/app-info -a -e /usr/bin/appstreamcli; then appstreamcli refresh-cache > /dev/null; fi";
APT::Default-Release "buster";
APT::Architectures "";
APT::Architectures:: "amd64";
APT::Compressor "";
APT::Compressor::. "";
APT::Compressor::.::Name ".";
APT::Compressor::.::Extension "";
APT::Compressor::.::Binary "";
APT::Compressor::.::Cost "0";
APT::Compressor::lz4 "";
APT::Compressor::lz4::Name "lz4";
APT::Compressor::lz4::Extension ".lz4";
APT::Compressor::lz4::Binary "false";
APT::Compressor::lz4::Cost "50";
APT::Compressor::gzip "";
APT::Compressor::gzip::Name "gzip";
APT::Compressor::gzip::Extension ".gz";
APT::Compressor::gzip::Binary "gzip";
APT::Compressor::gzip::Cost "100";
APT::Compressor::gzip::CompressArg "";
APT::Compressor::gzip::CompressArg:: "-6n";
APT::Compressor::gzip::UncompressArg "";
APT::Compressor::gzip::UncompressArg:: "-d";
APT::Compressor::xz "";
APT::Compressor::xz::Name "xz";
APT::Compressor::xz::Extension ".xz";
APT::Compressor::xz::Binary "xz";
APT::Compressor::xz::Cost "200";
APT::Compressor::xz::CompressArg "";
APT::Compressor::xz::CompressArg:: "-6";
APT::Compressor::xz::UncompressArg "";
APT::Compressor::xz::UncompressArg:: "-d";
APT::Compressor::bzip2 "";
APT::Compressor::bzip2::Name "bzip2";
APT::Compressor::bzip2::Extension ".bz2";
APT::Compressor::bzip2::Binary "bzip2";
APT::Compressor::bzip2::Cost "300";
APT::Compressor::bzip2::CompressArg "";
APT::Compressor::bzip2::CompressArg:: "-6";
APT::Compressor::bzip2::UncompressArg "";
APT::Compressor::bzip2::UncompressArg:: "-d";
APT::Compressor::lzma "";
APT::Compressor::lzma::Name "lzma";
APT::Compressor::lzma::Extension ".lzma";
APT::Compressor::lzma::Binary "xz";
APT::Compressor::lzma::Cost "400";
APT::Compressor::lzma::CompressArg "";
APT::Compressor::lzma::CompressArg:: "--format=lzma";
APT::Compressor::lzma::CompressArg:: "-6";
APT::Compressor::lzma::UncompressArg "";
APT::Compressor::lzma::UncompressArg:: "--format=lzma";
APT::Compressor::lzma::UncompressArg:: "-d";
Dir "/";
Dir::State "var/lib/apt";
Dir::State::lists "lists/";
Dir::State::cdroms "cdroms.list";
Dir::State::mirrors "mirrors/";
Dir::State::extended_states "extended_states";
Dir::State::status "/var/lib/dpkg/status";
Dir::Cache "var/cache/apt";
Dir::Cache::archives "archives/";
Dir::Cache::srcpkgcache "srcpkgcache.bin";
Dir::Cache::pkgcache "pkgcache.bin";
Dir::Etc "etc/apt";
Dir::Etc::sourcelist "sources.list";
Dir::Etc::sourceparts "sources.list.d";
Dir::Etc::main "apt.conf";
Dir::Etc::netrc "auth.conf";
Dir::Etc::parts "apt.conf.d";
Dir::Etc::preferences "preferences";
Dir::Etc::preferencesparts "preferences.d";
Dir::Etc::trusted "trusted.gpg";
Dir::Etc::trustedparts "trusted.gpg.d";
Dir::Bin "";
Dir::Bin::methods "/usr/lib/apt/methods";
Dir::Bin::solvers "";
Dir::Bin::solvers:: "/usr/lib/apt/solvers";
Dir::Bin::planners "";
Dir::Bin::planners:: "/usr/lib/apt/planners";
Dir::Bin::dpkg "/usr/bin/dpkg";
Dir::Bin::gzip "/bin/gzip";
Dir::Bin::bzip2 "/bin/bzip2";
Dir::Bin::xz "/usr/bin/xz";
Dir::Bin::lz4 "/usr/bin/lz4";
Dir::Bin::lzma "/usr/bin/xz";
Dir::Media "";
Dir::Media::MountPath "/media/cdrom";
Dir::Log "var/log/apt";
Dir::Log::Terminal "term.log";
Dir::Log::History "history.log";
Dir::Log::Planner "eipp.log.xz";
Dir::Ignore-Files-Silently "";
Dir::Ignore-Files-Silently:: "~$";
Dir::Ignore-Files-Silently:: "\.disabled$";
Dir::Ignore-Files-Silently:: "\.bak$";
Dir::Ignore-Files-Silently:: "\.dpkg-[a-z]+$";
Dir::Ignore-Files-Silently:: "\.ucf-[a-z]+$";
Dir::Ignore-Files-Silently:: "\.save$";
Dir::Ignore-Files-Silently:: "\.orig$";
Dir::Ignore-Files-Silently:: "\.distUpgrade$";
Acquire "";
Acquire::AllowInsecureRepositories "0";
Acquire::AllowWeakRepositories "0";
Acquire::AllowDowngradeToInsecureRepositories "0";
Acquire::cdrom "";
Acquire::cdrom::mount "/media/cdrom";
Acquire::IndexTargets "";
Acquire::IndexTargets::deb "";
Acquire::IndexTargets::deb::Packages "";
Acquire::IndexTargets::deb::Packages::MetaKey "$(COMPONENT)/binary-$(ARCHITECTURE)/Packages";
Acquire::IndexTargets::deb::Packages::flatMetaKey "Packages";
Acquire::IndexTargets::deb::Packages::ShortDescription "Packages";
Acquire::IndexTargets::deb::Packages::Description "$(RELEASE)/$(COMPONENT) $(ARCHITECTURE) Packages";
Acquire::IndexTargets::deb::Packages::flatDescription "$(RELEASE) Packages";
Acquire::IndexTargets::deb::Packages::Optional "0";
Acquire::IndexTargets::deb::Translations "";
Acquire::IndexTargets::deb::Translations::MetaKey "$(COMPONENT)/i18n/Translation-$(LANGUAGE)";
Acquire::IndexTargets::deb::Translations::flatMetaKey "$(LANGUAGE)";
Acquire::IndexTargets::deb::Translations::ShortDescription "Translation-$(LANGUAGE)";
Acquire::IndexTargets::deb::Translations::Description "$(RELEASE)/$(COMPONENT) Translation-$(LANGUAGE)";
Acquire::IndexTargets::deb::Translations::flatDescription "$(RELEASE) Translation-$(LANGUAGE)";
Acquire::IndexTargets::deb::DEP-11 "";
Acquire::IndexTargets::deb::DEP-11::MetaKey "$(COMPONENT)/dep11/Components-$(NATIVE_ARCHITECTURE).yml";
Acquire::IndexTargets::deb::DEP-11::ShortDescription "Components-$(NATIVE_ARCHITECTURE)";
Acquire::IndexTargets::deb::DEP-11::Description "$(RELEASE)/$(COMPONENT) $(NATIVE_ARCHITECTURE) DEP-11 Metadata";
Acquire::IndexTargets::deb::DEP-11::KeepCompressed "true";
Acquire::IndexTargets::deb::DEP-11::KeepCompressedAs "gz";
Acquire::IndexTargets::deb::DEP-11-icons "";
Acquire::IndexTargets::deb::DEP-11-icons::MetaKey "$(COMPONENT)/dep11/icons-64x64.tar";
Acquire::IndexTargets::deb::DEP-11-icons::ShortDescription "icons-64x64";
Acquire::IndexTargets::deb::DEP-11-icons::Description "$(RELEASE)/$(COMPONENT) DEP-11 64x64 Icons";
Acquire::IndexTargets::deb::DEP-11-icons::KeepCompressed "true";
Acquire::IndexTargets::deb::DEP-11-icons::KeepCompressedAs "gz";
Acquire::IndexTargets::deb::DEP-11-icons::DefaultEnabled "true";
Acquire::IndexTargets::deb::DEP-11-icons-hidpi "";
Acquire::IndexTargets::deb::DEP-11-icons-hidpi::MetaKey "$(COMPONENT)/dep11/icons-64x64@2.tar";
Acquire::IndexTargets::deb::DEP-11-icons-hidpi::ShortDescription "icons-64x64@2";
Acquire::IndexTargets::deb::DEP-11-icons-hidpi::Description "$(RELEASE)/$(COMPONENT) DEP-11 64x64@2 Icons";
Acquire::IndexTargets::deb::DEP-11-icons-hidpi::KeepCompressed "true";
Acquire::IndexTargets::deb::DEP-11-icons-hidpi::KeepCompressedAs "gz";
Acquire::IndexTargets::deb::DEP-11-icons-hidpi::DefaultEnabled "true";
Acquire::IndexTargets::deb::DEP-11-icons-large "";
Acquire::IndexTargets::deb::DEP-11-icons-large::MetaKey "$(COMPONENT)/dep11/icons-128x128.tar";
Acquire::IndexTargets::deb::DEP-11-icons-large::ShortDescription "icons-128x128";
Acquire::IndexTargets::deb::DEP-11-icons-large::Description "$(RELEASE)/$(COMPONENT) DEP-11 128x128 Icons";
Acquire::IndexTargets::deb::DEP-11-icons-large::KeepCompressed "true";
Acquire::IndexTargets::deb::DEP-11-icons-large::KeepCompressedAs "gz";
Acquire::IndexTargets::deb::DEP-11-icons-large::DefaultEnabled "false";
Acquire::IndexTargets::deb::DEP-11-icons-large-hidpi "";
Acquire::IndexTargets::deb::DEP-11-icons-large-hidpi::MetaKey "$(COMPONENT)/dep11/icons-128x128@2.tar";
Acquire::IndexTargets::deb::DEP-11-icons-large-hidpi::ShortDescription "icons-128x128@2";
Acquire::IndexTargets::deb::DEP-11-icons-large-hidpi::Description "$(RELEASE)/$(COMPONENT) DEP-11 128x128@2 Icons";
Acquire::IndexTargets::deb::DEP-11-icons-large-hidpi::KeepCompressed "true";
Acquire::IndexTargets::deb::DEP-11-icons-large-hidpi::KeepCompressedAs "gz";
Acquire::IndexTargets::deb::DEP-11-icons-large-hidpi::DefaultEnabled "false";
Acquire::IndexTargets::deb-src "";
Acquire::IndexTargets::deb-src::Sources "";
Acquire::IndexTargets::deb-src::Sources::MetaKey "$(COMPONENT)/source/Sources";
Acquire::IndexTargets::deb-src::Sources::flatMetaKey "Sources";
Acquire::IndexTargets::deb-src::Sources::ShortDescription "Sources";
Acquire::IndexTargets::deb-src::Sources::Description "$(RELEASE)/$(COMPONENT) Sources";
Acquire::IndexTargets::deb-src::Sources::flatDescription "$(RELEASE) Sources";
Acquire::IndexTargets::deb-src::Sources::Optional "0";
Acquire::Changelogs "";
Acquire::Changelogs::URI "";
Acquire::Changelogs::URI::Origin "";
Acquire::Changelogs::URI::Origin::Debian "http://metadata.ftp-master.debian.org/changelogs/@CHANGEPATH@_changelog";
Acquire::Changelogs::URI::Origin::Tanglu "http://metadata.tanglu.org/changelogs/@CHANGEPATH@_changelog";
Acquire::Changelogs::URI::Origin::Ubuntu "http://changelogs.ubuntu.com/changelogs/pool/@CHANGEPATH@/changelog";
Acquire::Changelogs::URI::Origin::Ultimedia "http://packages.ultimediaos.com/changelogs/pool/@CHANGEPATH@/changelog.txt";
Acquire::Changelogs::AlwaysOnline "";
Acquire::Changelogs::AlwaysOnline::Origin "";
Acquire::Changelogs::AlwaysOnline::Origin::Ubuntu "1";
Acquire::Languages "";
Acquire::Languages:: "en";
Acquire::Languages:: "none";
Acquire::CompressionTypes "";
Acquire::CompressionTypes::xz "xz";
Acquire::CompressionTypes::bz2 "bzip2";
Acquire::CompressionTypes::lzma "lzma";
Acquire::CompressionTypes::gz "gzip";
Acquire::CompressionTypes::lz4 "lz4";
Aptitude "";
Aptitude::Get-Root-Command "sudo:/usr/bin/sudo";
DPkg "";
DPkg::Pre-Install-Pkgs "";
DPkg::Pre-Install-Pkgs:: "/usr/bin/apt-listchanges --apt || test $? -lt 10";
DPkg::Pre-Install-Pkgs:: "/usr/sbin/dpkg-preconfigure --apt || true";
DPkg::Tools "";
DPkg::Tools::Options "";
DPkg::Tools::Options::/usr/bin/apt-listchanges "";
DPkg::Tools::Options::/usr/bin/apt-listchanges::Version "2";
DPkg::Tools::Options::/usr/bin/apt-listchanges::InfoFD "20";
DPkg::Post-Invoke "";
DPkg::Post-Invoke:: "/usr/bin/test -e /usr/share/dbus-1/system-services/org.freedesktop.PackageKit.service && /usr/bin/test -S /var/run/dbus/system_bus_socket && /usr/bin/gdbus call --system --dest org.freedesktop.PackageKit --object-path /org/freedesktop/PackageKit --timeout 4 --method org.freedesktop.PackageKit.StateHasChanged cache-update > /dev/null; /bin/echo > /dev/null";
Unattended-Upgrade "";
Unattended-Upgrade::Origins-Pattern "";
Unattended-Upgrade::Origins-Pattern:: "origin=Debian,codename=${distro_codename},label=Debian-Security";
Binary "apt-config";
Binary::apt "";
Binary::apt::APT "";
Binary::apt::APT::Color "1";
Binary::apt::APT::Cache "";
Binary::apt::APT::Cache::Show "";
Binary::apt::APT::Cache::Show::Version "2";
Binary::apt::APT::Cache::AllVersions "0";
Binary::apt::APT::Cache::ShowVirtuals "1";
Binary::apt::APT::Cache::Search "";
Binary::apt::APT::Cache::Search::Version "2";
Binary::apt::APT::Cache::ShowDependencyType "1";
Binary::apt::APT::Cache::ShowVersion "1";
Binary::apt::APT::Get "";
Binary::apt::APT::Get::Upgrade-Allow-New "1";
Binary::apt::APT::Get::Update "";
Binary::apt::APT::Get::Update::InteractiveReleaseInfoChanges "1";
Binary::apt::APT::Cmd "";
Binary::apt::APT::Cmd::Show-Update-Stats "1";
Binary::apt::APT::Keep-Downloaded-Packages "0";
Binary::apt::DPkg "";
Binary::apt::DPkg::Progress-Fancy "1";
CommandLine "";
CommandLine::AsString "apt-config dump";

-- (no /etc/apt/preferences present) --


-- (no /etc/apt/preferences.d/* present) --


-- /etc/apt/sources.list --

# 

deb http://ftp.us.debian.org/debian/ buster main non-free contrib
deb-src http://ftp.us.debian.org/debian/ buster main non-free contrib

deb http://security.debian.org/debian-security buster/updates main contrib non-free
deb-src http://security.debian.org/debian-security buster/updates main contrib non-free

# buster-updates, previously known as 'volatile'
deb http://ftp.us.debian.org/debian/ buster-updates main contrib non-free
deb-src http://ftp.us.debian.org/debian/ buster-updates main contrib non-free

# stretch-backports, previously on backports.debian.org
# deb http://ftp.us.debian.org/debian/ stretch-backports main contrib non-free
# deb-src http://ftp.us.debian.org/debian/ stretch-backports main contrib non-free

-- /etc/apt/sources.list.d/docker.list --

deb [arch=amd64] https://download.docker.com/linux/debian stretch stable
# deb-src [arch=amd64] https://download.docker.com/linux/debian stretch stable

-- /etc/apt/sources.list.d/experimental.list --

deb https://mirrors.wikimedia.org/debian/ experimental main contrib non-free
deb-src https://mirrors.wikimedia.org/debian/ experimental main contrib non-free

-- /etc/apt/sources.list.d/experimental.list.save --

deb http://ftp.us.debian.org/debian/ experimental main contrib non-free
deb-src http://ftp.us.debian.org/debian/ experimental main contrib non-free

-- /etc/apt/sources.list.d/google-chrome.list --

### THIS FILE IS AUTOMATICALLY CONFIGURED ###
# You may comment out this entry, but any other modifications may be lost.
deb [arch=amd64] https://dl.google.com/linux/chrome/deb/ stable main

-- /etc/apt/sources.list.d/google-chrome.list.save --

### THIS FILE IS AUTOMATICALLY CONFIGURED ###
# You may comment out this entry, but any other modifications may be lost.
deb [arch=amd64] http://dl.google.com/linux/chrome/deb/ stable main

-- /etc/apt/sources.list.d/unstable.list --

deb https://mirrors.wikimedia.org/debian/ unstable main contrib non-free
deb-src https://mirrors.wikimedia.org/debian/ unstable main contrib non-free

-- /etc/apt/sources.list.d/unstable.list.save --

deb http://ftp.us.debian.org/debian/ unstable main contrib non-free
deb-src http://ftp.us.debian.org/debian/ unstable main contrib non-free

-- System Information:
Debian Release: buster/sid
  APT prefers testing
  APT policy: (990, 'testing'), (500, 'unstable'), (1, 'experimental')
Architecture: amd64 (x86_64)

Kernel: Linux 4.12.0-2-amd64 (SMP w/4 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8), LANGUAGE=en_US:en (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)

Versions of packages apt depends on:
ii  adduser                 3.116
ii  debian-archive-keyring  2017.6
ii  gpgv                    2.2.1-5
ii  libapt-pkg5.0           1.6~alpha3
ii  libc6                   2.24-17
ii  libgcc1                 1:7.2.0-12
ii  libgnutls30             3.5.16-1
ii  libseccomp2             2.3.1-2.1
ii  libstdc++6              7.2.0-12

Versions of packages apt recommends:
ii  ca-certificates  20170717

Versions of packages apt suggests:
pn  apt-doc         <none>
ii  aptitude        0.8.9-1
ii  dpkg-dev        1.19.0.4
ii  gnupg           2.2.1-5
ii  gnupg2          2.2.1-5
ii  powermgmt-base  1.31+nmu1
ii  python-apt      1.4.0~beta3+b1

-- no debconf information

Message #10 received at 880645@bugs.debian.org (full text, mbox, reply):

From: Julian Andres Klode <jak@debian.org>

To: Ilan Cohen <ilanco@gmail.com>, 880645@bugs.debian.org, ftpmaster@debian.org

Subject: Re: Bug#880645: wrong content in xz-compressed dep11 Components files (outdated) (was: apt: Hash Sum mismatch when running apt-get update)

Date: Fri, 3 Nov 2017 10:18:53 +0100

Control: reassign -1 ftp.debian.org
Control: retitle -1 wrong content in xz-compressed dep11 Components files (outdated)

On Fri, Nov 03, 2017 at 10:54:49AM +0200, Ilan Cohen wrote:
> Package: apt
> Version: 1.6~alpha3
> Severity: important
> 
> Dear Maintainer,
> 
>    * What led up to the situation?
> 
> Running `apt-get update` gave me the following output:
> 
> ```
> Hit:1 http://security.debian.org/debian-security buster/updates InRelease
> Hit:2 http://ftp.us.debian.org/debian buster InRelease                                                                                                                            
> Hit:3 https://download.docker.com/linux/debian stretch InRelease                                                                                                                
> Ign:4 https://dl.google.com/linux/chrome/deb stable InRelease                                                                                       
> Hit:5 http://ftp.us.debian.org/debian buster-updates InRelease                                      
> Hit:6 https://dl.google.com/linux/chrome/deb stable Release              
> Hit:7 https://mirrors.wikimedia.org/debian experimental InRelease        
> Get:9 https://mirrors.wikimedia.org/debian unstable InRelease [235 kB]
> Get:10 https://mirrors.wikimedia.org/debian unstable/contrib Sources [50.8 kB]
> Get:11 https://mirrors.wikimedia.org/debian unstable/non-free Sources [83.8 kB]
> Get:12 https://mirrors.wikimedia.org/debian unstable/main Sources [7,848 kB]
> Get:13 https://mirrors.wikimedia.org/debian unstable/main amd64 Packages [7,777 kB]
> Get:14 https://mirrors.wikimedia.org/debian unstable/main Translation-en [5,867 kB]
> Get:15 https://mirrors.wikimedia.org/debian unstable/main amd64 DEP-11 Metadata [3,107 kB]
> Get:16 https://mirrors.wikimedia.org/debian unstable/main DEP-11 64x64 Icons [6,936 kB]
> Get:17 https://mirrors.wikimedia.org/debian unstable/contrib amd64 Packages [58.5 kB]
> Get:18 https://mirrors.wikimedia.org/debian unstable/contrib Translation-en [50.9 kB]
> Get:19 https://mirrors.wikimedia.org/debian unstable/contrib amd64 DEP-11 Metadata [2,924 B]
> Get:20 https://mirrors.wikimedia.org/debian unstable/contrib DEP-11 64x64 Icons [37.7 kB]
> Get:21 https://mirrors.wikimedia.org/debian unstable/non-free amd64 Packages [81.9 kB]
> Get:22 https://mirrors.wikimedia.org/debian unstable/non-free Translation-en [83.8 kB]
> Get:23 https://mirrors.wikimedia.org/debian unstable/non-free amd64 DEP-11 Metadata [6,384 B]
> Get:24 https://mirrors.wikimedia.org/debian unstable/non-free DEP-11 64x64 Icons [1,813 B]
> Err:23 https://mirrors.wikimedia.org/debian unstable/non-free amd64 DEP-11 Metadata
>   Hash Sum mismatch
>   Hashes of expected file:
>    - Filesize:65721 [weak]
>    - SHA256:0eb5ea70b4c46a7c0889e9601d16cedf3eb4ff55bf3b77ef2af2bcd3dcf48cec
>    - MD5Sum:68fdfbc3bc806010ba4c9fc8d4cb133b [weak]
>   Hashes of received file:
>    - SHA256:5fa520cd26eac94e183632f84371643219fdf905dfd351b53bbcd7afa5c3b848
>    - MD5Sum:875dd6824d698bfa73c6517307f692f5 [weak]
>    - Filesize:65721 [weak]
>   Last modification reported: Mon, 30 Oct 2017 21:09:03 +0000
>   Release file created at: Fri, 03 Nov 2017 02:41:19 +0000
> Reading package lists... Done       
> E: Failed to fetch store:/var/lib/apt/lists/partial/mirrors.wikimedia.org_debian_dists_unstable_non-free_dep11_Components-amd64.yml.xz  Hash Sum mismatch
>    Hashes of expected file:
>     - Filesize:65721 [weak]
>     - SHA256:0eb5ea70b4c46a7c0889e9601d16cedf3eb4ff55bf3b77ef2af2bcd3dcf48cec
>     - MD5Sum:68fdfbc3bc806010ba4c9fc8d4cb133b [weak]
>    Hashes of received file:
>     - SHA256:5fa520cd26eac94e183632f84371643219fdf905dfd351b53bbcd7afa5c3b848
>     - MD5Sum:875dd6824d698bfa73c6517307f692f5 [weak]
>     - Filesize:65721 [weak]
>    Last modification reported: Mon, 30 Oct 2017 21:09:03 +0000
>    Release file created at: Fri, 03 Nov 2017 02:41:19 +0000
> E: Some index files failed to download. They have been ignored, or old ones used instead.
> ```
> 
The archive is broken, .xz contains different content than .gz - writing the .xz file
failed. The are several .xz.new files, so I expect some of the other files are broken
too.



-- 
Debian Developer - deb.li/jak | jak-linux.org - free software dev
Ubuntu Core Developer                              de, en speaker

Message #23 received at 880645@bugs.debian.org (full text, mbox, reply):

From: Ansgar Burchardt <ansgar@debian.org>

To: mak@debian.org

Cc: Julian Andres Klode <jak@debian.org>, Ilan Cohen <ilanco@gmail.com>, 880645@bugs.debian.org

Subject: Re: Bug#880645: wrong content in xz-compressed dep11 Components files (outdated)

Date: Fri, 03 Nov 2017 11:26:43 +0100

Julian Andres Klode writes:
[...]
>> E: Failed to fetch store:/var/lib/apt/lists/partial/mirrors.wikimedia.org_debian_dists_unstable_non-free_dep11_Components-amd64.yml.xz  Hash Sum mismatch
>>    Hashes of expected file:
>>     - Filesize:65721 [weak]
>>     - SHA256:0eb5ea70b4c46a7c0889e9601d16cedf3eb4ff55bf3b77ef2af2bcd3dcf48cec
>>     - MD5Sum:68fdfbc3bc806010ba4c9fc8d4cb133b [weak]
>>    Hashes of received file:
>>     - SHA256:5fa520cd26eac94e183632f84371643219fdf905dfd351b53bbcd7afa5c3b848
>>     - MD5Sum:875dd6824d698bfa73c6517307f692f5 [weak]
>>     - Filesize:65721 [weak]
>>    Last modification reported: Mon, 30 Oct 2017 21:09:03 +0000
>>    Release file created at: Fri, 03 Nov 2017 02:41:19 +0000
>> E: Some index files failed to download. They have been ignored, or old ones used instead.
>> ```
>> 
> The archive is broken, .xz contains different content than .gz - writing the .xz file
> failed. The are several .xz.new files, so I expect some of the other files are broken
> too.

The appstream generator crashed and left inconsistent output data
(updates .gz, but old .xz) already on mekeel.d.o...  That is really not
nice: the data synced into the archive should really be in a staging
location and only be updated once the generator finished successfully.

CC'ed mak@ as he maintains the appstream generator.

Ansgar

Message #36 received at 880645@bugs.debian.org (full text, mbox, reply):

From: Matthias Klumpp <mak@debian.org>

To: Ansgar Burchardt <ansgar@debian.org>

Cc: Julian Andres Klode <jak@debian.org>, Ilan Cohen <ilanco@gmail.com>, 880645@bugs.debian.org

Subject: Re: Bug#880645: wrong content in xz-compressed dep11 Components files (outdated)

Date: Sun, 5 Nov 2017 04:53:24 +0100

2017-11-03 11:26 GMT+01:00 Ansgar Burchardt <ansgar@debian.org>:
> Julian Andres Klode writes:
> [...]
>>> E: Failed to fetch store:/var/lib/apt/lists/partial/mirrors.wikimedia.org_debian_dists_unstable_non-free_dep11_Components-amd64.yml.xz  Hash Sum mismatch
>>>    Hashes of expected file:
>>>     - Filesize:65721 [weak]
>>>     - SHA256:0eb5ea70b4c46a7c0889e9601d16cedf3eb4ff55bf3b77ef2af2bcd3dcf48cec
>>>     - MD5Sum:68fdfbc3bc806010ba4c9fc8d4cb133b [weak]
>>>    Hashes of received file:
>>>     - SHA256:5fa520cd26eac94e183632f84371643219fdf905dfd351b53bbcd7afa5c3b848
>>>     - MD5Sum:875dd6824d698bfa73c6517307f692f5 [weak]
>>>     - Filesize:65721 [weak]
>>>    Last modification reported: Mon, 30 Oct 2017 21:09:03 +0000
>>>    Release file created at: Fri, 03 Nov 2017 02:41:19 +0000
>>> E: Some index files failed to download. They have been ignored, or old ones used instead.
>>> ```
>>>
>> The archive is broken, .xz contains different content than .gz - writing the .xz file
>> failed. The are several .xz.new files, so I expect some of the other files are broken
>> too.
>
> The appstream generator crashed and left inconsistent output data
> (updates .gz, but old .xz) already on mekeel.d.o...  That is really not
> nice: the data synced into the archive should really be in a staging
> location and only be updated once the generator finished successfully.
>
> CC'ed mak@ as he maintains the appstream generator.

Hmm, I didn't know APT would have issues with this - I guess to be
safe it would make sense to rsync the data directory to a place where
dak can fetch it from after appstream-generator has finished
successfully.
Alternatively, I could maybe change the code so the contents of the
.gz/.xz files are ensured to be always identical.

In any case, there is bug#880645 to track this now.

Cheers,
    Matthias


-- 
I welcome VSRE emails. See http://vsre.info/

Message #41 received at 880645@bugs.debian.org (full text, mbox, reply):

From: shirish शिरीष <shirishag75@gmail.com>

To: 880645@bugs.debian.org

Subject: tor works, ping works, but apt doesn't

Date: Wed, 8 Nov 2017 18:52:08 +0000

Package: apt
Version: 1.6~alpha3
Severity: normal


Dear all,

Just to share, I *think* I'm sharing the same experience as felt/seen
by others.

I disconnected my network modem and reconnected in the case where my
ISP does trip you connection and makes it 0 (zeto at the end.) . I
disconnected and reconnected and this is what ping was showing me -

ping: sendmsg: Network is unreachable
From _gateway (192.168.1.1) icmp_seq=623 Destination Net Unreachable
64 bytes from klecker4.snt.utwente.nl (130.89.148.14): icmp_seq=712
ttl=53 time=220 ms

As shared above, all the other tools were working which strengthen the
idea that either apt or the archive is broken.  This is the output
that apt shares while updaating th iendex.

[$] sudo apt update
                                                            [23:24:40]
Get:1 http://debug.mirrors.debian.org/debian-debug buster-debug
InRelease [237 B]
Err:1 http://debug.mirrors.debian.org/debian-debug buster-debug
InRelease
  Clearsigned file isn't valid, got 'NOSPLIT' (does the network
require authentication?)
Hit:2 https://riot.im/packages/debian sid InRelease
Get:3 http://httpredir.debian.org/debian buster InRelease [237 B]
Err:3 http://httpredir.debian.org/debian buster InRelease
  Clearsigned file isn't valid, got 'NOSPLIT' (does the network
require authentication?)
Get:4 http://httpredir.debian.org/debian unstable InRelease [237 B]
Err:4 http://httpredir.debian.org/debian unstable InRelease
  Clearsigned file isn't valid, got 'NOSPLIT' (does the network
require authentication?)
Get:5 http://httpredir.debian.org/debian experimental InRelease [237
B]
Err:5 http://httpredir.debian.org/debian experimental InRelease
  Clearsigned file isn't valid, got 'NOSPLIT' (does the network
require authentication?)
Get:6 http://debug.mirrors.debian.org/debian-debug unstable-debug
InRelease [237 B]
Err:6 http://debug.mirrors.debian.org/debian-debug unstable-debug InRelease
  Clearsigned file isn't valid, got 'NOSPLIT' (does the network
require authentication?)
Get:7 http://debug.mirrors.debian.org/debian-debug experimental-debug
InRelease [237 B]
Err:7 http://debug.mirrors.debian.org/debian-debug experimental-debug InRelease
  Clearsigned file isn't valid, got 'NOSPLIT' (does the network
require authentication?)
Fetched 1,422 B in 28s (50 B/s)
Reading package lists... Done
E: Failed to fetch
http://httpredir.debian.org/debian/dists/buster/InRelease  Clearsigned
file isn't valid, got 'NOSPLIT' (does the network require
authentication?)
E: Failed to fetch
http://httpredir.debian.org/debian/dists/unstable/InRelease
Clearsigned file isn't valid, got 'NOSPLIT' (does the network require
authentication?)
E: Failed to fetch
http://httpredir.debian.org/debian/dists/experimental/InRelease
Clearsigned file isn't valid, got 'NOSPLIT' (does the network require
authentication?)
E: Failed to fetch
http://debug.mirrors.debian.org/debian-debug/dists/buster-debug/InRelease
 Clearsigned file isn't valid, got 'NOSPLIT' (does the network require
authentication?)
E: Failed to fetch
http://debug.mirrors.debian.org/debian-debug/dists/unstable-debug/InRelease
 Clearsigned file isn't valid, got 'NOSPLIT' (does the network require
authentication?)
E: Failed to fetch
http://debug.mirrors.debian.org/debian-debug/dists/experimental-debug/InRelease
 Clearsigned file isn't valid, got 'NOSPLIT' (does the network require
authentication?)
E: Some index files failed to download. They have been ignored, or old
ones used instead.

I am guessing it is as shared in the bug-report above..

Please let me know if any more info. is needed.

Also if manual upgradation of apt, libapt both which are right now
hitting unstable could improve the output.

─[$] apt-cache policy apt

[23:34:11]
apt:
  Installed: 1.6~alpha3
  Candidate: 1.6~alpha3
  Version table:
     1.6~alpha4 1
          1 http://httpredir.debian.org/debian unstable/main amd64 Packages
 *** 1.6~alpha3 600
        600 http://httpredir.debian.org/debian buster/main amd64 Packages
        100 /var/lib/dpkg/status

Looking forward to know.


-- 
          Regards,
          Shirish Agarwal  शिरीष अग्रवाल
  My quotes in this email licensed under CC 3.0
http://creativecommons.org/licenses/by-nc/3.0/
http://flossexperiences.wordpress.com
EB80 462B 08E1 A0DE A73A  2C2F 9F3D C7A4 E1C4 D2D8

Message #46 received at 880645-close@bugs.debian.org (full text, mbox, reply):

From: Matthias Klumpp <mak@debian.org>

To: Ansgar Burchardt <ansgar@debian.org>

Cc: Julian Andres Klode <jak@debian.org>, Ilan Cohen <ilanco@gmail.com>, 880645-close@bugs.debian.org

Subject: Re: Bug#880645: wrong content in xz-compressed dep11 Components files (outdated)

Date: Wed, 17 Jan 2018 19:34:43 +0100

Hi!
The root-cause of this bug has been fixed for 3 months now in
appstream-generator and on mekeel.d.o - only a patch[1] needs to be
applied to dak to make everything work again.
Therefore, I think we can close this issue.

Cheers,
    Matthias

[1]: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=887029

Send a report that this bug log contains spam.