Debian Bug report logs - #871037
unknown-horizons: run slower and slower and uses more and more memory

Toggle useless messages

Message #5 received at submit@bugs.debian.org (full text, mbox, reply):

From: Petter Reinholdtsen <pere@hungry.com>

To: submit@bugs.debian.org

Subject: unknown-horizons: run slower and slower and uses more and more memory

Date: Sun, 06 Aug 2017 20:59:45 +0200

Package: unknown-horizons
Version: 2017.1+ds-2

Hi.  When I played though the tutorial today, for the first time in a
long time, the experience at the start was quite nice, but after a while
the game became slower and slower.  A look at 'top' showed that the
program was using a lot of memory (31% of my total), and all swap was
spent.  At the end it was running so slow it was hard to use the game.

After I ended the game I did a test run in valgrind just starting and
stopping the game (ie just visiting the main meny), and according to
valgrind 200 MiB was lost and 400 MiB was indirectly lost.  In addition
there were heaps of problems reported by valgrind about use after free.

I asked about excessive memory usage on #unknown-horizons
(irc.freenode.net), and was told by user LinuxDonald that several fixes
regarding memory usage should be fixed in version 2017.2.  Perhaps some
of these fixes should be backported to Stretch?
-- 
Happy hacking
Petter Reinholdtsen

Message #10 received at 871037@bugs.debian.org (full text, mbox, reply):

From: Markus Koschany <apo@debian.org>

To: Petter Reinholdtsen <pere@hungry.com>

Cc: 871037@bugs.debian.org

Subject: Re: Bug#871037: unknown-horizons: run slower and slower and uses more and more memory

Date: Sun, 6 Aug 2017 15:40:08 -0400

On 06/08/17 14:59, Petter Reinholdtsen wrote:
> 
> Package: unknown-horizons
> Version: 2017.1+ds-2
> 
> Hi.  When I played though the tutorial today, for the first time in a
> long time, the experience at the start was quite nice, but after a while
> the game became slower and slower.  A look at 'top' showed that the
> program was using a lot of memory (31% of my total), and all swap was
> spent.  At the end it was running so slow it was hard to use the game.
> 
> After I ended the game I did a test run in valgrind just starting and
> stopping the game (ie just visiting the main meny), and according to
> valgrind 200 MiB was lost and 400 MiB was indirectly lost.  In addition
> there were heaps of problems reported by valgrind about use after free.
> 
> I asked about excessive memory usage on #unknown-horizons
> (irc.freenode.net), and was told by user LinuxDonald that several fixes
> regarding memory usage should be fixed in version 2017.2.  Perhaps some
> of these fixes should be backported to Stretch?

The problem is what shall be backported? Are those bug fixes documented 
somewhere? Can you confirm that 2017.2 resolves all memory issues and 
the "sluggishness"?

Markus

Message #15 received at 871037@bugs.debian.org (full text, mbox, reply):

From: Petter Reinholdtsen <pere@hungry.com>

To: 871037@bugs.debian.org

Subject: Re: Bug#871037: unknown-horizons: run slower and slower and uses more and more memory

Date: Sun, 06 Aug 2017 22:42:23 +0200

[Markus Koschany]
> The problem is what shall be backported? Are those bug fixes documented 
> somewhere?

I am sorry to tell that I have no idea.  I tried to ask on the IRC
channel for more details, but got no reply, so I do not know.  The
changelog for 2017.2 do not mention anything memory related, and I do
not know how to figure out which commit made a difference.

I have not given up on the IRC channel, and hope someone there can
provide more input.

> Can you confirm that 2017.2 resolves all memory issues and the
> "sluggishness"?

Nope, I have not tested 2017.2 yet.  Does this mean you do not see the
problem when you test?

-- 
Happy hacking
Petter Reinholdtsen

Message #20 received at 871037@bugs.debian.org (full text, mbox, reply):

From: Thomas Kowaliczek <linuxdonald@posteo.de>

To: 871037@bugs.debian.org

Subject: UH leaks

Date: Mon, 7 Aug 2017 08:36:21 +0200

Hello I'm the project leader of Unknown-horizons.
The version 2017.1 have some memory leaks and the engine too. They are all fixed in the last stable versions.
I would recommend to use 2017.2 from testing/unstable repo.

Greetings 

Thomas Kowaliczek 

Message #25 received at 871037@bugs.debian.org (full text, mbox, reply):

From: Markus Koschany <apo@debian.org>

To: Petter Reinholdtsen <pere@hungry.com>

Cc: 871037@bugs.debian.org

Subject: Re: Bug#871037: unknown-horizons: run slower and slower and uses more and more memory

Date: Mon, 7 Aug 2017 08:13:15 -0400

On 06/08/17 16:42, Petter Reinholdtsen wrote:
> [Markus Koschany]
>> The problem is what shall be backported? Are those bug fixes documented
>> somewhere?
> 
> I am sorry to tell that I have no idea.  I tried to ask on the IRC
> channel for more details, but got no reply, so I do not know.  The
> changelog for 2017.2 do not mention anything memory related, and I do
> not know how to figure out which commit made a difference.

Thanks for investigating the issue anyway.

> I have not given up on the IRC channel, and hope someone there can
> provide more input.
> 
>> Can you confirm that 2017.2 resolves all memory issues and the
>> "sluggishness"?
> 
> Nope, I have not tested 2017.2 yet.  Does this mean you do not see the
> problem when you test?

I can't really test it at the moment because I'm at DebConf in Canada 
but maybe upstream can clarify the situation.

Markus

Message #30 received at 871037@bugs.debian.org (full text, mbox, reply):

From: Markus Koschany <apo@debian.org>

To: Thomas Kowaliczek <linuxdonald@posteo.de>

Cc: 871037@bugs.debian.org, Petter Reinholdtsen <pere@hungry.com>

Subject: Re: Bug#871037: UH leaks

Date: Mon, 7 Aug 2017 08:19:33 -0400

On 07/08/17 02:36, Thomas Kowaliczek wrote:
> Hello I'm the project leader of Unknown-horizons.
> The version 2017.1 have some memory leaks and the engine too. They are all fixed in the last stable versions.
> I would recommend to use 2017.2 from testing/unstable repo.

Hello,

thank you for following up on this bug report.

We have already packaged the latest version of UH in unstable. The 
current problem is that we ship 2017.1 in Debian Stretch, the stable 
distribution of Debian, and updates should be minimal to comply with 
Debian's rules for stable updates. I'm not sure if we were allowed to 
backport 2017.2 to Stretch because there are other changes which makes 
it hard for our release team to review.

Can you point me to the relevant commits or patches that fix those 
memory leaks? Then I might be able to backport them. If I understand you 
correctly, fife and maybe even fifechan are affected as well? Then we 
need to clone this bug report and address those issues in all packages.

Regards,

Markus

Message #35 received at 871037@bugs.debian.org (full text, mbox, reply):

From: LinuxDonald <linuxdonald@posteo.de>

To: 871037@bugs.debian.org

Subject: Re: Bug#871037: UH leaks

Date: Mon, 07 Aug 2017 17:22:58 +0200

ON UH side it should be this commit: 
https://github.com/unknown-horizons/unknown-horizons/commit/25e933202e2db6083d0f163d978559c4ac24fb94
and on fife engine side this one: 
https://github.com/fifengine/fifengine/commit/2efebb3a0940e2570d2e7abeb54957dcb6f110ea

Am 07.08.2017 14:19 schrieb Markus Koschany:
> On 07/08/17 02:36, Thomas Kowaliczek wrote:
>> Hello I'm the project leader of Unknown-horizons.
>> The version 2017.1 have some memory leaks and the engine too. They are 
>> all fixed in the last stable versions.
>> I would recommend to use 2017.2 from testing/unstable repo.
> 
> Hello,
> 
> thank you for following up on this bug report.
> 
> We have already packaged the latest version of UH in unstable. The
> current problem is that we ship 2017.1 in Debian Stretch, the stable
> distribution of Debian, and updates should be minimal to comply with
> Debian's rules for stable updates. I'm not sure if we were allowed to
> backport 2017.2 to Stretch because there are other changes which makes
> it hard for our release team to review.
> 
> Can you point me to the relevant commits or patches that fix those
> memory leaks? Then I might be able to backport them. If I understand
> you correctly, fife and maybe even fifechan are affected as well? Then
> we need to clone this bug report and address those issues in all
> packages.
> 
> Regards,
> 
> Markus

Message #40 received at 871037@bugs.debian.org (full text, mbox, reply):

From: Petter Reinholdtsen <pere@hungry.com>

To: LinuxDonald <linuxdonald@posteo.de>, 871037@bugs.debian.org

Subject: Re: Bug#871037: UH leaks

Date: Fri, 11 Aug 2017 15:13:35 +0200

Control: clone -1 -2
Control: reassign -2 python-fife
Control: retitle -2 python-fife: leak memory when looking for icons (affects unknown-horizons)

[LinuxDonald]
> ON UH side it should be this commit: https://github.com/unknown-horizons/unknown-horizons/commit/25e933202e2db6083d0f163d978559c4ac24fb94
> and on fife engine side this one: https://github.com/fifengine/fifengine/commit/2efebb3a0940e2570d2e7abeb54957dcb6f110ea

Thank you.  Those are small and to the point, and should be possible to get
into Debian Stable.

As the fix is in two packages, I clone this bug to the python-fife package.
-- 
Happy hacking
Petter Reinholdtsen

Message #47 received at 871037@bugs.debian.org (full text, mbox, reply):

From: Petter Reinholdtsen <pere@hungry.com>

To: 871037@bugs.debian.org

Subject: Re: Bug#871037: UH leaks

Date: Fri, 11 Aug 2017 22:17:49 +0200

[Message part 1 (text/plain, inline)]

Here is a tested quilt patch to be stored in
debian/patches/1000-icon-mem-leak.patch.

I could not verify that all leaks are plugged, as the program is
still increasing in size while playing, and I do not know if this
is normal or not.  But the code in question make sense and is from
upstream, so it should at least reduce the amount of memory used. :)

I tested with the patch in place, and the game is working as it should.
I was not able to trigger the slowdown, but do not know if I played
long enough. :)

-- 
Happy hacking
Petter Reinholdtsen

[1000-icon-mem-leak.patch (text/x-diff, attachment)]

Message #52 received at 871037@bugs.debian.org (full text, mbox, reply):

From: Markus Koschany <apo@debian.org>

To: 871037@bugs.debian.org, pere@hungry.com

Subject: Re: Bug#871037: UH leaks

Date: Mon, 21 Aug 2017 09:39:03 +0200

[Message part 1 (text/plain, inline)]

Control: tags -1 pending
Control: block -1 by 872776

On Fri, 11 Aug 2017 22:17:49 +0200 Petter Reinholdtsen <pere@hungry.com>
wrote:
> Here is a tested quilt patch to be stored in
> debian/patches/1000-icon-mem-leak.patch.
> 
> I could not verify that all leaks are plugged, as the program is
> still increasing in size while playing, and I do not know if this
> is normal or not.  But the code in question make sense and is from
> upstream, so it should at least reduce the amount of memory used. :)
> 
> I tested with the patch in place, and the game is working as it should.
> I was not able to trigger the slowdown, but do not know if I played
> long enough. :)

Hi,

thank you for the patch. I have prepared a stretch-pu and the issue will
hopefully be resolved soon.

Regards,

Markus

[signature.asc (application/pgp-signature, attachment)]

Message #63 received at 871037-close@bugs.debian.org (full text, mbox, reply):

From: Markus Koschany <apo@debian.org>

To: 871037-close@bugs.debian.org

Subject: Bug#871037: fixed in unknown-horizons 2017.1+ds-2+deb9u1

Date: Wed, 23 Aug 2017 20:47:31 +0000

Source: unknown-horizons
Source-Version: 2017.1+ds-2+deb9u1

We believe that the bug you reported is fixed in the latest version of
unknown-horizons, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 871037@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Markus Koschany <apo@debian.org> (supplier of updated unknown-horizons package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@ftp-master.debian.org)


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

Format: 1.8
Date: Mon, 21 Aug 2017 08:54:57 +0200
Source: unknown-horizons
Binary: unknown-horizons
Architecture: source
Version: 2017.1+ds-2+deb9u1
Distribution: stretch
Urgency: medium
Maintainer: Debian Games Team <pkg-games-devel@lists.alioth.debian.org>
Changed-By: Markus Koschany <apo@debian.org>
Description:
 unknown-horizons - 2D realtime strategy simulation
Closes: 871037
Changes:
 unknown-horizons (2017.1+ds-2+deb9u1) stretch; urgency=medium
 .
   * Team upload.
   * Add 1000-icon-mem-leak.patch and fix a memory leak.
     Thanks to Petter Reinholdtsen for the report and testing and LinuxDonald
     for the patch. (Closes: #871037)
Checksums-Sha1:
 1d73cc8771c8b5bedbd44a69bcd0a97dbf96ada3 2298 unknown-horizons_2017.1+ds-2+deb9u1.dsc
 658f2c2335d53ad8f264b1602eb37927c3d8db32 13556 unknown-horizons_2017.1+ds-2+deb9u1.debian.tar.xz
 e6fddf0373a76a68ad530857dcd6aead3d543163 7756 unknown-horizons_2017.1+ds-2+deb9u1_source.buildinfo
Checksums-Sha256:
 cc85efe60b32ab931be03716cd0b6f31f60c064aad278ac72f6aff11761d0b6d 2298 unknown-horizons_2017.1+ds-2+deb9u1.dsc
 4b1be8357f7661b8fa5e90ee5c4c75571ed849a7dd66a03f8089324b8f9a5177 13556 unknown-horizons_2017.1+ds-2+deb9u1.debian.tar.xz
 7c8016d61db8f557f673038443e04c3ec2284dfc2c650bb020f79d550c729311 7756 unknown-horizons_2017.1+ds-2+deb9u1_source.buildinfo
Files:
 5bd13fc1481116f7124575f78236fcf2 2298 games optional unknown-horizons_2017.1+ds-2+deb9u1.dsc
 3b9b736a70c97221a7983c5a4d8956c4 13556 games optional unknown-horizons_2017.1+ds-2+deb9u1.debian.tar.xz
 93dc214fd59e50e1bde09cb8f48289e0 7756 games optional unknown-horizons_2017.1+ds-2+deb9u1_source.buildinfo

-----BEGIN PGP SIGNATURE-----

iQKjBAEBCgCNFiEErPPQiO8y7e9qGoNf2a0UuVE7UeQFAlmcqodfFIAAAAAALgAo
aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEFD
RjNEMDg4RUYzMkVERUY2QTFBODM1RkQ5QUQxNEI5NTEzQjUxRTQPHGFwb0BkZWJp
YW4ub3JnAAoJENmtFLlRO1HksB0P/jKFPdFz7CiG8D56yfQkHeznIbVyyyw+tdif
h4uX95aPlhEuOscSvKDChQcN+Iq/HgxBXNL/c72LHY2Q4y4cJYByXMbCV2m0byq6
Dui9F0fPYHfWlgUOdsUUOap8Ru3pVjV5FJYD0ZRQgJwBxdJrwmwGSBQrwt3sfsw9
LuYAD1lIFexVLpcl9JWqbKnKJScC2SGb1f1YDons4z0MbMXGpItPWFUdHgYXSQSM
r/wJBahtS5sHEsEKfcHA94Y8g5GfF+uzagTeeWNsi0Bp7EYpTZc7edeMLUBGRG6c
pMf9qs/ZUVMGIVfXaFDhBCLUtRf7VLPToWcV/UttZuwIKMwl9yj3b4QbnsMQRIAq
7htWFeQf9t8yeCKIuDiHXgK847yawiA/LWGcROXhh2ffcOQ+ZKMBsRpmcm/SS020
8o4F2kZXtJh/UQlP58eZ+3W3TTlRpKE6cvIq9OvFN3vHOe/aG428IWFdjC/q1avH
tCTBeRtHFDn7NLkmwC/kkU6SksUmnE8CpCOLyMnGPou5oC9BCXD4SvYuzyrzNyi4
N27/EE0Tirbk09irU1vRROAn5PcWm97O2o52oc+fD6wKN3p+EuLkbRwBHfhzfkNh
fJ33vQGKUcG2RPxhSlwvQ9g90rDfU0Nyucaeo2aZ+0Zb/Xij3UeZZI5u1wVJpPzE
JqXb6BQV
=+952
-----END PGP SIGNATURE-----

Send a report that this bug log contains spam.