Debian Bug report logs - #1017435
debian-installer: georgian text mode fails to render all characters

version graph

Package: debian-installer; Maintainer for debian-installer is Debian Install System Team <debian-boot@lists.debian.org>; Source for debian-installer is src:debian-installer (PTS, buildd, popcon).

Reported by: Philip Hands <phil@hands.com>

Date: Tue, 16 Aug 2022 09:33:01 UTC

Severity: normal

Fixed in version debian-installer/20230207

Done: Cyril Brulebois <kibi@debian.org>

Bug is archived. No further changes may be made.

Toggle useless messages

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to debian-bugs-dist@lists.debian.org, Debian Install System Team <debian-boot@lists.debian.org>:
Bug#1017435; Package debian-installer. (Tue, 16 Aug 2022 09:33:03 GMT) (full text, mbox, link).


Acknowledgement sent to Philip Hands <phil@hands.com>:
New Bug report received and forwarded. Copy sent to Debian Install System Team <debian-boot@lists.debian.org>. (Tue, 16 Aug 2022 09:33:03 GMT) (full text, mbox, link).


Message #5 received at submit@bugs.debian.org (full text, mbox, reply):

From: Philip Hands <phil@hands.com>
To: Debian Bug Tracking System <submit@bugs.debian.org>
Subject: debian-installer: georgian text mode fails to render all characters
Date: Tue, 16 Aug 2022 11:22:30 +0200
[Message part 1 (text/plain, inline)]
Package: debian-installer
Severity: normal

openQA just noticed that the rendering of certain characters just changed,
highlighting the fact that the rendering was already broken.

For example the prompt for the hostname:

msgid "Please enter the hostname for this system."
msgstr "გთხოვთ შეიყვანოთ კომპიუტერის სახელი."

gets displayed as something like:

   გთ_ოვთ შეი_ვანოთ კომპიუტერის სა_ელი."

so it looks like it's failing to deal with at least these characeters:

  https://www.compart.com/en/unicode/U+10EE
and
  https://www.compart.com/en/unicode/U+10E7

In the past the _'s would have appeared as blanks, whereas now they are inverted
and show as blue squares (which is an improvement, since this makes it obvious
that something's wrong, and also caused openQA to notice the change)

The old look can be seen here:

  https://openqa.debian.net/tests/69846#step/hostname/1

The new look here:

  https://openqa.debian.net/tests/69954#step/hostname/2

and I'll attach screenshots of the same (for when the links rot)

Cheers, Phil.
[georgian_old_look.png (image/png, attachment)]
[georgian_new_look.png (image/png, attachment)]

Information forwarded to debian-bugs-dist@lists.debian.org, Debian Install System Team <debian-boot@lists.debian.org>:
Bug#1017435; Package debian-installer. (Tue, 16 Aug 2022 21:03:02 GMT) (full text, mbox, link).


Acknowledgement sent to Holger Wansing <hwansing@mailbox.org>:
Extra info received and forwarded to list. Copy sent to Debian Install System Team <debian-boot@lists.debian.org>. (Tue, 16 Aug 2022 21:03:02 GMT) (full text, mbox, link).


Message #10 received at 1017435@bugs.debian.org (full text, mbox, reply):

From: Holger Wansing <hwansing@mailbox.org>
To: Philip Hands <phil@hands.com>, 1017435@bugs.debian.org
Subject: Re: Bug#1017435: debian-installer: georgian text mode fails to render all characters
Date: Tue, 16 Aug 2022 22:59:34 +0200
Hi Phil,

thanks for bringing this up.

Philip Hands <phil@hands.com> wrote (Tue, 16 Aug 2022 11:22:30 +0200):
> openQA just noticed that the rendering of certain characters just changed,
> highlighting the fact that the rendering was already broken.


To be more precise here:
- this only affects the text installer; rendering in graphical installer seems fine;
- Georgian started to be available for the text installer in debian 10, and some
  research showed, that this issue is there from that beginning (debian 10).

Since noone noticed this for years, maybe we can go with a workaround to
disable Georgian for the text installer (if noone finds the real solution
for this).


Holger



-- 
Holger Wansing <hwansing@mailbox.org>
PGP-Fingerprint: 496A C6E8 1442 4B34 8508  3529 59F1 87CA 156E B076



Information forwarded to debian-bugs-dist@lists.debian.org, Debian Install System Team <debian-boot@lists.debian.org>:
Bug#1017435; Package debian-installer. (Fri, 09 Dec 2022 22:39:02 GMT) (full text, mbox, link).


Acknowledgement sent to Holger Wansing <hwansing@mailbox.org>:
Extra info received and forwarded to list. Copy sent to Debian Install System Team <debian-boot@lists.debian.org>. (Fri, 09 Dec 2022 22:39:02 GMT) (full text, mbox, link).


Message #15 received at 1017435@bugs.debian.org (full text, mbox, reply):

From: Holger Wansing <hwansing@mailbox.org>
To: Holger Wansing <hwansing@mailbox.org>, 1017435@bugs.debian.org
Cc: Philip Hands <phil@hands.com>
Subject: Re: Bug#1017435: debian-installer: georgian text mode fails to render all characters
Date: Fri, 9 Dec 2022 23:34:48 +0100
Hi,

Holger Wansing <hwansing@mailbox.org> wrote (Tue, 16 Aug 2022 22:59:34 +0200):
> 
> Philip Hands <phil@hands.com> wrote (Tue, 16 Aug 2022 11:22:30 +0200):
> > openQA just noticed that the rendering of certain characters just changed,
> > highlighting the fact that the rendering was already broken.
> 
> 
> To be more precise here:
> - this only affects the text installer; rendering in graphical installer seems fine;
> - Georgian started to be available for the text installer in debian 10, and some
>   research showed, that this issue is there from that beginning (debian 10).
> 
> Since noone noticed this for years, maybe we can go with a workaround to
> disable Georgian for the text installer (if noone finds the real solution
> for this).

As a workaround, I have now disabled Georgian in the text installer for now:
https://salsa.debian.org/installer-team/localechooser/-/commit/6391b845540667d649a5ee118410867f11b0ce81


Holger


-- 
Holger Wansing <hwansing@mailbox.org>
PGP-Fingerprint: 496A C6E8 1442 4B34 8508  3529 59F1 87CA 156E B076



Bug reassigned from package 'debian-installer' to 'src:bogl'. Request was from Samuel Thibault <sthibault@debian.org> to control@bugs.debian.org. (Sun, 01 Jan 2023 18:03:02 GMT) (full text, mbox, link).


Bug reassigned from package 'src:bogl' to 'debian-installer'. Request was from Samuel Thibault <sthibault@debian.org> to control@bugs.debian.org. (Sun, 01 Jan 2023 19:09:06 GMT) (full text, mbox, link).


Information forwarded to debian-bugs-dist@lists.debian.org, Debian Install System Team <debian-boot@lists.debian.org>:
Bug#1017435; Package debian-installer. (Sun, 01 Jan 2023 19:18:03 GMT) (full text, mbox, link).


Acknowledgement sent to Samuel Thibault <sthibault@debian.org>:
Extra info received and forwarded to list. Copy sent to Debian Install System Team <debian-boot@lists.debian.org>. (Sun, 01 Jan 2023 19:18:03 GMT) (full text, mbox, link).


Message #24 received at 1017435@bugs.debian.org (full text, mbox, reply):

From: Samuel Thibault <sthibault@debian.org>
To: Holger Wansing <hwansing@mailbox.org>, 1017435@bugs.debian.org, aietkolkhi@gmail.com, aidter@use.startmail.com, 53352@protonmail.com, taya13@gmail.com
Cc: Philip Hands <phil@hands.com>
Subject: Re: Bug#1017435: debian-installer: georgian text mode fails to render all characters
Date: Sun, 1 Jan 2023 20:14:36 +0100
Hello,

Holger Wansing, le mar. 16 août 2022 22:59:34 +0200, a ecrit:
> Philip Hands <phil@hands.com> wrote (Tue, 16 Aug 2022 11:22:30 +0200):
> > openQA just noticed that the rendering of certain characters just changed,
> > highlighting the fact that the rendering was already broken.
> 
> To be more precise here:
> - this only affects the text installer; rendering in graphical installer seems fine;
> - Georgian started to be available for the text installer in debian 10, and some
>   research showed, that this issue is there from that beginning (debian 10).
> 
> Since noone noticed this for years, maybe we can go with a workaround to
> disable Georgian for the text installer (if noone finds the real solution
> for this).

The solution is simply to add the required characters in
debian-installer/build/needed-characters/ka.utf:

https://d-i.debian.org/doc/i18n-guide/ch03s06.html

I'm surprised that this was missed. Was

https://d-i.debian.org/doc/i18n-guide/ch03.html

not followed?

Samuel



Information forwarded to debian-bugs-dist@lists.debian.org, Debian Install System Team <debian-boot@lists.debian.org>:
Bug#1017435; Package debian-installer. (Sun, 01 Jan 2023 19:51:03 GMT) (full text, mbox, link).


Acknowledgement sent to Holger Wansing <hwansing@mailbox.org>:
Extra info received and forwarded to list. Copy sent to Debian Install System Team <debian-boot@lists.debian.org>. (Sun, 01 Jan 2023 19:51:03 GMT) (full text, mbox, link).


Message #29 received at 1017435@bugs.debian.org (full text, mbox, reply):

From: Holger Wansing <hwansing@mailbox.org>
To: Samuel Thibault <sthibault@debian.org>
Cc: 1017435@bugs.debian.org, aietkolkhi@gmail.com, aidter@use.startmail.com, 53352@protonmail.com, taya13@gmail.com, Philip Hands <phil@hands.com>
Subject: Re: Bug#1017435: debian-installer: georgian text mode fails to render all characters
Date: Sun, 1 Jan 2023 20:49:43 +0100
Hi,

Samuel Thibault <sthibault@debian.org> wrote (Sun, 1 Jan 2023 20:14:36 +0100):
> Hello,
> 
> Holger Wansing, le mar. 16 août 2022 22:59:34 +0200, a ecrit:
> > Philip Hands <phil@hands.com> wrote (Tue, 16 Aug 2022 11:22:30 +0200):
> > > openQA just noticed that the rendering of certain characters just changed,
> > > highlighting the fact that the rendering was already broken.
> > 
> > To be more precise here:
> > - this only affects the text installer; rendering in graphical installer seems fine;
> > - Georgian started to be available for the text installer in debian 10, and some
> >   research showed, that this issue is there from that beginning (debian 10).
> > 
> > Since noone noticed this for years, maybe we can go with a workaround to
> > disable Georgian for the text installer (if noone finds the real solution
> > for this).
> 
> The solution is simply to add the required characters in
> debian-installer/build/needed-characters/ka.utf:
> 
> https://d-i.debian.org/doc/i18n-guide/ch03s06.html
> 
> I'm surprised that this was missed. Was
> 
> https://d-i.debian.org/doc/i18n-guide/ch03.html
> 
> not followed?

Apparently not :-(

So, we need a Georgian translator, providing us a file with all non-ascii 
characters needed for the Georgian language.

Can anyone help us, please?


Thanks

Holger




-- 
Holger Wansing <hwansing@mailbox.org>
PGP-Fingerprint: 496A C6E8 1442 4B34 8508  3529 59F1 87CA 156E B076



Information forwarded to debian-bugs-dist@lists.debian.org, Debian Install System Team <debian-boot@lists.debian.org>:
Bug#1017435; Package debian-installer. (Fri, 06 Jan 2023 12:48:06 GMT) (full text, mbox, link).


Acknowledgement sent to Roland Clobus <rclobus@rclobus.nl>:
Extra info received and forwarded to list. Copy sent to Debian Install System Team <debian-boot@lists.debian.org>. (Fri, 06 Jan 2023 12:48:06 GMT) (full text, mbox, link).


Message #34 received at 1017435@bugs.debian.org (full text, mbox, reply):

From: Roland Clobus <rclobus@rclobus.nl>
To: Holger Wansing <hwansing@mailbox.org>, 1017435@bugs.debian.org, Samuel Thibault <sthibault@debian.org>
Cc: aietkolkhi@gmail.com, aidter@use.startmail.com, 53352@protonmail.com, taya13@gmail.com, Philip Hands <phil@hands.com>
Subject: Re: Bug#1017435: debian-installer: georgian text mode fails to render all characters
Date: Fri, 6 Jan 2023 13:38:34 +0100
[Message part 1 (text/plain, inline)]
On 01/01/2023 20:49, Holger Wansing wrote:
> Hi,
> 
> Samuel Thibault <sthibault@debian.org> wrote (Sun, 1 Jan 2023 20:14:36 +0100):
>> Hello,
>>
>> Holger Wansing, le mar. 16 août 2022 22:59:34 +0200, a ecrit:
>>> Philip Hands <phil@hands.com> wrote (Tue, 16 Aug 2022 11:22:30 +0200):
>>>> openQA just noticed that the rendering of certain characters just changed,
>>>> highlighting the fact that the rendering was already broken.
...
>> The solution is simply to add the required characters in
>> debian-installer/build/needed-characters/ka.utf:

> So, we need a Georgian translator, providing us a file with all non-ascii
> characters needed for the Georgian language.
> 
> Can anyone help us, please?

With the attached script you can generate a list of all characters that 
are used in the translations. That can be used to determine the minimal 
set of required characters.

With kind regards,
Roland Clobus
[chars.py (text/x-python, attachment)]
[OpenPGP_signature (application/pgp-signature, attachment)]

Information forwarded to debian-bugs-dist@lists.debian.org, Debian Install System Team <debian-boot@lists.debian.org>:
Bug#1017435; Package debian-installer. (Fri, 06 Jan 2023 15:24:06 GMT) (full text, mbox, link).


Acknowledgement sent to Samuel Thibault <sthibault@debian.org>:
Extra info received and forwarded to list. Copy sent to Debian Install System Team <debian-boot@lists.debian.org>. (Fri, 06 Jan 2023 15:24:06 GMT) (full text, mbox, link).


Message #39 received at 1017435@bugs.debian.org (full text, mbox, reply):

From: Samuel Thibault <sthibault@debian.org>
To: Roland Clobus <rclobus@rclobus.nl>
Cc: Holger Wansing <hwansing@mailbox.org>, 1017435@bugs.debian.org, aietkolkhi@gmail.com, aidter@use.startmail.com, 53352@protonmail.com, taya13@gmail.com, Philip Hands <phil@hands.com>
Subject: Re: Bug#1017435: debian-installer: georgian text mode fails to render all characters
Date: Fri, 6 Jan 2023 16:20:38 +0100
Roland Clobus, le ven. 06 janv. 2023 13:38:34 +0100, a ecrit:
> On 01/01/2023 20:49, Holger Wansing wrote:
> > Samuel Thibault <sthibault@debian.org> wrote (Sun, 1 Jan 2023 20:14:36 +0100):
> > > Hello,
> > > 
> > > Holger Wansing, le mar. 16 août 2022 22:59:34 +0200, a ecrit:
> > > > Philip Hands <phil@hands.com> wrote (Tue, 16 Aug 2022 11:22:30 +0200):
> > > > > openQA just noticed that the rendering of certain characters just changed,
> > > > > highlighting the fact that the rendering was already broken.
> ...
> > > The solution is simply to add the required characters in
> > > debian-installer/build/needed-characters/ka.utf:
> 
> > So, we need a Georgian translator, providing us a file with all non-ascii
> > characters needed for the Georgian language.
> > 
> > Can anyone help us, please?
> 
> With the attached script you can generate a list of all characters that are
> used in the translations. That can be used to determine the minimal set of
> required characters.

We already do that in the debian installer, but that is not enough to be
reasonably sure that this covers all questions that might happen during
installation, since questions could be asked by any udeb. That's why we
rather request for a an explicit file from actual translators.

Samuel



Information forwarded to debian-bugs-dist@lists.debian.org, Debian Install System Team <debian-boot@lists.debian.org>:
Bug#1017435; Package debian-installer. (Sat, 07 Jan 2023 10:36:03 GMT) (full text, mbox, link).


Acknowledgement sent to Roland Clobus <rclobus@rclobus.nl>:
Extra info received and forwarded to list. Copy sent to Debian Install System Team <debian-boot@lists.debian.org>. (Sat, 07 Jan 2023 10:36:03 GMT) (full text, mbox, link).


Message #44 received at 1017435@bugs.debian.org (full text, mbox, reply):

From: Roland Clobus <rclobus@rclobus.nl>
To: Samuel Thibault <sthibault@debian.org>, 1017435@bugs.debian.org
Cc: Holger Wansing <hwansing@mailbox.org>, aietkolkhi@gmail.com, aidter@use.startmail.com, 53352@protonmail.com, taya13@gmail.com, Philip Hands <phil@hands.com>
Subject: Re: Bug#1017435: debian-installer: georgian text mode fails to render all characters
Date: Sat, 7 Jan 2023 11:31:29 +0100
[Message part 1 (text/plain, inline)]
On 06/01/2023 16:20, Samuel Thibault wrote:
> Roland Clobus, le ven. 06 janv. 2023 13:38:34 +0100, a ecrit:
>> With the attached script you can generate a list of all characters that are
>> used in the translations. That can be used to determine the minimal set of
>> required characters.
> 
> We already do that in the debian installer, but that is not enough to be
> reasonably sure that this covers all questions that might happen during
> installation, since questions could be asked by any udeb. That's why we
> rather request for a an explicit file from actual translators.

I agree. But the work for the translators can be reduced by 
automatically parsing the work they have already done (i.e. the 
translations).
That would leave only some characters that have not been used in any 
translated text, but might be present i.e. on the keyboard.
@Translators: It that something you might want to use?

If those additional characters would be listed in a second line in the 
file, it would even allow for friction-less merges.
(I.e. the first line would be autogenerated from the provided 
translations and the second line would be a list of additional characters)

In order not to miss any translated text, I've updated the script to 
parse all .udeb files that are present on the installation medium and 
extract the template from them. This ensures that all questions that 
might happen during installation will be could.
Or... are additional udebs downloaded on demand?

# How to run this script:
# 1) cd path_of_git_workdirectory_of_debian-installer
# 2) find mount_point_of_installer_image -name "*.udeb" | awk -e '{ 
print "dpkg-deb --control ", $1; print "if [ -e DEBIAN/templates ]; then 
cat DEBIAN/templates >> collect; fi"; print "rm -fr DEBIAN" }' | sh
# 3) python3 chars_v2.py
# Carefully evaluate the proposed modifications in build/needed-characters

With kind regards,
Roland Clobus

Attached:
1) chars_v2.py: The updated script
2) sample.summary: Its output to the console
3) ka.utf: Automatically generated Georgian list of use characters
[chars_v2.py (text/x-python, attachment)]
[sample.summary (text/plain, attachment)]
[ka.utf (text/plain, attachment)]
[OpenPGP_signature (application/pgp-signature, attachment)]

Information forwarded to debian-bugs-dist@lists.debian.org, Debian Install System Team <debian-boot@lists.debian.org>:
Bug#1017435; Package debian-installer. (Sat, 07 Jan 2023 10:51:05 GMT) (full text, mbox, link).


Acknowledgement sent to Holger Wansing <hwansing@mailbox.org>:
Extra info received and forwarded to list. Copy sent to Debian Install System Team <debian-boot@lists.debian.org>. (Sat, 07 Jan 2023 10:51:05 GMT) (full text, mbox, link).


Message #49 received at 1017435@bugs.debian.org (full text, mbox, reply):

From: Holger Wansing <hwansing@mailbox.org>
To: 1017435@bugs.debian.org
Cc: Roland Clobus <rclobus@rclobus.nl>, aietkolkhi@gmail.com, aidter@use.startmail.com, 53352@protonmail.com, taya13@gmail.com, Philip Hands <phil@hands.com>, Samuel Thibault <sthibault@debian.org>
Subject: Re: Bug#1017435: debian-installer: georgian text mode fails to render all characters
Date: Sat, 7 Jan 2023 11:48:13 +0100
Control: tags -1 + pending


Hi,

Samuel Thibault <sthibault@debian.org> wrote (Fri, 6 Jan 2023 16:20:38 +0100):
> Roland Clobus, le ven. 06 janv. 2023 13:38:34 +0100, a ecrit:
> > On 01/01/2023 20:49, Holger Wansing wrote:
> > > Samuel Thibault <sthibault@debian.org> wrote (Sun, 1 Jan 2023 20:14:36 +0100):
> > > > Hello,
> > > > 
> > > > Holger Wansing, le mar. 16 août 2022 22:59:34 +0200, a ecrit:
> > > > > Philip Hands <phil@hands.com> wrote (Tue, 16 Aug 2022 11:22:30 +0200):
> > > > > > openQA just noticed that the rendering of certain characters just changed,
> > > > > > highlighting the fact that the rendering was already broken.
> > ...
> > > > The solution is simply to add the required characters in
> > > > debian-installer/build/needed-characters/ka.utf:
> > 
> > > So, we need a Georgian translator, providing us a file with all non-ascii
> > > characters needed for the Georgian language.
> > > 
> > > Can anyone help us, please?
> > 
> > With the attached script you can generate a list of all characters that are
> > used in the translations. That can be used to determine the minimal set of
> > required characters.

Roland: thanks for this tool. It may be useful at some point, however in
this case I chose a different approach.

> We already do that in the debian installer, but that is not enough to be
> reasonably sure that this covers all questions that might happen during
> installation, since questions could be asked by any udeb. That's why we
> rather request for a an explicit file from actual translators.

I have now generated such file from 
https://en.wikipedia.org/wiki/Georgian_language

Tests have proven to fix the problem.


Holger



-- 
Holger Wansing <hwansing@mailbox.org>
PGP-Fingerprint: 496A C6E8 1442 4B34 8508  3529 59F1 87CA 156E B076



Added tag(s) pending. Request was from Holger Wansing <hwansing@mailbox.org> to 1017435-submit@bugs.debian.org. (Sat, 07 Jan 2023 10:51:05 GMT) (full text, mbox, link).


Information forwarded to debian-bugs-dist@lists.debian.org, Debian Install System Team <debian-boot@lists.debian.org>:
Bug#1017435; Package debian-installer. (Sat, 07 Jan 2023 11:03:02 GMT) (full text, mbox, link).


Acknowledgement sent to Samuel Thibault <sthibault@debian.org>:
Extra info received and forwarded to list. Copy sent to Debian Install System Team <debian-boot@lists.debian.org>. (Sat, 07 Jan 2023 11:03:03 GMT) (full text, mbox, link).


Message #56 received at 1017435@bugs.debian.org (full text, mbox, reply):

From: Samuel Thibault <sthibault@debian.org>
To: Roland Clobus <rclobus@rclobus.nl>
Cc: 1017435@bugs.debian.org, Holger Wansing <hwansing@mailbox.org>, aietkolkhi@gmail.com, aidter@use.startmail.com, 53352@protonmail.com, taya13@gmail.com, Philip Hands <phil@hands.com>
Subject: Re: Bug#1017435: debian-installer: georgian text mode fails to render all characters
Date: Sat, 7 Jan 2023 11:59:32 +0100
Roland Clobus, le sam. 07 janv. 2023 11:31:29 +0100, a ecrit:
> On 06/01/2023 16:20, Samuel Thibault wrote:
> > Roland Clobus, le ven. 06 janv. 2023 13:38:34 +0100, a ecrit:
> > > With the attached script you can generate a list of all characters that are
> > > used in the translations. That can be used to determine the minimal set of
> > > required characters.
> > 
> > We already do that in the debian installer, but that is not enough to be
> > reasonably sure that this covers all questions that might happen during
> > installation, since questions could be asked by any udeb. That's why we
> > rather request for a an explicit file from actual translators.
> 
> I agree. But the work for the translators can be reduced by automatically
> parsing the work they have already done (i.e. the translations).

Ah ok I misread what you meant. Yes that can be a good base, which can
then be proofread by translators.

> In order not to miss any translated text, I've updated the script to parse
> all .udeb files that are present on the installation medium and extract the
> template from them. This ensures that all questions that might happen during
> installation will be could.
> Or... are additional udebs downloaded on demand?

It seems from the list.gz files that udebs are on the first iso, and
from the debian-cd exclude files that the only udebs which are not there
are the ones which are already included in the d-i initrd.

I doesn't seem that your current script looks at the udebs included in
the initrd?

Samuel



Information forwarded to debian-bugs-dist@lists.debian.org, Debian Install System Team <debian-boot@lists.debian.org>:
Bug#1017435; Package debian-installer. (Sun, 08 Jan 2023 17:51:05 GMT) (full text, mbox, link).


Acknowledgement sent to Holger Wansing <hwansing@mailbox.org>:
Extra info received and forwarded to list. Copy sent to Debian Install System Team <debian-boot@lists.debian.org>. (Sun, 08 Jan 2023 17:51:05 GMT) (full text, mbox, link).


Message #61 received at 1017435@bugs.debian.org (full text, mbox, reply):

From: Holger Wansing <hwansing@mailbox.org>
To: Roland Clobus <rclobus@rclobus.nl>, 1017435@bugs.debian.org
Cc: Samuel Thibault <sthibault@debian.org>, aietkolkhi@gmail.com, aidter@use.startmail.com, 53352@protonmail.com, taya13@gmail.com, Philip Hands <phil@hands.com>
Subject: Re: Bug#1017435: debian-installer: georgian text mode fails to render all characters
Date: Sun, 8 Jan 2023 18:49:34 +0100
Hi,

Roland Clobus <rclobus@rclobus.nl> wrote (Sat, 7 Jan 2023 11:31:29 +0100):
> I agree. But the work for the translators can be reduced by 
> automatically parsing the work they have already done (i.e. the 
> translations).
> That would leave only some characters that have not been used in any 
> translated text, but might be present i.e. on the keyboard.
> @Translators: It that something you might want to use?

For a translator, it's just a matter of 1 minute, to write down the 
alphabet for his language, I guess.

But anyway, we can still use your script, if we cannot get such info from
translator (if there is no active translator, for example).

> Attached:
> 1) chars_v2.py: The updated script
> 2) sample.summary: Its output to the console
> 3) ka.utf: Automatically generated Georgian list of use characters

The ka.utf you attached is conspicuously (nearly) identical to what I grabbed
from Wikipedia, so: good work!!!


Holger


-- 
Holger Wansing <hwansing@mailbox.org>
PGP-Fingerprint: 496A C6E8 1442 4B34 8508  3529 59F1 87CA 156E B076



Information forwarded to debian-bugs-dist@lists.debian.org, Debian Install System Team <debian-boot@lists.debian.org>:
Bug#1017435; Package debian-installer. (Mon, 09 Jan 2023 16:51:03 GMT) (full text, mbox, link).


Acknowledgement sent to Roland Clobus <rclobus@rclobus.nl>:
Extra info received and forwarded to list. Copy sent to Debian Install System Team <debian-boot@lists.debian.org>. (Mon, 09 Jan 2023 16:51:03 GMT) (full text, mbox, link).


Message #66 received at 1017435@bugs.debian.org (full text, mbox, reply):

From: Roland Clobus <rclobus@rclobus.nl>
To: Holger Wansing <hwansing@mailbox.org>, 1017435@bugs.debian.org
Cc: Samuel Thibault <sthibault@debian.org>, aietkolkhi@gmail.com, aidter@use.startmail.com, 53352@protonmail.com, taya13@gmail.com, Philip Hands <phil@hands.com>
Subject: Re: Bug#1017435: debian-installer: georgian text mode fails to render all characters
Date: Mon, 9 Jan 2023 17:46:37 +0100
[Message part 1 (text/plain, inline)]
On 08/01/2023 18:49, Holger Wansing wrote:
> Roland Clobus <rclobus@rclobus.nl> wrote (Sat, 7 Jan 2023 11:31:29 +0100):
>> I agree. But the work for the translators can be reduced by
>> automatically parsing the work they have already done (i.e. the
>> translations).
>> That would leave only some characters that have not been used in any
>> translated text, but might be present i.e. on the keyboard.
>> @Translators: It that something you might want to use?
> 
> For a translator, it's just a matter of 1 minute, to write down the
> alphabet for his language, I guess.
> 
> But anyway, we can still use your script, if we cannot get such info from
> translator (if there is no active translator, for example).
> 
>> Attached:
>> 1) chars_v2.py: The updated script
>> 2) sample.summary: Its output to the console
>> 3) ka.utf: Automatically generated Georgian list of use characters
> 
> The ka.utf you attached is conspicuously (nearly) identical to what I grabbed
> from Wikipedia, so: good work!!!

Note the 'nearly'... :-)
In the translations the following code points are used, which are not in 
your list yet:

10f2 (Georgian Letter Hie), used in 'retriever/media/loadnow' and 
'partman-auto-raid/notenoughparts'
201c (Left Double Quotation Mark) 16x used
201d (Right Double Quotation Mark) 38x used
201e (Double Low-9 Quotation Mark) 56x used
21b5 (Downwards Arrow With Corner Leftwards), used in 
'partman-md/deleteverify' and 'mdcfg/deleteverify'

Note that 10f1 (Georgian Letter He) and 10f3-10fe are not used in any 
translated text.

The last four code points will be included by other languages, so it's 
probably not important to have them missing in ka.utf.

With kind regards,
Roland Clobus

PS: The strings with the missing letters were found be enabling lines 36 
and 37 of the script.
[OpenPGP_signature (application/pgp-signature, attachment)]

Information forwarded to debian-bugs-dist@lists.debian.org, Debian Install System Team <debian-boot@lists.debian.org>:
Bug#1017435; Package debian-installer. (Mon, 09 Jan 2023 17:09:03 GMT) (full text, mbox, link).


Acknowledgement sent to Roland Clobus <rclobus@rclobus.nl>:
Extra info received and forwarded to list. Copy sent to Debian Install System Team <debian-boot@lists.debian.org>. (Mon, 09 Jan 2023 17:09:03 GMT) (full text, mbox, link).


Message #71 received at 1017435@bugs.debian.org (full text, mbox, reply):

From: Roland Clobus <rclobus@rclobus.nl>
To: Samuel Thibault <sthibault@debian.org>, 1017435@bugs.debian.org
Cc: Holger Wansing <hwansing@mailbox.org>, aietkolkhi@gmail.com, aidter@use.startmail.com, 53352@protonmail.com, taya13@gmail.com, Philip Hands <phil@hands.com>
Subject: Re: Bug#1017435: debian-installer: georgian text mode fails to render all characters
Date: Mon, 9 Jan 2023 18:01:41 +0100
On 07/01/2023 11:59, Samuel Thibault wrote:
> Roland Clobus, le sam. 07 janv. 2023 11:31:29 +0100, a ecrit:
>> Or... are additional udebs downloaded on demand?
> 
> It seems from the list.gz files that udebs are on the first iso, and
> from the debian-cd exclude files that the only udebs which are not there
> are the ones which are already included in the d-i initrd.
> 
> I doesn't seem that your current script looks at the udebs included in
> the initrd?

I have a local build of a live image that downloads all udebs but did 
not remove any udeb (due to a bug, soon to be fixed), so I have looked 
at a total of 386 udeb files (which includes the udebs in the initrd)

I'll take a closer look, because 
http://deb.debian.org/debian/dists/sid/main/debian-installer/binary-amd64/Packages.gz 
appears to mention 393 udeb files, so I'm missing 7.

With kind regards,
Roland



Information forwarded to debian-bugs-dist@lists.debian.org, Debian Install System Team <debian-boot@lists.debian.org>:
Bug#1017435; Package debian-installer. (Mon, 09 Jan 2023 18:09:02 GMT) (full text, mbox, link).


Acknowledgement sent to Roland Clobus <rclobus@rclobus.nl>, 1017435@bugs.debian.org:
Extra info received and forwarded to list. Copy sent to Debian Install System Team <debian-boot@lists.debian.org>. (Mon, 09 Jan 2023 18:09:02 GMT) (full text, mbox, link).


Message #76 received at 1017435@bugs.debian.org (full text, mbox, reply):

From: Roland Clobus <rclobus@rclobus.nl>
To: Samuel Thibault <sthibault@debian.org>, 1017435@bugs.debian.org
Cc: Holger Wansing <hwansing@mailbox.org>, aietkolkhi@gmail.com, aidter@use.startmail.com, 53352@protonmail.com, taya13@gmail.com, Philip Hands <phil@hands.com>
Subject: Re: Bug#1017435: debian-installer: georgian text mode fails to render all characters
Date: Mon, 9 Jan 2023 19:05:25 +0100
[Message part 1 (text/plain, inline)]
On 09/01/2023 18:01, Roland Clobus wrote:
> On 07/01/2023 11:59, Samuel Thibault wrote:
>> Roland Clobus, le sam. 07 janv. 2023 11:31:29 +0100, a ecrit:
>>> Or... are additional udebs downloaded on demand?
>>
>> It seems from the list.gz files that udebs are on the first iso, and
>> from the debian-cd exclude files that the only udebs which are not there
>> are the ones which are already included in the d-i initrd.
>>
>> I doesn't seem that your current script looks at the udebs included in
>> the initrd?
> 
> I have a local build of a live image that downloads all udebs but did 
> not remove any udeb (due to a bug, soon to be fixed), so I have looked 
> at a total of 386 udeb files (which includes the udebs in the initrd)
> 
> I'll take a closer look, because 
> http://deb.debian.org/debian/dists/sid/main/debian-installer/binary-amd64/Packages.gz appears to mention 393 udeb files, so I'm missing 7.

And found: I was comparing bookworm with sid...

The ones that are extra in sid are:
+depthcharge-tools-installer
+libdns-export1110
+libirs-export161
+libisccc-export161
+libisccfg-export163
+libisc-export1105
+squid-deb-proxy-client-udeb

With kind regards,
Roland

[OpenPGP_signature (application/pgp-signature, attachment)]

Information forwarded to debian-bugs-dist@lists.debian.org, Debian Install System Team <debian-boot@lists.debian.org>:
Bug#1017435; Package debian-installer. (Mon, 09 Jan 2023 18:54:03 GMT) (full text, mbox, link).


Acknowledgement sent to Holger Wansing <hwansing@mailbox.org>:
Extra info received and forwarded to list. Copy sent to Debian Install System Team <debian-boot@lists.debian.org>. (Mon, 09 Jan 2023 18:54:03 GMT) (full text, mbox, link).


Message #81 received at 1017435@bugs.debian.org (full text, mbox, reply):

From: Holger Wansing <hwansing@mailbox.org>
To: Roland Clobus <rclobus@rclobus.nl>, 1017435@bugs.debian.org
Cc: Samuel Thibault <sthibault@debian.org>, aietkolkhi@gmail.com, aidter@use.startmail.com, 53352@protonmail.com, taya13@gmail.com, Philip Hands <phil@hands.com>
Subject: Re: Bug#1017435: debian-installer: georgian text mode fails to render all characters
Date: Mon, 9 Jan 2023 19:51:38 +0100
Hi,

Roland Clobus <rclobus@rclobus.nl> wrote (Mon, 9 Jan 2023 17:46:37 +0100):
> Note the 'nearly'... :-)
> In the translations the following code points are used, which are not in 
> your list yet:
> 
> 10f2 (Georgian Letter Hie), used in 'retriever/media/loadnow' and 
> 'partman-auto-raid/notenoughparts'

I noticed, that I had Hie (10f2) missing in my file compared to yours.
However, I checked if it's used in Georgian translation, and my result was,
that it's not used.
I cannot explain what went wrong with that search, but checking again today 
shows, that it's indeed used, as you say.

So I will add it to ka.utf now.
Thanks for the heads up!


Holger



> 201c (Left Double Quotation Mark) 16x used
> 201d (Right Double Quotation Mark) 38x used
> 201e (Double Low-9 Quotation Mark) 56x used
> 21b5 (Downwards Arrow With Corner Leftwards), used in 
> 'partman-md/deleteverify' and 'mdcfg/deleteverify'
> 
> Note that 10f1 (Georgian Letter He) and 10f3-10fe are not used in any 
> translated text.
> 
> The last four code points will be included by other languages, so it's 
> probably not important to have them missing in ka.utf.
> 
> With kind regards,
> Roland Clobus
> 
> PS: The strings with the missing letters were found be enabling lines 36 
> and 37 of the script.


-- 
Holger Wansing <hwansing@mailbox.org>
PGP-Fingerprint: 496A C6E8 1442 4B34 8508  3529 59F1 87CA 156E B076



Reply sent to Cyril Brulebois <kibi@debian.org>:
You have taken responsibility. (Tue, 07 Feb 2023 14:39:07 GMT) (full text, mbox, link).


Notification sent to Philip Hands <phil@hands.com>:
Bug acknowledged by developer. (Tue, 07 Feb 2023 14:39:07 GMT) (full text, mbox, link).


Message #86 received at 1017435-close@bugs.debian.org (full text, mbox, reply):

From: Debian FTP Masters <ftpmaster@ftp-master.debian.org>
To: 1017435-close@bugs.debian.org
Subject: Bug#1017435: fixed in debian-installer 20230207
Date: Tue, 07 Feb 2023 14:36:13 +0000
Source: debian-installer
Source-Version: 20230207
Done: Cyril Brulebois <kibi@debian.org>

We believe that the bug you reported is fixed in the latest version of
debian-installer, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 1017435@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Cyril Brulebois <kibi@debian.org> (supplier of updated debian-installer package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@ftp-master.debian.org)


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

Format: 1.8
Date: Tue, 07 Feb 2023 14:59:08 +0100
Source: debian-installer
Architecture: source
Version: 20230207
Distribution: unstable
Urgency: medium
Maintainer: Debian Install System Team <debian-boot@lists.debian.org>
Changed-By: Cyril Brulebois <kibi@debian.org>
Closes: 1017435
Changes:
 debian-installer (20230207) unstable; urgency=medium
 .
   [ Samuel Thibault ]
   * Revert the build-dependencies changes of "Add support for cross-building".
   * Build-depend on bogl-utils instead of libbogl-dev for getting bdftobogl.
 .
   [ Cyril Brulebois ]
   * Bump Linux kernel ABI to 6.1.0-3.
   * Update MIRROR example with a better value (http://deb.debian.org/debian).
   * Update translation-status for the release.
 .
   [ Holger Wansing ]
   * Add ka.utf with needed characters for Georgian language, to fix broken
     rendering in text installer. Closes: #1017435
 .
   [ Alper Nebi Yasak ]
   * [amd64, arm64] Build netboot images for ChromeOS devices
     - Make the disk images reproducible
     - Add the images to manifests
     - Refactor into a Makefile target
Checksums-Sha1:
 408c8133c7b78c86d82408017b6e6bce55d1c16d 3860 debian-installer_20230207.dsc
 95703c55e3a58cc7084e2e1a7405bdf11147ea38 1420237 debian-installer_20230207.tar.gz
 9f5509fd981b8d76f01051d4d7bc3a251af918e1 12578 debian-installer_20230207_source.buildinfo
Checksums-Sha256:
 4e6f52f64c9efba10cc3dfe32fe1649f99646701afed937e2490be82cff4f3c7 3860 debian-installer_20230207.dsc
 b34578409d1c8076117019a7d05ee0c6bb1abd1bae2dda2613a332317c6ea51e 1420237 debian-installer_20230207.tar.gz
 0851d8e8c008d89a054986c69b0d640ac32cde4e89bcffc4454c88e056906d8b 12578 debian-installer_20230207_source.buildinfo
Files:
 dbbfb2650fcbef0a62da642fe5057cf3 3860 devel optional debian-installer_20230207.dsc
 75b38b4fade36c541fee44dea97f1117 1420237 devel optional debian-installer_20230207.tar.gz
 1b9f16d65f2b63daf1bda8489c84fb04 12578 devel optional debian-installer_20230207_source.buildinfo

-----BEGIN PGP SIGNATURE-----

iQJEBAEBCgAuFiEEtg6/KYRFPHDXTPR4/5FK8MKzVSAFAmPiXegQHGtpYmlAZGVi
aWFuLm9yZwAKCRD/kUrwwrNVINXMEACeuBJfwmYmQQX2cJLKxHYFWXDgJCT1WF/b
AAjG3RDqzQtdd5wR7ict7Cv6R0SgCd4ZVeRtlSz8c/4+Kzbtv93WloZ58tuKb+fb
iY/xjN0H7g/BKiXhiZyY9Iql8huD6bV2xtNUodxCyQh0+wZouVx3kdeZmTDcC/xl
EC2Xs4r9gXA9U6VGLRTdSO6rSdFpEsdbqN/8hXA+S0JNrEPIp/VQO2SJYRqSnRC6
AsQKSi0+o0dl01I51jV/YKdsuAWJDprxWKc65NGVTiEr/F6O+lEDxLXCUhpJMgxq
bBZ9QbmPSkUYtL2OOlWnZ48t9zMrxQG5DxuMloiKNZkHs5vUAniqmLPJIshk3YSY
pWwXEVsjPx9LhYdbjm9e+Fr48tVXew7Mmhas/kfP8l/aH7I+iMN398h4OUk+0ThS
GdhV15fr/85Va/TIkQlLfJuagkE303VSu9gEiRqu4NyTaQ+4D7jHFMYNPojBKhaH
FRipOnNrBEZomdAtRhjC5owU0so50EOCjlWDEVEumtDDm2uYB06oquiFMs3LK2UK
5pvhbO70bU828OwIIe6nam1jqkpRDUNAfCqkkywCu66HjmUHp8Oli9w2/3ka+kfI
n6n7lJHiqihsTi5fOxzFenVs8cp5hMnb9LrIl+GB13EREOJseURzerpEbKYuRuFG
gXTcq/cutw==
=EckA
-----END PGP SIGNATURE-----




Bug archived. Request was from Debbugs Internal Request <owner@bugs.debian.org> to internal_control@bugs.debian.org. (Wed, 08 Mar 2023 07:28:53 GMT) (full text, mbox, link).


Send a report that this bug log contains spam.


Debian bug tracking system administrator <owner@bugs.debian.org>. Last modified: Wed May 17 09:33:39 2023; Machine Name: buxtehude

Debian Bug tracking system

Debbugs is free software and licensed under the terms of the GNU Public License version 2. The current version can be obtained from https://bugs.debian.org/debbugs-source/.

Copyright © 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson, 2005-2017 Don Armstrong, and many other contributors.