Bug#929048: tracker-extract: Allocates between 5 and 10 GiB of memory when examining certain DDS files

[Andreas Henriksson]

Control: tags -1 + unreproducible

Hello Bálint Kovács,

Thanks for your bug report. I'm not able to reproduce this issue.
Possibly I don't have things installed that's actually used to
parse this file format. (The bug is likely in some underlying
library for the file format rather than in tracker(-extract) itself.)
Would be great if you could gather some more detailed debug information
as your current info is apparently not enough to reproduce the issue.
I'd suggest you install dbgsym packages and run gdb on the
tracker-extract process and try to break it and see where it's at, then
continue running, then breaking again.... repeat a number of times and
make sure you have all the dbgsym packages installed.

The output I get below FWIW.

On Thu, May 16, 2019 at 01:42:44AM +0100, Bálint Kovács wrote:
> Package: tracker-extract
> Version: 2.1.6-1
> Severity: critical
> Justification: breaks the whole system
[...]
> Full output from an affected file:
> 
> $ /usr/lib/tracker/tracker-extract -v 2 -f bad.dds
> 00:57
> ** Message: 00:57:52.901: Starting tracker-extract 2.1.6
> ** Message: 00:57:52.901: General options:
> ** Message: 00:57:52.901:   Verbosity  ............................  2
> ** Message: 00:57:52.901:   Sched Idle  ...........................  1
> ** Message: 00:57:52.901:   Max bytes (per file)  .................  1048576
> (tracker-extract:9171): dconf-DEBUG: 00:57:52.901: watch_established:
> "/org/freedesktop/tracker/extract/" (establishing: 1)
> Setting scheduler policy to SCHED_IDLE
> Setting priority nice level to 19
> Loading extractor rules... (/usr/share/tracker-miners/extract-rules)
> Extractor rules loaded
> MIME type guessed as 'image/x-dds' (from GIO)
> ../../../glib/gmem.c:105: failed to allocate 65687 bytes
> 
[...]

For me the same commands finishes in about no time and without putting
any memory pressure on the system at all.

$ /usr/lib/tracker/tracker-extract -v 2 -f /tmp/dds_examples/bad.dds 
** Message: 16:40:49.858: Starting tracker-extract 2.1.6
** Message: 16:40:49.858: General options:
** Message: 16:40:49.858:   Verbosity  ............................  2
** Message: 16:40:49.858:   Sched Idle  ...........................  1
** Message: 16:40:49.858:   Max bytes (per file)  .................
1048576
Setting scheduler policy to SCHED_IDLE
Setting priority nice level to 19
(tracker-extract:3683): dconf-DEBUG: 16:40:49.858: watch_established:
"/org/freedesktop/tracker/extract/" (establishing: 1)
Loading extractor rules... (/usr/share/tracker-miners/extract-rules)
Extractor rules loaded
MIME type guessed as 'image/x-dds' (from GIO)
@prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
@prefix nmm: <http://www.tracker-project.org/temp/nmm#> .
@prefix nfo: <http://www.semanticdesktop.org/ontologies/2007/03/22/nfo#>
.

<file:///tmp/dds_examples/bad.dds> a nfo:Image , nmm:Photo .

Regards,
Andreas Henriksson