Bug#592204: nvidia-vdpau-driver: Segfault on VDPAU using apps that call XCloseDisplay

[Anssi Hannula]

25.01.2013 23:36, Andreas Beckmann kirjoitti:
> Control: tag -1 moreinfo
> 
> Hi Anssi,

Hi!

> On 2012-03-06 02:10, Anssi Hannula wrote:
>> Testcase attached. Also, this is a libvdpau bug, not a
>> nvidia-vdpau-driver one. It crashes with all drivers, whether VDPAU is
>> supported or not (as the bug is caused by the probing code in libvdpau).
> 
> I just noticed that there is now an upstream commit that should fix this
> (3b43955c7324e1d213a3134387767722f34e2356), but so far I could still
> reproduce the segfault with your test program.
> Anyway, I just uploaded (to experimental) 0.5-1 including all upstream
> commits that were done after the upstream release of 0.5.
> 
> Perhaps you can have a look at this again.

There is an identical issue in libXext.so which is triggered by the use
of Xext in libvdpau.so.

Aaron Plattner from upstream has posted a testcase which workarounds the
libXext.so issue:
http://lists.freedesktop.org/archives/vdpau/2013-January/000045.html

The libXext.so issue can be reproduced easily without libvdpau
involvement by dlopening it, calling e.g. XGEQueryVersion() or
XSyncQueryExtension() (two examples I just randomly picked up), and then
dlclosing it before calling XCloseDisplay(). Testcase attached for that.

I'm not 100% sure if this is even supposed to work, but at the very
least it is rather fishy. Anyway, the libvdpau part has been fixed, and
it of course fixes the issue on all those cases where the main program
is directly linked against libXext.so.6 (which I guess most VDPAU users
are, except for my testcase) as that the libXext callbacks will always
be present at XCloseDisplay() time.

-- 
Anssi Hannula
-------------- next part --------------
A non-text attachment was scrubbed...
Name: libxext-dlopen-crash.c
Type: text/x-csrc
Size: 1469 bytes
Desc: not available
URL: <http://lists.alioth.debian.org/pipermail/pkg-nvidia-devel/attachments/20130127/c8e618e3/attachment-0001.c>