Bug#893488: gnome-shell 3.28 crashes on Radeon R9: Failed to create texture 2d due to size/format constraints

[Simon McVittie]

Control: retitle -1 gnome-shell 3.28 crashes on Radeon R9: Failed to create texture 2d due to size/format constraints

I'm retitling this based on my best guess at the root cause to stop
others thinking it's an appropriate place to report different crashes.
I think we'd prefer to err on the side of having different reports and
merging them, rather than having one report for multiple crashes and
having to disentangle which is which.

On Mon, 19 Mar 2018 at 12:05:42 +0100, Matteo Settenvini wrote:
> I am attaching also a core file appearing in my home folder,
> apparently it is for Xwayland.

This core probably isn't helpful: it's part of the symptom, not the
cause. If the Wayland compositor (in this case gnome-shell) crashes,
Xwayland will crash too: that's (currently) an expected thing.

> Looking at the journal I see:

To help with interpretation:

Process 1402 looks like the gdm "greeter" GNOME Shell process (uid 117).

Process 1925 looks like your GNOME Shell (uid 1000).

> mar 19 11:46:42 rosebud gnome-shell[1402]: g_array_free: assertion 'array' failed

This means something isn't quite right, a long way before what I
think is probably the actual root cause. If you can run GNOME Shell
with G_DEBUG=fatal-criticals and get a backtrace from the resulting
crash (systemd-coredump is probably the easiest way), that might be
helpful; but this isn't likely to be the root cause.

> mar 19 11:46:44 rosebud gnome-shell[1402]: JS WARNING: [resource:///org/gnome/shell/ui/main.js 332]: reference to undefined property "MetaStage"
> mar 19 11:46:44 rosebud gnome-shell[1402]: JS WARNING: [resource:///org/gnome/shell/ui/layout.js 220]: reference to undefined property "MetaWindowGroup"
> mar 19 11:46:44 rosebud gnome-shell[1402]: JS WARNING: [resource:///org/gnome/shell/ui/osdMonitorLabeler.js 59]: reference to undefined property "MetaDBusDisplayConfigSkeleton"

This stuff is probably harmless.

> mar 19 11:46:45 rosebud gnome-shell[1402]: _cogl_buffer_gl_map_range: assertion 'data != ((void *)0)' failed
> mar 19 11:46:45 rosebud gnome-shell[1402]: g_error_free: assertion 'error != NULL' failed
> mar 19 11:46:45 rosebud gnome-shell[1402]: _cogl_buffer_bind_no_create: assertion 'ctx->current_buffer[buffer->last_target] != buffer' failed
> mar 19 11:46:45 rosebud gnome-shell[1402]: Failed to create texture for background
> mar 19 11:46:45 rosebud gnome-shell[1402]: Failed to create texture for background

Something is already going wrong with OpenGL drawing in gdm's gnome-shell,
but unlike yours, it didn't crash.

Did you notice that in GNOME Shell 3.28, you don't get the grey "noise"
background texture that you should? In GNOME Shell 3.26, do you get the
"noise" texture correctly?

(This one:
https://askubuntu.com/questions/534187/where-is-the-login-screen-wallpaper-for-gdm-stored)

> mar 19 11:51:50 rosebud gnome-shell[1925]: GNOME Shell started at Mon Mar 19 2018 11:51:46 GMT+0100 (CET)
> mar 19 11:51:52 rosebud gnome-shell[1925]: _cogl_buffer_gl_map_range: assertion 'data != ((void *)0)' failed
> mar 19 11:51:52 rosebud gnome-shell[1925]: g_error_free: assertion 'error != NULL' failed
> mar 19 11:51:52 rosebud gnome-shell[1925]: _cogl_buffer_bind_no_create: assertion 'ctx->current_buffer[buffer->last_target] != buffer' failed
> mar 19 11:51:52 rosebud gnome-shell[1925]: _cogl_buffer_gl_map_range: assertion 'data != ((void *)0)' failed
> mar 19 11:51:52 rosebud gnome-shell[1925]: g_error_free: assertion 'error != NULL' failed
> mar 19 11:51:52 rosebud gnome-shell[1925]: _cogl_buffer_bind_no_create: assertion 'ctx->current_buffer[buffer->last_target] != buffer' failed

Again, this isn't right, and backtraces from these assertion failures
might be interesting, but it probably isn't the whole story.

There might also be some bugs in the error-handling.

> mar 19 11:51:52 rosebud gnome-shell[1925]: Failed to allocate texture: Failed to create texture 2d due to size/format constraints
> mar 19 11:51:52 rosebud gnome-shell[1925]: cogl_object_ref: assertion 'object != ((void *)0)' failed
> mar 19 11:51:52 rosebud gnome-shell[1925]: clutter_texture_set_cogl_texture: assertion 'cogl_is_texture (cogl_tex)' failed
> mar 19 11:51:52 rosebud gnome-shell[1925]: CoglError set over the top of a previous CoglError or uninitialized memory.
> mar 19 11:51:52 rosebud gnome-shell[1925]: clutter_texture_set_cogl_texture: assertion 'cogl_is_texture (cogl_tex)' failed
> mar 19 11:51:52 rosebud kernel: gnome-shell[1925]: segfault at 1 ip 00007fae6a9a7509 sp 00007fffdb1a0d30 error 4 in libglib-2.0.so.0.5600.0[7fae6a93e000+113000]

I think "Failed to create texture 2d due to size/format constraints"
might be the root cause here. We've had similar Shell crashes in the past,
but I don't know what caused them.

There's also some wrong error-handling, unfortunately.

    smcv