Associated bug: bug 91028

Assigned to Humberto to provide logs and bisect result

(In reply to cprigent from comment #2)
> Assigned to Humberto to provide logs and bisect result

with BDW Lenovo G50-80 Notebook this issue does not happen with the following kernel commits

commit aab15c274da587bcab19376d2caa9d6626440335
commit 71d126590e2fa6d65d93fe3586d55ddf9f6c39a6
commit f35ed31aea66b3230c366fcba5f3456ae2cb956e

Please see the attachments for each commit

Created attachment 127391 [details]
71d1265.log

Created attachment 127392 [details]
commit-aab15c2.log

Created attachment 127393 [details]
commit-f35ed31.log

This is the configuration for my previous comment

 Hardware information 
============================================ 
Platform                     	: BDW 
Motherboard model            	: 80E5 
Motherboard type             	: Lenovo G50-80 Notebook 
Motherboard manufacturer     	: LENOVO 
CPU family                   	: Core i5 
CPU information              	: Intel(R) Core(TM) i5-5200U CPU @ 2.20GHz 
GPU Card                     	: Intel Corporation Broadwell-U Integrated Graphics (rev 09) (prog-if 00 [VGA controller]) 
Memory ram                   	: 6 GB 
Maximum memory ram allowed   	: 16 GB 
CPU thread                      : 4 
CPU core                        : 2 
Socket                          : Socket BGA1168 
Signature                       : Type 0, Family 6, Model 61, Stepping 4 
Hard drive capacity             : 149GiB (160GB) 

i'll try with a BDW nuc ASAP

(In reply to Humberto Israel Perez Rodriguez from comment #7)
> This is the configuration for my previous comment
> 
>  Hardware information 
> ============================================ 
> Platform                     	: BDW 
> Motherboard model            	: 80E5 
> Motherboard type             	: Lenovo G50-80 Notebook 
> Motherboard manufacturer     	: LENOVO 
> CPU family                   	: Core i5 
> CPU information              	: Intel(R) Core(TM) i5-5200U CPU @ 2.20GHz 
> GPU Card                     	: Intel Corporation Broadwell-U Integrated
> Graphics (rev 09) (prog-if 00 [VGA controller]) 
> Memory ram                   	: 6 GB 
> Maximum memory ram allowed   	: 16 GB 
> CPU thread                      : 4 
> CPU core                        : 2 
> Socket                          : Socket BGA1168 
> Signature                       : Type 0, Family 6, Model 61, Stepping 4 
> Hard drive capacity             : 149GiB (160GB) 
> 
> i'll try with a BDW nuc ASAP

even with latest drm-intel-nightly the test passed

commit 5b633f423e27af3a7f30d303e243f5a2e82917ae
Author: Chris Wilson <chris@chris-wilson.co.uk>
Date:   Tue Oct 18 14:27:24 2016 +0100

    drm-intel-nightly: 2016y-10m-18d-13h-24m-11s UTC integration manifest

Even with a BDW Nuc this test is passed with the following configuration


Hardware information 
============================================ 
Platform                     	: BDW Nuc
Motherboard type             	: NUC5i5MYBE Desktop 
CPU family                   	: Core i5 
CPU information              	: Intel(R) Core(TM) i5-5300U CPU @ 2.30GHz 
GPU Card                     	: Intel Corporation Broadwell-U Integrated Graphics (rev 09) (prog-if 00 [VGA controller]) 
Memory ram                   	: 16 GB 
Maximum memory ram allowed   	: 16 GB 
CPU thread                      : 4 
CPU core                        : 2 
Socket                          : Socket BGA1168 
Signature                       : Type 0, Family 6, Model 61, Stepping 4 
Hard drive capacity             : 111GiB (120GB)


Gfx Stack
=============================================
Component         : drm
	tag       : libdrm-2.4.70-14-g0659558
	commit    : 0659558 

Component         : cairo
	tag       : 1.15.2
	commit    : db8a7f1 

Component         : intel-gpu-tools
	tag       : intel-gpu-tools-1.16-30-g32b2021
	commit    : 32b2021 


Commits tested from drm-intel-nightly
==============================================
latest available commit : 5b633f423e27af3a7f30d303e243f5a2e82917ae (pass)
commit aab15c274da587bcab19376d2caa9d6626440335 WW40 (pass)
commit 71d126590e2fa6d65d93fe3586d55ddf9f6c39a6 WW41 (pass)
commit f35ed31aea66b3230c366fcba5f3456ae2cb956e WW42 (pass)

Christophe, please confirm whether or not we can close that bug as worksforme

Created attachment 127424 [details]
BDW__kms_frontbuffer_tracking__fbc-suspend__kern.log

Created attachment 127425 [details]
BDW__kms_frontbuffer_tracking__fbc-suspend__output

Created attachment 127426 [details]
BDW__suspend-to-mem__kern.log

Created attachment 127427 [details]
BDW__lsusb

IGT output shows an rtcwake error:
(kms_frontbuffer_tracking:1651) igt-aux-CRITICAL: This failure means that something is wrong with the rtcwake tool or how your distro is set up. This is not a i915.ko or i-g-t bug.

rtcwake returns a write error after several tries:
root@BDW101:/home/user# rtcwake -m mem -s 30
rtcwake: wakeup from "mem" using /dev/rtc0 at Thu Oct 20 11:51:10 2016
root@BDW101:/home/user# rtcwake -m mem -s 30
rtcwake: wakeup from "mem" using /dev/rtc0 at Thu Oct 20 11:52:54 2016
root@BDW101:/home/user# rtcwake -m mem -s 30
rtcwake: wakeup from "mem" using /dev/rtc0 at Thu Oct 20 11:53:45 2016
rtcwake: write error

Could it be due to USB?
[   22.361971] usb 2-7: device descriptor read/64, error -110
[   22.589896] usb 2-7: new full-speed USB device number 3 using xhci_hcd
[   24.098323] random: crng init done
[   27.738320] usb 2-7: device descriptor read/64, error -110
[   43.355423] usb 2-7: device descriptor read/64, error -110
[   43.583349] usb 2-7: new full-speed USB device number 4 using xhci_hcd
[   48.611744] xhci_hcd 0000:00:14.0: Timeout while waiting for setup device command
[   48.819846] usb 2-7: Device not responding to setup address.
[   49.027725] usb 2-7: device not accepting address 4, error -71
[   49.147738] usb 2-7: new full-speed USB device number 5 using xhci_hcd
[   54.244174] xhci_hcd 0000:00:14.0: Timeout while waiting for setup device command
[   54.452237] usb 2-7: Device not responding to setup address.
[   54.660115] usb 2-7: device not accepting address 5, error -71
[   54.660163] usb usb2-port7: unable to enumerate USB device


Platform BDW: NUC5i7RYB
CPU: Intel(R) Core(TM) i7-5557U CPU @ 3.10GHz (Family 6, Model 61, Stepping 4)
Motherboard version: H73774-102
GPU: Intel® Iris™ Graphics 6100 - Intel Corporation Broadwell-U Integrated Graphics (rev 09)
Memory: two 4GB card Kingston 99U5469-045.A00LF
SSD: INTEL SSDSC2KW24

Software
Bios: RYBDWi35.86A.0358.2016.0606.1423 from https://downloadcenter.intel.com/downloads/eula/26081/BIOS-Update-RYBDWi35-86A-?httpDown=https%3A%2F%2Fdownloadmirror.intel.com%2F26081%2Feng%2FRY0358.bio
Linux distribution: Ubuntu 16.04 64 bits
Setup:
Kernel: 4.9.0-rc1 5b633f4 from http://cgit.freedesktop.org/drm-intel/
  commit 5b633f423e27af3a7f30d303e243f5a2e82917ae
  Author: Chris Wilson <chris@chris-wilson.co.uk>
  Date:   Tue Oct 18 13:27:24 2016 +0000
  drm-intel-nightly: 2016y-10m-18d-13h-24m-11s UTC integration manifest
libdrm-2.4.71 a44c9c3 from git://anongit.freedesktop.org/mesa/drm
mesa: mesa-12.0.0 8b06176 from git://anongit.freedesktop.org/mesa/mesa
cairo 1.15.2 db8a7f1 from git://anongit.freedesktop.org/cairo
xorg-server-1.18.99.901-80 5dcb066 from git://git.freedesktop.org/git/xorg/xserver
xf86-video-intel 2.99.917-713 eb01cc5 from git://git.freedesktop.org/git/xorg/driver/xf86-video-intel
libva-1.7.2-38 3b7e499 from git://git.freedesktop.org/git/vaapi/libva 
vaapi-intel-driver: 1.7.2-138 fc7bd06 from git://git.freedesktop.org/git/vaapi/intel-driver
IGT: 1.16 27d3070 from http://anongit.freedesktop.org/git/xorg/app/intel-gpu-tools.git

(In reply to cprigent from comment #14)
> Created attachment 127427 [details]
> BDW__lsusb
> 
> IGT output shows an rtcwake error:
> (kms_frontbuffer_tracking:1651) igt-aux-CRITICAL: This failure means that
> something is wrong with the rtcwake tool or how your distro is set up. This
> is not a i915.ko or i-g-t bug.
> 
> rtcwake returns a write error after several tries:
> root@BDW101:/home/user# rtcwake -m mem -s 30
> rtcwake: wakeup from "mem" using /dev/rtc0 at Thu Oct 20 11:51:10 2016
> root@BDW101:/home/user# rtcwake -m mem -s 30
> rtcwake: wakeup from "mem" using /dev/rtc0 at Thu Oct 20 11:52:54 2016
> root@BDW101:/home/user# rtcwake -m mem -s 30
> rtcwake: wakeup from "mem" using /dev/rtc0 at Thu Oct 20 11:53:45 2016
> rtcwake: write error
> 
> Could it be due to USB?
> [   22.361971] usb 2-7: device descriptor read/64, error -110
> [   22.589896] usb 2-7: new full-speed USB device number 3 using xhci_hcd
> [   24.098323] random: crng init done
> [   27.738320] usb 2-7: device descriptor read/64, error -110
> [   43.355423] usb 2-7: device descriptor read/64, error -110
> [   43.583349] usb 2-7: new full-speed USB device number 4 using xhci_hcd
> [   48.611744] xhci_hcd 0000:00:14.0: Timeout while waiting for setup device
> command
> [   48.819846] usb 2-7: Device not responding to setup address.
> [   49.027725] usb 2-7: device not accepting address 4, error -71
> [   49.147738] usb 2-7: new full-speed USB device number 5 using xhci_hcd
> [   54.244174] xhci_hcd 0000:00:14.0: Timeout while waiting for setup device
> command
> [   54.452237] usb 2-7: Device not responding to setup address.
> [   54.660115] usb 2-7: device not accepting address 5, error -71
> [   54.660163] usb usb2-port7: unable to enumerate USB device
> 
> 
> Platform BDW: NUC5i7RYB
> CPU: Intel(R) Core(TM) i7-5557U CPU @ 3.10GHz (Family 6, Model 61, Stepping
> 4)
> Motherboard version: H73774-102
> GPU: Intel® Iris™ Graphics 6100 - Intel Corporation Broadwell-U Integrated
> Graphics (rev 09)
> Memory: two 4GB card Kingston 99U5469-045.A00LF
> SSD: INTEL SSDSC2KW24
> 
> Software
> Bios: RYBDWi35.86A.0358.2016.0606.1423 from
> https://downloadcenter.intel.com/downloads/eula/26081/BIOS-Update-RYBDWi35-
> 86A-?httpDown=https%3A%2F%2Fdownloadmirror.intel.com%2F26081%2Feng%2FRY0358.
> bio
> Linux distribution: Ubuntu 16.04 64 bits
> Setup:
> Kernel: 4.9.0-rc1 5b633f4 from http://cgit.freedesktop.org/drm-intel/
>   commit 5b633f423e27af3a7f30d303e243f5a2e82917ae
>   Author: Chris Wilson <chris@chris-wilson.co.uk>
>   Date:   Tue Oct 18 13:27:24 2016 +0000
>   drm-intel-nightly: 2016y-10m-18d-13h-24m-11s UTC integration manifest
> libdrm-2.4.71 a44c9c3 from git://anongit.freedesktop.org/mesa/drm
> mesa: mesa-12.0.0 8b06176 from git://anongit.freedesktop.org/mesa/mesa
> cairo 1.15.2 db8a7f1 from git://anongit.freedesktop.org/cairo
> xorg-server-1.18.99.901-80 5dcb066 from
> git://git.freedesktop.org/git/xorg/xserver
> xf86-video-intel 2.99.917-713 eb01cc5 from
> git://git.freedesktop.org/git/xorg/driver/xf86-video-intel
> libva-1.7.2-38 3b7e499 from git://git.freedesktop.org/git/vaapi/libva 
> vaapi-intel-driver: 1.7.2-138 fc7bd06 from
> git://git.freedesktop.org/git/vaapi/intel-driver
> IGT: 1.16 27d3070 from
> http://anongit.freedesktop.org/git/xorg/app/intel-gpu-tools.git

maybe you can try with 

# hwclock -w

and test againg

Created attachment 128586 [details]
BDW-NUC5i3RYB__kms_frontbuffer_tracking__fbc-suspend__loop__kern.log

Created attachment 128588 [details]
BDW-NUC5i3RYB__kms_frontbuffer_tracking__fbc-suspend__loop__output

yes, the clock is accurate.
Tested in a loop using a BDW NUC5i3RYB with fresh setup, it is 50% reproduced.

USB controller also fails to suspend:
[  495.830966] calling  0000:00:14.0+ @ 163, parent: pci0000:00
[  495.830972] pci_pm_suspend(): hcd_pci_suspend+0x0/0x30 returns -16
[  495.830976] dpm_run_callback(): pci_pm_suspend+0x0/0x140 returns -16
[  495.830977] call 0000:00:14.0+ returned -16 after 9 usecs
[  495.830978] PM: Device 0000:00:14.0 failed to suspend async: error -16
[  495.896515] PM: Some devices failed to suspend, or early wake event detected

Platform BDW: NUC5i3RYB
CPU: Intel(R) Core(TM) i3-5010U CPU @ 2.10GHz (family 6, model 61, stepping 4)
Motherboard version: H41000-503
GPU: Intel® HD Graphics 5500 - Intel Corporation Broadwell-U Integrated Graphics (rev 09)
Memory: two 4GB card Crucial CT51264BF160B.C16F
SSD: INTEL SSDSC2BW48 480 Go

Software
Bios: RYBDWi35.86A.0358.2016.0606.1423 from https://downloadcenter.intel.com/downloads/eula/26081/BIOS-Update-RYBDWi35-86A-?httpDown=https%3A%2F%2Fdownloadmirror.intel.com%2F26081%2Feng%2FRY0358.bio
Linux distribution: Ubuntu 16.04 64 bits
Kernel: 4.9.0 86a2672 branch drm-tip from https://cgit.freedesktop.org/drm-tip
  commit 86a26727690faef9018c6585e0094e701e0e9b0c
  Author: Rodrigo Vivi <rodrigo.vivi@intel.com>
  Date:   Mon Dec 19 11:15:50 2016 -0800
  drm-tip: 2016y-12m-19d-19h-15m-10s UTC integration manifest
libdrm-2.4.74-17 a07cf7f from git://anongit.freedesktop.org/mesa/drm
mesa: mesa-13.0.2 c9e993b from git://anongit.freedesktop.org/mesa/mesa
cairo 1.15.4 9fe6683 from git://anongit.freedesktop.org/cairo
xorg-server-1.19.0-31 b5dffbb from git://git.freedesktop.org/git/xorg/xserver
xf86-video-2.99.917-746 169c74f from git://git.freedesktop.org/git/xorg/driver/xf86-video-intel
libva-1.7.2-44 598fb9e from git://git.freedesktop.org/git/vaapi/libva 
vaapi-intel-driver: 1.7.2-199 4518d07 from git://git.freedesktop.org/git/vaapi/intel-driver
intel-gpu-tools-1.17-53 38bffd9 from http://anongit.freedesktop.org/git/xorg/app/intel-gpu-tools.git

External screen: DELL U2311Hb

Does the same problem also happen when you run the other suspend/resume tests on the same machine?

If yes, it may be worth testing with i915.ko blacklisted just to see if it's actually our fault.

(In reply to Paulo Zanoni from comment #18)
> Does the same problem also happen when you run the other suspend/resume
> tests on the same machine?
> 
> If yes, it may be worth testing with i915.ko blacklisted just to see if it's
> actually our fault.

Also, this bug is certainly a regression since when I wrote this test, it passed. So a bisection would be useful here.

I will work on it ww04.

Is there any indication of a bug in either i915 or IGT?

This test passes on both a Lenovo ThinkPad X1 Carbon (Broadwell) and a Intel NUC5i7RYH (haven't checked BIOS version), built from drm-tip on 2017-02-15.

It should be noted that the ThinkPad does NOT support PSR, but since the original bug report concerned the NUCi7RYB this shouldn't matter (unless that NUC was paired up with a PSR capable eDP).

Christophe this test is been reported as now pass. I will put this bug as Resolved fixed and once you confirm it please close it

I confirm it.

Tested with:
Platform BDW: NUC5i7RYB
CPU: Intel(R) Core(TM) i7-5557U CPU @ 3.10GHz (Family 6, Model 61, Stepping 4)
Motherboard version: H73774-102
GPU: Intel® Iris™ Graphics 6100 - Intel Corporation Broadwell-U Integrated Graphics (rev 09)
Memory: two 4GB card Kingston 99U5469-045.A00LF
SSD: INTEL SSDSC2KW24

Software
Bios: RYBDWi35.86A.0358.2016.0606.1423 from https://downloadcenter.intel.com/downloads/eula/26081/BIOS-Update-RYBDWi35-86A-?httpDown=https%3A%2F%2Fdownloadmirror.intel.com%2F26081%2Feng%2FRY0358.bio
Linux distribution: Ubuntu 16.04 64 bits

Kernel: 4.10.0 f76e5ec branch drm-tip from https://cgit.freedesktop.org/drm-tip
  commit: f76e5eca8c2a46cbd0203d32842bca6ce0ec16ef
  committed_date: Mon Feb 27 13:20:52 2017 +0000
  author: Mika Kuoppala <mika.kuoppala@intel.com>
  summary: 'drm-tip: 2017y-02m-27d-13h-20m-25s UTC integration manifest'

libdrm-2.4.75-10 f6499b1 from git://anongit.freedesktop.org/mesa/drm
mesa: mesa-17.0.0 683462e from git://anongit.freedesktop.org/mesa/mesa
cairo 1.15.4 9fe6683 from git://anongit.freedesktop.org/cairo
xorg-server-1.19.0-125 7d7788e from git://git.freedesktop.org/git/xorg/xserver
xf86-video-intel 2.99.917-758 860c366 from git://git.freedesktop.org/git/xorg/driver/xf86-video-intel
libva-1.7.3.pre1-84 e613327 from git://git.freedesktop.org/git/vaapi/libva 
vaapi-intel-driver: 1.7.3-325 03a86fc from git://git.freedesktop.org/git/vaapi/intel-driver
intel-gpu-tools-1.17-261 8f3164f from http://anongit.freedesktop.org/git/xorg/app/intel-gpu-tools.git

So closed