KMS only in one card in dual card config

Graphics / Linux Linux
1

Hi

have a system with 2 cards. one is GTX770 and other is GTX Titan Black

i use the 770 for linux and the titan black for VGA passtrought (qemu virtualization)

when enable the KMS in my system, the Vfio module hangs with this message:

jul 23 23:25:15 sL1pKn07 systemd-udevd[1006]: seq 2884
'/devices/pci0000:00/0000:00:07.0/0000:05:00.0/0000:06:02.0/0000:07:00.0'
is taking a long time
jul 23 23:25:15 sL1pKn07 systemd-udevd[1006]: seq 2775
'/devices/pci0000:00/0000:00:03.0/0000:0f:00.0/0000:10:00.0/0000:13:00.0'
is taking a long time
jul 23 23:27:15 sL1pKn07 systemd-udevd[1006]: seq 2884
'/devices/pci0000:00/0000:00:07.0/0000:05:00.0/0000:06:02.0/0000:07:00.0'
killed
jul 23 23:27:15 sL1pKn07 systemd-udevd[1006]: seq 2775
'/devices/pci0000:00/0000:00:03.0/0000:0f:00.0/0000:10:00.0/0000:13:00.0'
killed
jul 23 23:27:15 sL1pKn07 systemd-udevd[1006]: worker [1057] terminated
by signal 9 (Killed)
jul 23 23:27:15 sL1pKn07 systemd-udevd[1006]: worker [1057] failed
while handling '/devices/pci0000:00/0000:00:03.0/0000:0f:00.0/0000:10:00.0/0000:13:00.0'
jul 23 23:28:07 sL1pKn07 kernel: INFO: task kworker/0:0:4 blocked for
more than 120 seconds.
jul 23 23:28:07 sL1pKn07 kernel:       Tainted: P           O    4.6.2-1-ARCH #1
jul 23 23:28:07 sL1pKn07 kernel: "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
jul 23 23:28:07 sL1pKn07 kernel: kworker/0:0     D ffff8806a4627b78
 0     4      2 0x00000000
jul 23 23:28:07 sL1pKn07 kernel: Workqueue: events os_execute_work_item [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  ffff8806a4627b78 0000000000001b9c
ffff88053b0eb400 ffff8806a45ea700
jul 23 23:28:07 sL1pKn07 kernel:  ffff8806a4628000 ffff880ca24a8c48
ffff8806a45ea700 ffff8806a4627e18
jul 23 23:28:07 sL1pKn07 kernel:  ffff88053a170d08 ffff8806a4627b90
ffffffff815c37fc 7fffffffffffffff
jul 23 23:28:07 sL1pKn07 kernel: Call Trace:
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c37fc>] schedule+0x3c/0x90
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c62d3>]
schedule_timeout+0x1d3/0x260
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff811c8f8c>] ?
alloc_pages_current+0x8c/0x110
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c5276>] __down+0x76/0xc0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810c4611>] down+0x41/0x50
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b23bf8>]
os_acquire_mutex+0x38/0x40 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa1083e08>]
_nv016567rm+0x18/0x30 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa1030f3d>] ?
_nv018664rm+0x3d/0x120 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0eb246b>] ?
_nv017224rm+0xfb/0x200 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa10879a5>] ?
_nv000814rm+0x225/0xbb0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa108acd9>] ?
rm_execute_work_item+0x49/0xc0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b24096>] ?
os_execute_work_item+0x46/0x70 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093a05>] ?
process_one_work+0x1e5/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ce8>] ?
worker_thread+0x48/0x4e0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ca0>] ?
process_one_work+0x480/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81099998>] ? kthread+0xd8/0xf0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c7482>] ? ret_from_fork+0x22/0x40
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810998c0>] ?
kthread_worker_fn+0x170/0x170
jul 23 23:28:07 sL1pKn07 kernel: INFO: task kworker/0:1:50 blocked for
more than 120 seconds.
jul 23 23:28:07 sL1pKn07 kernel:       Tainted: P           O    4.6.2-1-ARCH #1
jul 23 23:28:07 sL1pKn07 kernel: "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
jul 23 23:28:07 sL1pKn07 kernel: kworker/0:1     D ffff8806a4187b88
 0    50      2 0x00000000
jul 23 23:28:07 sL1pKn07 kernel: Workqueue: events os_execute_work_item [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  ffff8806a4187b88 0000000b00000000
ffffffff8180d500 ffff8806a415e800
jul 23 23:28:07 sL1pKn07 kernel:  ffff8806a4188000 ffff880ca24a8c48
ffff8806a415e800 ffff8806a4187e18
jul 23 23:28:07 sL1pKn07 kernel:  ffff88053cb71ec8 ffff8806a4187ba0
ffffffff815c37fc 7fffffffffffffff
jul 23 23:28:07 sL1pKn07 kernel: Call Trace:
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c37fc>] schedule+0x3c/0x90
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c62d3>]
schedule_timeout+0x1d3/0x260
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c5276>] __down+0x76/0xc0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810c4611>] down+0x41/0x50
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b23bf8>]
os_acquire_mutex+0x38/0x40 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa1083e08>]
_nv016567rm+0x18/0x30 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa1030f3d>] ?
_nv018664rm+0x3d/0x120 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0f8aee5>] ?
_nv020254rm+0x395/0x7a0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa10879a5>] ?
_nv000814rm+0x225/0xbb0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa108acd9>] ?
rm_execute_work_item+0x49/0xc0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b24096>] ?
os_execute_work_item+0x46/0x70 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093a05>] ?
process_one_work+0x1e5/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ce8>] ?
worker_thread+0x48/0x4e0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ca0>] ?
process_one_work+0x480/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81099998>] ? kthread+0xd8/0xf0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c7482>] ? ret_from_fork+0x22/0x40
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810998c0>] ?
kthread_worker_fn+0x170/0x170
jul 23 23:28:07 sL1pKn07 kernel: INFO: task kworker/0:2:768 blocked
for more than 120 seconds.
jul 23 23:28:07 sL1pKn07 kernel:       Tainted: P           O    4.6.2-1-ARCH #1
jul 23 23:28:07 sL1pKn07 kernel: "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
jul 23 23:28:07 sL1pKn07 kernel: kworker/0:2     D ffff8806a1897b78
 0   768      2 0x00000000
jul 23 23:28:07 sL1pKn07 kernel: Workqueue: events os_execute_work_item [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  ffff8806a1897b78 0000000000016400
ffff88053b0ea700 ffff8806a182e800
jul 23 23:28:07 sL1pKn07 kernel:  ffff8806a1898000 ffff880ca24a8c48
ffff8806a182e800 ffff8806a1897e18
jul 23 23:28:07 sL1pKn07 kernel:  ffff88053a11f988 ffff8806a1897b90
ffffffff815c37fc 7fffffffffffffff
jul 23 23:28:07 sL1pKn07 kernel: Call Trace:
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c37fc>] schedule+0x3c/0x90
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c62d3>]
schedule_timeout+0x1d3/0x260
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c3089>] ? __schedule+0x399/0xad0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c5276>] __down+0x76/0xc0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810c4611>] down+0x41/0x50
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b23bf8>]
os_acquire_mutex+0x38/0x40 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa1083e08>]
_nv016567rm+0x18/0x30 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa1030f3d>] ?
_nv018664rm+0x3d/0x120 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b7087f>] ?
_nv003893rm+0xcf/0x170 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b6f7b3>] ?
_nv003899rm+0xf3/0x760 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa10879a5>] ?
_nv000814rm+0x225/0xbb0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa108acd9>] ?
rm_execute_work_item+0x49/0xc0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b24096>] ?
os_execute_work_item+0x46/0x70 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093a05>] ?
process_one_work+0x1e5/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ce8>] ?
worker_thread+0x48/0x4e0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ca0>] ?
process_one_work+0x480/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81099998>] ? kthread+0xd8/0xf0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c7482>] ? ret_from_fork+0x22/0x40
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810998c0>] ?
kthread_worker_fn+0x170/0x170
jul 23 23:28:07 sL1pKn07 kernel: INFO: task kworker/0:3:846 blocked
for more than 120 seconds.
jul 23 23:28:07 sL1pKn07 kernel:       Tainted: P           O    4.6.2-1-ARCH #1
jul 23 23:28:07 sL1pKn07 kernel: "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
jul 23 23:28:07 sL1pKn07 kernel: kworker/0:3     D ffff88003cc07b88
 0   846      2 0x00000000
jul 23 23:28:07 sL1pKn07 kernel: Workqueue: events os_execute_work_item [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  ffff88003cc07b88 00ff8806a18be800
ffff8806a182e800 ffff8806a18be800
jul 23 23:28:07 sL1pKn07 kernel:  ffff88003cc08000 ffff880ca24a8c48
ffff8806a18be800 ffff88003cc07e18
jul 23 23:28:07 sL1pKn07 kernel:  ffff88053cb71e48 ffff88003cc07ba0
ffffffff815c37fc 7fffffffffffffff
jul 23 23:28:07 sL1pKn07 kernel: Call Trace:
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c37fc>] schedule+0x3c/0x90
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c62d3>]
schedule_timeout+0x1d3/0x260
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff812b4562>] ?
__freed_request+0x92/0xa0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff812b45ba>] ? freed_request+0x4a/0x80
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff812b4ffa>] ?
__blk_put_request+0xaa/0x1a0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c5276>] __down+0x76/0xc0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810c4611>] down+0x41/0x50
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b23bf8>]
os_acquire_mutex+0x38/0x40 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa1083e08>]
_nv016567rm+0x18/0x30 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa1030f3d>] ?
_nv018664rm+0x3d/0x120 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0f167b5>] ?
_nv021281rm+0x8b5/0x9d0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa10879a5>] ?
_nv000814rm+0x225/0xbb0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa108acd9>] ?
rm_execute_work_item+0x49/0xc0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b24096>] ?
os_execute_work_item+0x46/0x70 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093a05>] ?
process_one_work+0x1e5/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ce8>] ?
worker_thread+0x48/0x4e0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ca0>] ?
process_one_work+0x480/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ca0>] ?
process_one_work+0x480/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81099998>] ? kthread+0xd8/0xf0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c7482>] ? ret_from_fork+0x22/0x40
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810998c0>] ?
kthread_worker_fn+0x170/0x170
jul 23 23:28:07 sL1pKn07 kernel: INFO: task systemd-udevd:1065 blocked
for more than 120 seconds.
jul 23 23:28:07 sL1pKn07 kernel:       Tainted: P           O    4.6.2-1-ARCH #1
jul 23 23:28:07 sL1pKn07 kernel: "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
jul 23 23:28:07 sL1pKn07 kernel: systemd-udevd   D ffff880ca2d8f588
 0  1065   1006 0x00000006
jul 23 23:28:07 sL1pKn07 kernel:  ffff880ca2d8f588 00ffffffa0deb271
ffff880ca1f18d00 ffff880ca2d0b400
jul 23 23:28:07 sL1pKn07 kernel:  ffff880ca2d90000 ffffffffa14d5020
ffff880ca2d0b400 0000000000000000
jul 23 23:28:07 sL1pKn07 kernel:  0000000000000005 ffff880ca2d8f5a0
ffffffff815c37fc 7fffffffffffffff
jul 23 23:28:07 sL1pKn07 kernel: Call Trace:
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c37fc>] schedule+0x3c/0x90
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c62d3>]
schedule_timeout+0x1d3/0x260
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b24d82>] ?
os_acquire_spinlock+0x12/0x20 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0deb3cb>] ?
_nv011319rm+0x37b/0x560 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c5276>] __down+0x76/0xc0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff8149837c>] ?
pci_conf1_read+0xbc/0x100
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810c4611>] down+0x41/0x50
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b1cf01>]
nv_get_adapter_state+0x31/0xc0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b2540f>]
os_pci_init_handle+0xcf/0x110 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa10223eb>]
_nv016268rm+0xdb/0x240 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa105c2d6>] ?
_nv018766rm+0x326/0xe60 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa105d7af>] ?
_nv018768rm+0x3f/0x4e0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa105e366>] ?
_nv018764rm+0x1f6/0x4f80 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa105e30a>] ?
_nv018764rm+0x19a/0x4f80 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa105b510>] ?
_nv018605rm+0xbd0/0x1030 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa105b98a>] ?
_nv000837rm+0x1a/0x60 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa109401a>] ?
_nv000832rm+0x32a/0x6a0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa1088a1a>] ?
rm_init_adapter+0x6a/0x100 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810d7c00>] ?
request_threaded_irq+0xc0/0x1b0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b1a23b>] ?
nv_open_device+0x12b/0x600 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810d28de>] ?
msg_print_text+0xde/0x180
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b1d107>] ?
nvidia_dev_get+0x27/0x50 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa08c3a27>] ?
nvkms_open_gpu+0x47/0x80 [nvidia_modeset]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0928206>] ?
_nv000003kms+0x66/0x3e0 [nvidia_modeset]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810d3efa>] ?
vprintk_emit+0x23a/0x430
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810d423f>] ?
vprintk_default+0x1f/0x30
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff8116da59>] ? printk+0x57/0x73
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa053e4ae>] ?
nvidia_drm_load+0xbe/0x3a0 [nvidia_drm]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815b8dd7>] ?
klist_node_init+0x37/0x50
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa053e350>] ?
nvidia_drm_unload+0xb0/0xb0 [nvidia_drm]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff8140ef72>] ? device_add+0x232/0x670
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0463847>] ?
drm_dev_register+0xa7/0xb0 [drm]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa053e8f0>] ?
nvidia_drm_probe_devices+0x160/0x230 [nvidia_drm]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff812f422e>] ? kasprintf+0x4e/0x70
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0530000>] ? 0xffffffffa0530000
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa053e01e>] ?
nv_drm_init+0x1e/0x50 [nvidia_drm]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0530009>] ?
nv_linux_drm_init+0x9/0x1000 [nvidia_drm]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81002123>] ?
do_one_initcall+0xb3/0x1f0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff8116dc57>] ?
do_init_module+0x5f/0x1d8
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81103e26>] ?
load_module+0x2186/0x29b0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81100f20>] ?
symbol_put_addr+0x50/0x50
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff811048db>] ?
SyS_finit_module+0xeb/0x120
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c7272>] ?
entry_SYSCALL_64_fastpath+0x1a/0xa4
jul 23 23:28:07 sL1pKn07 kernel: INFO: task kworker/0:4:1673 blocked
for more than 120 seconds.
jul 23 23:28:07 sL1pKn07 kernel:       Tainted: P           O    4.6.2-1-ARCH #1
jul 23 23:28:07 sL1pKn07 kernel: "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
jul 23 23:28:07 sL1pKn07 kernel: kworker/0:4     D ffff88053cb2bb78
 0  1673      2 0x00000000
jul 23 23:28:07 sL1pKn07 kernel: Workqueue: events os_execute_work_item [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  ffff88053cb2bb78 0000000000001b9c
ffff8806a182e800 ffff88053b0e9a00
jul 23 23:28:07 sL1pKn07 kernel:  ffff88053cb2c000 ffff880ca24a8c48
ffff88053b0e9a00 ffff88053cb2be18
jul 23 23:28:07 sL1pKn07 kernel:  ffff88053a11fa08 ffff88053cb2bb90
ffffffff815c37fc 7fffffffffffffff
jul 23 23:28:07 sL1pKn07 kernel: Call Trace:
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c37fc>] schedule+0x3c/0x90
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c62d3>]
schedule_timeout+0x1d3/0x260
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff811c8f8c>] ?
alloc_pages_current+0x8c/0x110
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c5276>] __down+0x76/0xc0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810c4611>] down+0x41/0x50
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b23bf8>]
os_acquire_mutex+0x38/0x40 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa1083e08>]
_nv016567rm+0x18/0x30 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa1030f3d>] ?
_nv018664rm+0x3d/0x120 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b7087f>] ?
_nv003893rm+0xcf/0x170 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b6f7b3>] ?
_nv003899rm+0xf3/0x760 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa10879a5>] ?
_nv000814rm+0x225/0xbb0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa108acd9>] ?
rm_execute_work_item+0x49/0xc0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b24096>] ?
os_execute_work_item+0x46/0x70 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093a05>] ?
process_one_work+0x1e5/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ce8>] ?
worker_thread+0x48/0x4e0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ca0>] ?
process_one_work+0x480/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ca0>] ?
process_one_work+0x480/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81099998>] ? kthread+0xd8/0xf0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c7482>] ? ret_from_fork+0x22/0x40
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810998c0>] ?
kthread_worker_fn+0x170/0x170
jul 23 23:28:07 sL1pKn07 kernel: INFO: task kworker/0:5:1695 blocked
for more than 120 seconds.
jul 23 23:28:07 sL1pKn07 kernel:       Tainted: P           O    4.6.2-1-ARCH #1
jul 23 23:28:07 sL1pKn07 kernel: "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
jul 23 23:28:07 sL1pKn07 kernel: kworker/0:5     D ffff8806a2c2bb88
 0  1695      2 0x00000000
jul 23 23:28:07 sL1pKn07 kernel: Workqueue: events os_execute_work_item [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  ffff8806a2c2bb88 00ff8806a2c2bbb8
ffff88053b0edb00 ffff88053b0ea700
jul 23 23:28:07 sL1pKn07 kernel:  ffff8806a2c2c000 ffff880ca24a8c48
ffff88053b0ea700 ffff8806a2c2be18
jul 23 23:28:07 sL1pKn07 kernel:  ffff88053c8f6108 ffff8806a2c2bba0
ffffffff815c37fc 7fffffffffffffff
jul 23 23:28:07 sL1pKn07 kernel: Call Trace:
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c37fc>] schedule+0x3c/0x90
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c62d3>]
schedule_timeout+0x1d3/0x260
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c3089>] ? __schedule+0x399/0xad0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c5276>] __down+0x76/0xc0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810c4611>] down+0x41/0x50
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b23bf8>]
os_acquire_mutex+0x38/0x40 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa1083e08>]
_nv016567rm+0x18/0x30 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa1030f3d>] ?
_nv018664rm+0x3d/0x120 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0c890e8>] ?
_nv006228rm+0x858/0xa40 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa10879a5>] ?
_nv000814rm+0x225/0xbb0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa108acd9>] ?
rm_execute_work_item+0x49/0xc0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b24096>] ?
os_execute_work_item+0x46/0x70 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093a05>] ?
process_one_work+0x1e5/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ce8>] ?
worker_thread+0x48/0x4e0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ca0>] ?
process_one_work+0x480/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81099998>] ? kthread+0xd8/0xf0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c7482>] ? ret_from_fork+0x22/0x40
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810998c0>] ?
kthread_worker_fn+0x170/0x170
jul 23 23:28:07 sL1pKn07 kernel: INFO: task kworker/0:6:1696 blocked
for more than 120 seconds.
jul 23 23:28:07 sL1pKn07 kernel:       Tainted: P           O    4.6.2-1-ARCH #1
jul 23 23:28:07 sL1pKn07 kernel: "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
jul 23 23:28:07 sL1pKn07 kernel: kworker/0:6     D ffff88053a2dbb78
 0  1696      2 0x00000000
jul 23 23:28:07 sL1pKn07 kernel: Workqueue: events os_execute_work_item [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  ffff88053a2dbb78 0000000000001b9c
ffffffff8180d500 ffff88053b0eb400
jul 23 23:28:07 sL1pKn07 kernel:  ffff88053a2dc000 ffff880ca24a8c48
ffff88053b0eb400 ffff88053a2dbe18
jul 23 23:28:07 sL1pKn07 kernel:  ffff88053a170cc8 ffff88053a2dbb90
ffffffff815c37fc 7fffffffffffffff
jul 23 23:28:07 sL1pKn07 kernel: Call Trace:
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c37fc>] schedule+0x3c/0x90
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c62d3>]
schedule_timeout+0x1d3/0x260
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c5276>] __down+0x76/0xc0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810c4611>] down+0x41/0x50
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b23bf8>]
os_acquire_mutex+0x38/0x40 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa1083e08>]
_nv016567rm+0x18/0x30 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa1030f3d>] ?
_nv018664rm+0x3d/0x120 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0eb246b>] ?
_nv017224rm+0xfb/0x200 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa10879a5>] ?
_nv000814rm+0x225/0xbb0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa108acd9>] ?
rm_execute_work_item+0x49/0xc0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b24096>] ?
os_execute_work_item+0x46/0x70 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093a05>] ?
process_one_work+0x1e5/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ce8>] ?
worker_thread+0x48/0x4e0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ca0>] ?
process_one_work+0x480/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ca0>] ?
process_one_work+0x480/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81099998>] ? kthread+0xd8/0xf0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c7482>] ? ret_from_fork+0x22/0x40
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810998c0>] ?
kthread_worker_fn+0x170/0x170
jul 23 23:28:07 sL1pKn07 kernel: INFO: task setup_kvm_vfio.:1719
blocked for more than 120 seconds.
jul 23 23:28:07 sL1pKn07 kernel:       Tainted: P           O    4.6.2-1-ARCH #1
jul 23 23:28:07 sL1pKn07 kernel: "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
jul 23 23:28:07 sL1pKn07 kernel: setup_kvm_vfio. D ffff880b19b4fba8
 0  1719      1 0x00000000
jul 23 23:28:07 sL1pKn07 kernel:  ffff880b19b4fba8 00ff8806bfffdb40
ffff8806a4644100 ffff880b19a0a700
jul 23 23:28:07 sL1pKn07 kernel:  ffff880b19b50000 ffff880ca1c2c488
ffff880b19a0a700 ffffffffa14841a8
jul 23 23:28:07 sL1pKn07 kernel:  000000000000000d ffff880b19b4fbc0
ffffffff815c37fc 7fffffffffffffff
jul 23 23:28:07 sL1pKn07 kernel: Call Trace:
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c37fc>] schedule+0x3c/0x90
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c62d3>]
schedule_timeout+0x1d3/0x260
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81270f97>] ?
kernfs_iattrs.isra.0+0x37/0xd0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81267951>] ? pde_put+0x31/0x40
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c5276>] __down+0x76/0xc0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810c4611>] down+0x41/0x50
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b1cb69>]
nvidia_remove+0x139/0x390 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff8132f289>]
pci_device_remove+0x39/0xc0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81412091>]
__device_release_driver+0xa1/0x160
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81412173>]
device_release_driver+0x23/0x30
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81410c7d>] unbind_store+0x10d/0x160
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff8140fe35>] drv_attr_store+0x25/0x30
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff812749e7>] sysfs_kf_write+0x37/0x40
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81273f9c>]
kernfs_fop_write+0x11c/0x170
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff811f6397>] __vfs_write+0x37/0x100
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81214659>] ? __alloc_fd+0xc9/0x180
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff811f72a3>] vfs_write+0xa3/0x190
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff811f8745>] SyS_write+0x55/0xc0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81214933>] ? __close_fd+0xa3/0xd0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c7272>]
entry_SYSCALL_64_fastpath+0x1a/0xa4
jul 23 23:28:07 sL1pKn07 kernel: INFO: task kworker/0:7:1776 blocked
for more than 120 seconds.
jul 23 23:28:07 sL1pKn07 kernel:       Tainted: P           O    4.6.2-1-ARCH #1
jul 23 23:28:07 sL1pKn07 kernel: "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
jul 23 23:28:07 sL1pKn07 kernel: kworker/0:7     D ffff8806a1927b88
 0  1776      2 0x00000000
jul 23 23:28:07 sL1pKn07 kernel: Workqueue: events os_execute_work_item [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  ffff8806a1927b88 0000000c00000000
ffff88053b0ea700 ffff88053b0ece00
jul 23 23:28:07 sL1pKn07 kernel:  ffff8806a1928000 ffff880ca24a8c48
ffff88053b0ece00 ffff8806a1927e18
jul 23 23:28:07 sL1pKn07 kernel:  ffff88053c8f60c8 ffff8806a1927ba0
ffffffff815c37fc 7fffffffffffffff
jul 23 23:28:07 sL1pKn07 kernel: Call Trace:
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c37fc>] schedule+0x3c/0x90
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c62d3>]
schedule_timeout+0x1d3/0x260
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff811c8f8c>] ?
alloc_pages_current+0x8c/0x110
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c5276>] __down+0x76/0xc0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810c4611>] down+0x41/0x50
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b23bf8>]
os_acquire_mutex+0x38/0x40 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa1083e08>]
_nv016567rm+0x18/0x30 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa1030f3d>] ?
_nv018664rm+0x3d/0x120 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0c890e8>] ?
_nv006228rm+0x858/0xa40 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa10879a5>] ?
_nv000814rm+0x225/0xbb0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa108acd9>] ?
rm_execute_work_item+0x49/0xc0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b24096>] ?
os_execute_work_item+0x46/0x70 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093a05>] ?
process_one_work+0x1e5/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ce8>] ?
worker_thread+0x48/0x4e0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ca0>] ?
process_one_work+0x480/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ca0>] ?
process_one_work+0x480/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81099998>] ? kthread+0xd8/0xf0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c7482>] ? ret_from_fork+0x22/0x40
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810998c0>] ?
kthread_worker_fn+0x170/0x170
jul 23 23:30:07 sL1pKn07 sudo[2503]: sl1pkn07 : TTY=tty1 ;
PWD=/home/sl1pkn07 ; USER=root ; COMMAND=/usr/bin/systemctl stop
vfio-bind
jul 23 23:30:07 sL1pKn07 sudo[2503]: pam_unix(sudo:session): session
opened for user root by sl1pkn07(uid=0)
jul 23 23:31:09 sL1pKn07 sudo[2503]: pam_unix(sudo:session): session
closed for user root
jul 23 23:31:15 sL1pKn07 sudo[2506]: sl1pkn07 : TTY=tty1 ;
PWD=/home/sl1pkn07 ; USER=root ; COMMAND=/usr/bin/systemctl disable
vfio-bind
jul 23 23:31:15 sL1pKn07 sudo[2506]: pam_unix(sudo:session): session
opened for user root by sl1pkn07(uid=0)
jul 23 23:31:15 sL1pKn07 systemd[1]: Reloading.
jul 23 23:28:07 sL1pKn07 kernel: setup_kvm_vfio. D ffff880b19b4fba8
 0  1719      1 0x00000000
jul 23 23:28:07 sL1pKn07 kernel:  ffff880b19b4fba8 00ff8806bfffdb40
ffff8806a4644100 ffff880b19a0a700
jul 23 23:28:07 sL1pKn07 kernel:  ffff880b19b50000 ffff880ca1c2c488
ffff880b19a0a700 ffffffffa14841a8
jul 23 23:28:07 sL1pKn07 kernel:  000000000000000d ffff880b19b4fbc0
ffffffff815c37fc 7fffffffffffffff
jul 23 23:28:07 sL1pKn07 kernel: Call Trace:
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c37fc>] schedule+0x3c/0x90
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c62d3>]
schedule_timeout+0x1d3/0x260
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81270f97>] ?
kernfs_iattrs.isra.0+0x37/0xd0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81267951>] ? pde_put+0x31/0x40
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c5276>] __down+0x76/0xc0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810c4611>] down+0x41/0x50
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b1cb69>]
nvidia_remove+0x139/0x390 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff8132f289>]
pci_device_remove+0x39/0xc0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81412091>]
__device_release_driver+0xa1/0x160
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81412173>]
device_release_driver+0x23/0x30
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81410c7d>] unbind_store+0x10d/0x160
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff8140fe35>] drv_attr_store+0x25/0x30
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff812749e7>] sysfs_kf_write+0x37/0x40
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81273f9c>]
kernfs_fop_write+0x11c/0x170
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff811f6397>] __vfs_write+0x37/0x100
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81214659>] ? __alloc_fd+0xc9/0x180
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff811f72a3>] vfs_write+0xa3/0x190
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff811f8745>] SyS_write+0x55/0xc0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81214933>] ? __close_fd+0xa3/0xd0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c7272>]
entry_SYSCALL_64_fastpath+0x1a/0xa4
jul 23 23:28:07 sL1pKn07 kernel: INFO: task kworker/0:7:1776 blocked
for more than 120 seconds.
jul 23 23:28:07 sL1pKn07 kernel:       Tainted: P           O    4.6.2-1-ARCH #1
jul 23 23:28:07 sL1pKn07 kernel: "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
jul 23 23:28:07 sL1pKn07 kernel: kworker/0:7     D ffff8806a1927b88
 0  1776      2 0x00000000
jul 23 23:28:07 sL1pKn07 kernel: Workqueue: events os_execute_work_item [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  ffff8806a1927b88 0000000c00000000
ffff88053b0ea700 ffff88053b0ece00
jul 23 23:28:07 sL1pKn07 kernel:  ffff8806a1928000 ffff880ca24a8c48
ffff88053b0ece00 ffff8806a1927e18
jul 23 23:28:07 sL1pKn07 kernel:  ffff88053c8f60c8 ffff8806a1927ba0
ffffffff815c37fc 7fffffffffffffff
jul 23 23:28:07 sL1pKn07 kernel: Call Trace:
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c37fc>] schedule+0x3c/0x90
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c62d3>]
schedule_timeout+0x1d3/0x260
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff811c8f8c>] ?
alloc_pages_current+0x8c/0x110
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c5276>] __down+0x76/0xc0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810c4611>] down+0x41/0x50
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b23bf8>]
os_acquire_mutex+0x38/0x40 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa1083e08>]
_nv016567rm+0x18/0x30 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa1030f3d>] ?
_nv018664rm+0x3d/0x120 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0c890e8>] ?
_nv006228rm+0x858/0xa40 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa10879a5>] ?
_nv000814rm+0x225/0xbb0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa108acd9>] ?
rm_execute_work_item+0x49/0xc0 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffffa0b24096>] ?
os_execute_work_item+0x46/0x70 [nvidia]
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093a05>] ?
process_one_work+0x1e5/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ce8>] ?
worker_thread+0x48/0x4e0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ca0>] ?
process_one_work+0x480/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81093ca0>] ?
process_one_work+0x480/0x480
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff81099998>] ? kthread+0xd8/0xf0
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff815c7482>] ? ret_from_fork+0x22/0x40
jul 23 23:28:07 sL1pKn07 kernel:  [<ffffffff810998c0>] ?
kthread_worker_fn+0x170/0x170

and i unable to launch the X (fail connection)

is possible enable the KMS support in a specified card?

greetings

2

any help?

3

What exactly are you doing that triggers this problem, and can you please generate and attach an nvidia-bug-report.log.gz file after this happens?

4

simply add ‘nvidia-drm.modeset=1’ to kernel in grub2

linux   /boot/vmlinuz-linux-lts root=UUID=1b76a96e-0c70-49c5-a90b-c5308f969a2f rw  intel_iommu=on nvidia-drm.modeset=1

and launch this script as systemd service

└───╼  cat /etc/systemd/system/vfio-bind.service
[Unit]
Description=Binds devices to vfio-pci
After=syslog.target

[Service]
Type=oneshot
RemainAfterExit=yes
ExecStart=-/usr/bin/setup_kvm_vfio.sh

[Install]
WantedBy=multi-user.target
┌─┤[$]|[sl1pkn07]|[sL1pKn07]|[~/aplicaciones/chromium-dev]|
└───╼  cat /usr/bin/setup_kvm_vfio.sh 
#!/bin/bash

# Get pci-id host GPU 
host_gpu=$(lspci | grep "GTX 770" | awk '{print $1;}')
host_gpu_audio=$(echo $host_gpu | sed -e 's/\.0$/.1/')

# Get pci-id/vendor-id/device-id guest GPU
guest_gpu=$(lspci | grep "GTX TITAN Black" | awk '{print $1;}')
guest_gpu_vendor=$(cat /sys/bus/pci/devices/0000:$guest_gpu/vendor)
guest_gpu_device=$(cat /sys/bus/pci/devices/0000:$guest_gpu/device)
guest_gpu_audio=$(echo $guest_gpu | sed -e 's/\.0$/.1/')
guest_gpu_audio_vendor=$(cat /sys/bus/pci/devices/0000:$guest_gpu_audio/vendor)
guest_gpu_audio_device=$(cat /sys/bus/pci/devices/0000:$guest_gpu_audio/device)

# Get pci-id/vendor-id/device-id guest USB
# usb_pci=$(lspci | grep "NEC" | head -1 | awk '{print $1;}')
# usb_pci_vendor=$(cat /sys/bus/pci/devices/0000:$usb_pci/vendor)
# usb_pci_device=$(cat /sys/bus/pci/devices/0000:$usb_pci/device)

# Get pci-id/vendor-id/device-id guest SATA
# sata_pci=$(lspci | grep "Marvell Technology Group Ltd. 88SE9120 SATA" | awk '{print $1;}')
# sata_pci_vendor=$(cat /sys/bus/pci/devices/0000:$sata_pci/vendor)
# sata_pci_device=$(cat /sys/bus/pci/devices/0000:$sata_pci/device)

# Set real driver for host GPU/GPU-audio
echo nvidia        > /sys/bus/pci/devices/0000:$host_gpu/driver_override
echo snd-hda-intel > /sys/bus/pci/devices/0000:$host_gpu_audio/driver_override

# Set vfio-pci driver for guest GPU/GPU-audio/USB/SATA
echo vfio-pci      > /sys/bus/pci/devices/0000:$guest_gpu/driver_override
echo vfio-pci      > /sys/bus/pci/devices/0000:$guest_gpu_audio/driver_override
# echo vfio-pci       > /sys/bus/pci/devices/0000:$usb_pci/driver_override
# echo vfio-pci       > /sys/bus/pci/devices/0000:$sata_pci/driver_override

# Load vfio-pci kernel module
modprobe vfio-pci

# Set GPU/GPU-audio/USB/SATA vfio-pci id
echo $guest_gpu_vendor $guest_gpu_device             > /sys/bus/pci/drivers/vfio-pci/new_id
echo $guest_gpu_audio_vendor $guest_gpu_audio_device > /sys/bus/pci/drivers/vfio-pci/new_id
# echo $usb_pci_vendor $usb_pci_device                 > /sys/bus/pci/drivers/vfio-pci/new_id
# echo $sata_pci_vendor $sata_pci_device               > /sys/bus/pci/drivers/vfio-pci/new_id

# Unbind GPU/GPU-audio/USB/SATA real driver
echo 0000:$guest_gpu       > /sys/bus/pci/devices/0000:$guest_gpu/driver/unbind
echo 0000:$guest_gpu_audio > /sys/bus/pci/devices/0000:$guest_gpu_audio/driver/unbind
# echo 0000:$usb_pci          > /sys/bus/pci/devices/0000:$usb_pci/driver/unbind
# echo 0000:$sata_pci         > /sys/bus/pci/devices/0000:$sata_pci/driver/unbind

# Bind GPU/GPU-audio/USB/SATA to vfio-pci
echo 0000:$guest_gpu       > /sys/bus/pci/drivers/vfio-pci/bind
echo 0000:$guest_gpu_audio > /sys/bus/pci/drivers/vfio-pci/bind
# echo 0000:$usb_pci        > /sys/bus/pci/drivers/vfio-pci/bind
# echo 0000:$sata_pci       > /sys/bus/pci/drivers/vfio-pci/bind

# Load nvidia kernel module
modprobe nvidia

then try startx or startplasmacompositor

The mobo is a EVGA SR-2, the pci layout is

slot1 -> GTX 770 (host)
slot2 -> empty
slot3 -> empty
slot4 -> LSI SAS controller (8x) (host)
slot5 -> empty
slot6 -> Asus U3S6 (USB3 and SATA6 card) (conected to VM disk)
slot7 -> GTX TITAN Black (guest)

can’t generate the nvidia report bug now because is in production in this time

greetings

5

new notices

time ago, swicth from script to kernel option (and upgrade the GTX770(host) to Titan Black, and the Titan black to Titan X Maxwell(guest). the pci layout is the same)

options vfio_pci ids=10de:17c2,10de:0fb0

with this, vfio module kernel load without problem described in the first post

but lead other fail if try to load weston with EGL

weston-launcher -- --use-egldevice

(weston-eglstreams in [AUR])

now show this message in kernel

[drm:nvidia_drm_gem_import_nvkms_memory [nvidia_drm]] *ERROR* [nvidia-drm] [GPU ID 0x00001300] Failed to import NVKMS memory to GEM object

and the weston launcher show this:

Date: 2017-01-21 CET
[22:30:24.619] weston 1.12.0
               http://wayland.freedesktop.org
               Bug reports to: https://bugs.freedesktop.org/enter_bug.cgi?product=Wayland&component=weston&version=1.12.0
               Build: 1.11.94-2-ga08dff5 configure.ac: bump to version 1.12.0 for the official release (2016-09-20 12:22:46 -0700)
[22:30:24.619] Command line: /usr/bin/weston
[22:30:24.619] OS: Linux, 4.8.11-1-ARCH, #1 SMP PREEMPT Sun Nov 27 09:26:14 CET 2016, x86_64
[22:30:24.619] Starting with no config file.
[22:30:24.619] Output repaint window is 7 ms maximum.
[22:30:24.619] Loading module '/usr/lib/libweston-1/drm-backend.so'
[22:30:24.622] initializing drm backend
[22:30:24.624] logind: session control granted
[22:30:24.625] using /dev/dri/card0
[22:30:24.625] Loading module '/usr/lib/libweston-1/gl-renderer.so'
[22:30:24.660] EGL client extensions:
[22:30:24.660] warning: either no EGL_EXT_platform_base support or specific platform support; falling back to eglGetDisplay.
[22:30:24.660] failed to create display
[22:30:24.660] failed to initialize egl
[22:30:24.660] fatal: failed to create compositor backend

attach also the nvidia bugreport

greetings
nvidia-bug-report.log.gz (317 KB)