Panic triggered by remote graphics, modesetting driver, drm g20181126

[outpaddling]

This one might be a bit obscure, but it's reproducible, so maybe we can track it down. When I try to launch octave --force-gui on a remote Linux system, my FreeBSD 12 box panics.

Interestingly, I can run octave on a remote FreeBSD system without any issues.

vendor     = 'Intel Corporation'
device     = 'Xeon E3-1200 v2/3rd Gen Core processor Graphics Controller'
class      = display

<<<ROOT@cray.acadix>>> /home/bacon 213 # kgdb -d /var/crash -n 1 /boot/kernel/kernel
GNU gdb (GDB) 8.2.1 [GDB v8.2.1 for FreeBSD]
Copyright (C) 2018 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-portbld-freebsd12.0".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
    <http://www.gnu.org/software/gdb/documentation/>.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /boot/kernel/kernel...Reading symbols from /usr/lib/debug//boot/kernel/kernel.debug...done.
done.

Unread portion of the kernel message buffer:


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address	= 0x538
fault code		= supervisor read data, page not present
instruction pointer	= 0x20:0xffffffff82af3f1f
stack pointer	        = 0x28:0xfffffe004afb5640
frame pointer	        = 0x28:0xfffffe004afb5670
code segment		= base 0x0, limit 0xfffff, type 0x1b
			= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags	= interrupt enabled, resume, IOPL = 0
current process		= 16798 (ssh)
trap number		= 12
WARNING !drm_modeset_is_locked(&crtc->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-4192575/drivers/gpu/drm/drm_atomic_helper.c:577
WARNING !drm_modeset_is_locked(&crtc->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-4192575/drivers/gpu/drm/drm_atomic_helper.c:577
WARNING !drm_modeset_is_locked(&crtc->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-4192575/drivers/gpu/drm/drm_atomic_helper.c:577
WARNING !drm_modeset_is_locked(&dev->mode_config.connection_mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-4192575/drivers/gpu/drm/drm_atomic_helper.c:622
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-4192575/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-4192575/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-4192575/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-4192575/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-4192575/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-4192575/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-4192575/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-4192575/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-4192575/drivers/gpu/drm/drm_atomic_helper.c:821
<4>WARN_ON(!mutex_is_locked(&dev->struct_mutex))
                           
<4>WARN_ON(!mutex_is_locked(&fbc->lock))WARN_ON(!mutex_is_locked(&fbc->lock))WARN_ON(!mutex_is_locked(&fbc->lock))
panic: page fault
cpuid = 0
time = 1554300927
KDB: stack backtrace:
#0 0xffffffff80be7977 at kdb_backtrace+0x67
#1 0xffffffff80b9b563 at vpanic+0x1a3
#2 0xffffffff80b9b3b3 at panic+0x43
#3 0xffffffff8107496f at trap_fatal+0x35f
#4 0xffffffff810749c9 at trap_pfault+0x49
#5 0xffffffff81073fee at trap+0x29e
#6 0xffffffff8104f435 at calltrap+0x8
#7 0xffffffff80b4363a at _fdrop+0x1a
#8 0xffffffff80b466e4 at closef+0x244
#9 0xffffffff80c3bcea at unp_freerights+0x12a
#10 0xffffffff80c3af62 at unp_externalize+0x232
#11 0xffffffff80c32f98 at soreceive_generic+0x678
#12 0xffffffff80c34984 at soreceive+0x44
#13 0xffffffff80c041f5 at dofileread+0x95
#14 0xffffffff80c03d63 at sys_read+0xc3
#15 0xffffffff81075449 at amd64_syscall+0x369
#16 0xffffffff8104fd1d at fast_syscall_common+0x101
Uptime: 20h40m18s
Dumping 737 out of 7959 MB:..3%..11%..22%..31%..42%..53%..61%..72%..81%..92%

__curthread () at ./machine/pcpu.h:230
230	./machine/pcpu.h: No such file or directory.
(kgdb) where
#0  __curthread () at ./machine/pcpu.h:230
#1  doadump (textdump=<optimized out>) at /usr/src/sys/kern/kern_shutdown.c:366
#2  0xffffffff80b9b14b in kern_reboot (howto=260)
    at /usr/src/sys/kern/kern_shutdown.c:446
#3  0xffffffff80b9b5c3 in vpanic (fmt=<optimized out>, ap=0xfffffe004afb5390)
    at /usr/src/sys/kern/kern_shutdown.c:872
#4  0xffffffff80b9b3b3 in panic (fmt=<unavailable>)
    at /usr/src/sys/kern/kern_shutdown.c:799
#5  0xffffffff8107496f in trap_fatal (frame=0xfffffe004afb5580, eva=1336)
    at /usr/src/sys/amd64/amd64/trap.c:929
#6  0xffffffff810749c9 in trap_pfault (frame=0xfffffe004afb5580, usermode=0)
    at /usr/src/sys/amd64/amd64/trap.c:765
#7  0xffffffff81073fee in trap (frame=0xfffffe004afb5580)
    at /usr/src/sys/amd64/amd64/trap.c:441
#8  <signal handler called>
#9  linux_set_current (td=0x0)
    at /usr/src/sys/compat/linuxkpi/common/include/linux/compat.h:47
#10 linux_file_close (file=0xfffff8000475d000, td=0x0)
    at /usr/src/sys/compat/linuxkpi/common/src/linux_compat.c:1392
#11 0xffffffff80b4363a in fo_close (fp=0xfffff8000475d000, td=0x0)
    at /usr/src/sys/sys/file.h:353
#12 _fdrop (fp=0xfffff8000475d000, td=0x0)
    at /usr/src/sys/kern/kern_descrip.c:2950
#13 0xffffffff80b466e4 in closef (fp=0xfffff8000475d000, td=0x0)
    at /usr/src/sys/kern/kern_descrip.c:2528
#14 0xffffffff80c3bcea in unp_discard (fp=0xfffff8000475d000)
    at /usr/src/sys/kern/uipc_usrreq.c:2381
#15 unp_freerights (fdep=0xfffff8000466eb30, fdcount=<optimized out>)
    at /usr/src/sys/kern/uipc_usrreq.c:1976
--Type <RET> for more, q to quit, c to continue without paging--
#16 0xffffffff80c3af62 in unp_externalize (control=0xfffff8000466eb00, 
    controlp=<optimized out>, flags=<optimized out>)
    at /usr/src/sys/kern/uipc_usrreq.c:2016
#17 0xffffffff80c32f98 in soreceive_generic (so=<optimized out>, psa=0x0, 
    uio=0xfffffe004afb5920, mp0=0x0, controlp=0x0, flagsp=0x0)
    at /usr/src/sys/kern/uipc_socket.c:1892
#18 0xffffffff80c34984 in soreceive (so=0xfffff8000475d000, psa=0x0, uio=0x1, 
    mp0=0x1, controlp=0x0, flagsp=0xe) at /usr/src/sys/kern/uipc_socket.c:2561
#19 0xffffffff80c041f5 in fo_read (fp=<optimized out>, uio=<optimized out>, 
    active_cred=0x1, flags=<optimized out>, td=<optimized out>)
    at /usr/src/sys/sys/file.h:306
#20 dofileread (td=<optimized out>, fd=7, fp=<optimized out>, 
    auio=0xfffffe004afb5920, offset=7, flags=<optimized out>)
    at /usr/src/sys/kern/sys_generic.c:368
#21 0xffffffff80c03d63 in kern_readv (td=<optimized out>, fd=7, 
    auio=<optimized out>) at /usr/src/sys/kern/sys_generic.c:289
#22 sys_read (td=0xfffff80086278580, uap=<optimized out>)
    at /usr/src/sys/kern/sys_generic.c:205
#23 0xffffffff81075449 in syscallenter (td=<optimized out>)
    at /usr/src/sys/amd64/amd64/../../kern/subr_syscall.c:135
#24 amd64_syscall (td=0xfffff80086278580, traced=0)
    at /usr/src/sys/amd64/amd64/trap.c:1076
#25 <signal handler called>
#26 0x00000008007cf07a in ?? ()
Backtrace stopped: Cannot access memory at address 0x7fffffff6cf8

[jsm222]

FWIW using firefox on linux also crashes. ssh -Y linuxbox; firefox -> crash

[thefallenidealist]

Same thing happened to me: FreeBSD 12.1-RELEASE host, bastille 12.1-RELEASE jail (with pkgs: zsh, firefox, xauth).
Trying to connect from host to jail to run firefox (ssh -YC jailname firefox) results in kernel panic

innovator dumped core - see /var/crash/vmcore.6

Mon Jun 15 08:49:46 CEST 2020

FreeBSD innovator 12.1-RELEASE-p6 FreeBSD 12.1-RELEASE-p6 118b3d5f0a4(my12.1) MYKERNEL  amd64

panic: page fault

Reading symbols from /boot/kernel/kernel...
Reading symbols from /usr/lib/debug//boot/kernel/kernel.debug...

Unread portion of the kernel message buffer:


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address	= 0x538
fault code		= supervisor read data, page not present
instruction pointer	= 0x20:0xffffffff8300210f
stack pointer	        = 0x28:0xfffffe00933e1620
frame pointer	        = 0x28:0xfffffe00933e1650
code segment		= base 0x0, limit 0xfffff, type 0x1b
			= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags	= interrupt enabled, resume, IOPL = 0
current process		= 2354 (ssh)
trap number		= 12
WARNING !drm_modeset_is_locked(&crtc->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:577
WARNING !drm_modeset_is_locked(&crtc->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:577
WARNING !drm_modeset_is_locked(&crtc->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:577
WARNING !drm_modeset_is_locked(&dev->mode_config.connection_mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:622
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:821
<4>WARN_ON(!mutex_is_locked(&dev->struct_mutex))
                             
<4>WARN_ON(!mutex_is_locked(&fbc->lock))WARN_ON(!mutex_is_locked(&fbc->lock))WARN_ON(!mutex_is_locked(&fbc->lock))
panic: page fault
cpuid = 0
time = 1592203676
KDB: stack backtrace:
#0 0xffffffff80b8d497 at kdb_backtrace+0x67
#1 0xffffffff80b407cd at vpanic+0x19d
#2 0xffffffff80b40623 at panic+0x43
#3 0xffffffff81018dcc at trap_fatal+0x39c
#4 0xffffffff81018e19 at trap_pfault+0x49
#5 0xffffffff8101840f at trap+0x29f
#6 0xffffffff80ff1d8c at calltrap+0x8
#7 0xffffffff80ae81ea at _fdrop+0x1a
#8 0xffffffff80aeb311 at closef+0x241
#9 0xffffffff80be281a at unp_freerights+0x13a
#10 0xffffffff80be1a51 at unp_externalize+0x211
#11 0xffffffff80bd999c at soreceive_generic+0x66c
#12 0xffffffff80bdb3d4 at soreceive+0x44
#13 0xffffffff80baa9d5 at dofileread+0x95
#14 0xffffffff80baa551 at sys_read+0xc1
#15 0xffffffff81019984 at amd64_syscall+0x364
#16 0xffffffff80ff26b0 at fast_syscall_common+0x101
Uptime: 1m20s
Dumping 921 out of 16264 MB:..2%..11%..21%..32%..42%..51%..61%..72%..82%..91%

__curthread () at /usr/src/sys/amd64/include/pcpu.h:234
234		__asm("movq %%gs:%P1,%0" : "=r" (td) : "n" (OFFSETOF_CURTHREAD));
(kgdb) #0  __curthread () at /usr/src/sys/amd64/include/pcpu.h:234
#1  doadump (textdump=<optimized out>)
    at /usr/src/sys/kern/kern_shutdown.c:371
#2  0xffffffff80b403c8 in kern_reboot (howto=260)
    at /usr/src/sys/kern/kern_shutdown.c:451
#3  0xffffffff80b40829 in vpanic (fmt=<optimized out>, ap=<optimized out>)
    at /usr/src/sys/kern/kern_shutdown.c:877
#4  0xffffffff80b40623 in panic (fmt=<unavailable>)
    at /usr/src/sys/kern/kern_shutdown.c:804
#5  0xffffffff81018dcc in trap_fatal (frame=0xfffffe00933e1560, eva=1336)
    at /usr/src/sys/amd64/amd64/trap.c:943
#6  0xffffffff81018e19 in trap_pfault (frame=0xfffffe00933e1560, usermode=0)
    at /usr/src/sys/amd64/amd64/trap.c:767
#7  0xffffffff8101840f in trap (frame=0xfffffe00933e1560)
    at /usr/src/sys/amd64/amd64/trap.c:443
#8  <signal handler called>
#9  linux_set_current (td=0x0)
    at /usr/src/sys/compat/linuxkpi/common/include/linux/compat.h:47
#10 linux_file_close (file=0xfffff8019eca3640, td=0x0)
    at /usr/src/sys/compat/linuxkpi/common/src/linux_compat.c:1507
#11 0xffffffff80ae81ea in fo_close (fp=0xfffff8019eca3640, td=0x0)
    at /usr/src/sys/sys/file.h:360
#12 _fdrop (fp=0xfffff8019eca3640, td=0x0)
    at /usr/src/sys/kern/kern_descrip.c:2977
#13 0xffffffff80aeb311 in closef (fp=0xfffff8019eca3640, td=0x0)
    at /usr/src/sys/kern/kern_descrip.c:2546
#14 0xffffffff80be281a in unp_discard (fp=0xfffff8019eca3640)
    at /usr/src/sys/kern/uipc_usrreq.c:2417
#15 unp_freerights (fdep=0xfffff80027bb6330, fdcount=<optimized out>)
    at /usr/src/sys/kern/uipc_usrreq.c:1973
#16 0xffffffff80be1a51 in unp_externalize (control=0xfffff80027bb6300, 
    controlp=<optimized out>, flags=<optimized out>)
    at /usr/src/sys/kern/uipc_usrreq.c:2013
#17 0xffffffff80bd999c in soreceive_generic (so=<optimized out>, psa=0x0, 
    uio=0xfffffe00933e1910, mp0=0x0, controlp=0x0, flagsp=0x0)
    at /usr/src/sys/kern/uipc_socket.c:1894
#18 0xffffffff80bdb3d4 in soreceive (so=0xfffff8019eca3640, psa=0x0, uio=0x1, 
    mp0=0x1, controlp=0xfffff8015671c450, flagsp=0x0)
    at /usr/src/sys/kern/uipc_socket.c:2563
#19 0xffffffff80baa9d5 in fo_read (fp=<optimized out>, uio=<optimized out>, 
    active_cred=0x1, flags=<optimized out>, td=<optimized out>)
    at /usr/src/sys/sys/file.h:313
#20 dofileread (td=<optimized out>, fd=7, fp=<optimized out>, 
    auio=0xfffffe00933e1910, offset=7, flags=<optimized out>)
    at /usr/src/sys/kern/sys_generic.c:368
#21 0xffffffff80baa551 in kern_readv (td=<optimized out>, fd=7, 
    auio=<optimized out>) at /usr/src/sys/kern/sys_generic.c:289
#22 sys_read (td=0xfffff8001e2d95e0, uap=<optimized out>)
    at /usr/src/sys/kern/sys_generic.c:205
#23 0xffffffff81019984 in syscallenter (td=0xfffff8001e2d95e0)
    at /usr/src/sys/amd64/amd64/../../kern/subr_syscall.c:135
#24 amd64_syscall (td=0xfffff8001e2d95e0, traced=0)
    at /usr/src/sys/amd64/amd64/trap.c:1186
#25 <signal handler called>
#26 0x00000001007d8dfa in ?? ()
Backtrace stopped: Cannot access memory at address 0x7fffffff6868
(kgdb) 

------------------------------------------------------------------------
ps -axlww

 UID  PID PPID CPU PRI NI     VSZ   RSS MWCHAN   STAT TT     TIME COMMAND
   0    0    0   0 -16  0       0     0 swapin   DLs   -  0:03.30 [kernel]
   0    1    0   0  20  0    9924  1048 wait     DLs   -  0:00.17 [init]
   0    2    0   0 -16  0       0     0 crypto_w DL    -  0:00.00 [crypto]
   0    3    0   0 -16  0       0     0 crypto_r DL    -  0:00.00 [crypto returns 0]
   0    4    0   0 -16  0       0     0 crypto_r DL    -  0:00.00 [crypto returns 1]
   0    5    0   0 -16  0       0     0 crypto_r DL    -  0:00.00 [crypto returns 2]
   0    6    0   0 -16  0       0     0 crypto_r DL    -  0:00.00 [crypto returns 3]
   0    7    0   0 -16  0       0     0 -        RL    -  0:00.06 [cam]
   0    8    0   0 -16  0       0     0 -        DL    -  0:00.00 [soaiod1]
   0    9    0   0 -16  0       0     0 -        DL    -  0:00.00 [soaiod2]
   0   10    0   0 -16  0       0     0 audit_wo DL    -  0:00.00 [audit]
   0   11    0   0 155  0       0     0 -        RL    -  3:08.24 [idle]
   0   12    0   0 -56  0       0     0 -        WL    -  0:01.44 [intr]
   0   13    0   0  -8  0       0     0 -        DL    -  0:00.20 [geom]
   0   14    0   0 -16  0       0     0 -        DL    -  0:00.00 [soaiod3]
   0   15    0   0 -16  0       0     0 -        DL    -  0:00.00 [soaiod4]
   0   16    0   0  -8  0       0     0 t->zthr_ DL    -  0:00.07 [zfskern]
   0   17    0   0 -16  0       0     0 waiting_ DL    -  0:00.00 [sctp_iterator]
   0   18    0   0 -16  0       0     0 -        DL    -  0:00.02 [rand_harvestq]
   0   19    0   0 -16  0       0     0 tzpoll   DL    -  0:00.00 [acpi_thermal]
   0   20    0   0 -16  0       0     0 cooling  DL    -  0:00.00 [acpi_cooling0]
   0   21    0   0 -16  0       0     0 psleep   DL    -  0:00.01 [pagedaemon]
   0   22    0   0 -16  0       0     0 psleep   DL    -  0:00.01 [vmdaemon]
   0   23    0   0 -16  0       0     0 qsleep   DL    -  0:00.01 [bufdaemon]
   0   24    0   0  16  0       0     0 syncer   DL    -  0:00.00 [syncer]
   0   25    0   0 -16  0       0     0 vlruwt   DL    -  0:00.00 [vnlru]
   0   26    0   0 -16  0       0     0 -        DL    -  0:00.02 [racctd]
   0   27    0   0  20  0       0     0 geli:w   DL    -  0:00.12 [g_eli[0] ada0p3]
   0   28    0   0  20  0       0     0 geli:w   DL    -  0:00.12 [g_eli[1] ada0p3]
   0   29    0   0  20  0       0     0 geli:w   DL    -  0:00.15 [g_eli[2] ada0p3]
   0   30    0   0  20  0       0     0 geli:w   DL    -  0:00.13 [g_eli[3] ada0p3]
   0  132    0   0 -68  0       0     0 -        DL    -  0:00.78 [usb]
   0  353    1   0  20  0   17856  7376 select   Ds    -  0:00.04 [wpa_supplicant]
   0  824    1   0  25  0   11400  2696 select   Ds    -  0:00.00 [dhclient]
   0  827    1   0  52  0   11548  2768 select   Ds    -  0:00.00 [dhclient]
  65  886    1   0  20  0   11716  2896 select   DCs   -  0:00.00 [dhclient]
   0  893    1   0  20  0   10560  1512 select   Ds    -  0:00.17 [devd]
   0  899    0   0 -16  0       0     0 pftm     DL    -  0:00.02 [pf purge]
   0  911    1   0  52  0   12448  3228 sbwait   Ds    -  0:00.00 [pflogd]
  64  914  911   0  20  0   12516  3228 bpf      D     -  0:00.45 [pflogd]
   0 1089    1   0  20  0   11348  2724 select   Ds    -  0:00.10 [syslogd]
  65 1313    1   0  25  0   14948  5500 select   Ds    -  0:00.00 [dhcpd]
   0 1328    1   0  20  0   12344  3548 nanslp   Ds    -  0:00.04 [powerd++]
 556 1352    1   0  20  0   13152  3840 select   Ds    -  0:00.03 [dbus-daemon]
   0 1383    1   0  32  0   42868 31520 wait     Ds    -  0:00.20 [slim]
   0 1389 1383   0  21  0  109772 76400 select   D     -  0:03.15 [Xorg]
   0 1407    1   0  52  0   19880  8780 select   Ds    -  0:00.00 [sshd]
 558 1414    1   0  20  0   13008  4008 select   D     -  0:00.42 [avahi-daemon]
   0 1417    1   0  37  0   54304  8420 kqread   Ds    -  0:00.03 [cupsd]
 970 1419    1   0  52  0   31188 12956 select   D     -  0:00.33 [colord]
   0 1440    1   0  52  0   11348  2616 nanslp   Ds    -  0:00.00 [cron]
   0 1506    1   0  52  0   10880  2320 ttyin    Ds+   -  0:00.00 [getty]
   0 1507    1   0  52  0   10880  2320 ttyin    Ds+   -  0:00.00 [getty]
   0 1508    1   0  52  0   10880  2320 ttyin    Ds+   -  0:00.00 [getty]
   0 1509    1   0  52  0   10880  2320 ttyin    Ds+   -  0:00.00 [getty]
   0 1510    1   0  52  0   10880  2320 ttyin    Ds+   -  0:00.00 [getty]
   0 1511    1   0  52  0   10880  2320 ttyin    Ds+   -  0:00.00 [getty]
   0 1512    1   0  52  0   10880  2320 ttyin    Ds+   -  0:00.00 [getty]
   0 1513    1   0  52  0   10880  2320 ttyin    Ds+   -  0:00.00 [getty]
 560 1518    1   0  20  0   22736  9676 select   Ds    -  0:14.16 [hald]
   0 1520    1   0  20  0   52028  8124 select   D     -  0:00.05 [console-kit-daemon]
 565 1522    1   0  20  0 1136376 23568 select   D     -  0:00.12 [polkitd]
   0 1523 1518   0  52  0   19696  6700 select   D     -  0:00.41 [hald-runner]
   0 1530 1523   0  20  0   15580  5028 select   D     -  0:00.46 [hald-addon-mouse-s]
1001 1531 1383   0  20  0   36532 20984 select   Ds    -  0:00.26 [openbox]
1001 1548 1531   0  52  0   62460 34240 select   D     -  0:02.08 [tint2]
1001 1552    1   0  20  0   13392  3812 select   D     -  0:00.44 [xbindkeys]
1001 1558 1531   0  20  0   13140  3952 nanslp   D     -  0:00.03 [osdmixer]
1001 1561 1531   0  52  0   18340  7552 select   D     -  0:00.06 [skippy-xd]
1001 1570    1   0  52  0   14052  4528 select   D     -  0:00.00 [dbus-launch]
1001 1571    1   0  52  0   12520  3684 select   Ds    -  0:00.01 [dbus-daemon]
1001 1573    1   0  47  0   28032  8212 select   D     -  0:00.03 [at-spi-bus-launche]
1001 1574 1573   0  41  0   12416  3532 select   D     -  0:00.48 [dbus-daemon]
1001 1591    1   0  20  0   24196  8816 select   D     -  0:00.03 [at-spi2-registryd]
1001 1615    1   0  20  0   25620 15984 select   D     -  0:00.47 [xterm]
1001 1618 1615   0  52  0   16520  7700 pause    Ds    -  0:00.35 [zsh]
   0 1645 1618   0  37  0   12012  3204 wait     D     -  0:00.02 [su]
   0 1653 1645   0  52  0   16608  7732 pause    D     -  0:00.32 [zsh]
   0 1683 1653   0  52  0   13016  4220 select   D+    -  0:00.01 [tmux]
   0 1685    1   0  52  0   13932  5368 select   Ds    -  0:00.28 [tmux]
   0 1693 1685   0  52  0   16208  7440 ttyin    Ds+   -  0:00.28 [zsh]
   0 1741 1685   0  22  0   19664  8368 pause    Ds    -  0:00.57 [zsh]
   0 1745 1685   0  52  0   19680  8556 pause    Ds    -  0:00.62 [zsh]
   0 1926    1   0  20  0   11400  2748 select   Ds    -  0:00.00 [syslogd]
   0 1990    1   0  20  0   19884  8392 select   Ds    -  0:00.00 [sshd]
   0 1995    1   0  52  0   11264  2592 nanslp   Ds    -  0:00.00 [cron]
   0 2058 1745   0  20  0   12452  3628 ttyin    D+    -  0:00.09 [less]
   0 2239 1741   0  52  0   11940  3132 wait     D     -  0:00.01 [sh]
   0 2245 2239   0  52  0   12024  3168 wait     D     -  0:00.02 [login]
   0 2246 2245   0  47  0   13080  3808 ttyin    D+    -  0:00.02 [csh]
1001 2301    1   0  22  0   23144 12704 select   D     -  0:00.20 [xterm]
1001 2303 2301   0  52  0   16552  7892 pause    Ds    -  0:00.26 [zsh]
1001 2354 2303   0  31  0   17880  7896 -        R+    -  0:00.03 [ssh]
   0 2355 1990   0  23  0   20400  9016 select   Ds    -  0:00.03 [sshd]
1001 2362 2355   0  22  0   20880  9276 select   D     -  0:00.00 [sshd]
1001 2364 2362   0  34  0  178296 42712 select   Ds    -  0:00.02 [firefox]
1001 2366 1548   0  72  0   62460 34216 -        R     -  0:00.00 [tint2]
1001 2367 1548   0  72  0   62460 34216 -        R     -  0:00.00 [tint2]
1001 2368 1548   0  72  0   62460 34216 -        R     -  0:00.00 [tint2]
1001 2369 1548   0  72  0   62460 34216 -        R     -  0:00.00 [tint2]
1001 2370 2364   0  35  0  178472 41812 select   D     -  0:00.00 [firefox]

------------------------------------------------------------------------
vmstat -s

   342349 cpu context switches
    19760 device interrupts
     4473 software interrupts
   423316 traps
 97714947 system calls
       32 kernel threads created
     1910  fork() calls
      426 vfork() calls
        2 rfork() calls
        0 swap pager pageins
        0 swap pager pages paged in
        0 swap pager pageouts
        0 swap pager pages paged out
     4465 vnode pager pageins
    44704 vnode pager pages paged in
      142 vnode pager pageouts
     2107 vnode pager pages paged out
        0 page daemon wakeups
        0 pages examined by the page daemon
        0 clean page reclamation shortfalls
        0 pages reactivated by the page daemon
   115144 copy-on-write faults
       91 copy-on-write optimized faults
   206329 zero fill pages zeroed
        0 zero fill pages prezeroed
        1 intransit blocking page faults
   374454 total VM faults taken
     4075 page faults requiring I/O
        0 pages affected by kernel thread creation
   114164 pages affected by  fork()
    15991 pages affected by vfork()
      114 pages affected by rfork()
   468179 pages freed
        0 pages freed by daemon
        0 pages freed by exiting processes
        0 pages active
        0 pages inactive
        0 pages in the laundry queue
        0 pages wired down
        0 pages free
        0 bytes per page
        0 total name lookups
          cache hits (0% pos + 0% neg) system 0% per-directory
          deletions 0%, falsehits 0%, toolong 0%

------------------------------------------------------------------------
vmstat -m

         Type InUse MemUse HighUse Requests  Size(s)
      CAM DEV     7    14K       -       12  2048
      entropy     1     1K       -      109  32,4096
      CAM CCB     0     0K       -     9596  2048
     CAM path     9     1K       -       52  32
   CAM periph     6     2K       -       22  16,32,64,128,256
    acpi_perf     4     1K       -        4  256
      acpipwr     5     1K       -        5  64
CAM I/O Scheduler     2     1K       -        2  128
    CAM queue    12     4K       -       29  16,32,512
          USB    41    50K       -       46  16,32,128,512,2048,4096
       USBdev    55    16K       -      157  32,64,128,256,512
CAM dev queue     5     1K       -        5  64
       athdev     4   434K       -        4  2048,16384
        vtbuf    24  5712K       -       70  4096
           vt    11     6K       -       11  512
      ath_hal     3    35K       -        3  128,2048,32768
       DEVFS2   624    10K       -      624  16
       DEVFS3  1310   328K       -     1312  256
       DEVFS1   624   312K       -      635  512
   DEVFS_RULE    72    34K       -       72  64,512
        DEVFS    34     1K       -       35  16,128
       DEVFSP     9     1K       -      117  64
NFSD V4client     1     1K       -        1  256
 NFSD lckfile     1     1K       -        1  256
 NFSD session     1     1K       -        1  1024
    pfs_nodes   184    92K       -      184  512
         GEOM    87    16K       -      603  16,32,64,128,256,512,1024,2048,4096,8192,16384
    raid_data     0     0K       -       66  32,128,256
       isadev     7     1K       -        7  128
         cdev     5     2K       -        5  256
     filedesc    15    60K       -       53  4096
        sigio     0     0K       -        1  64
     filecaps     2     1K       -      277  16,32,64
      kdtrace   604   133K       -     5894  64,256
         kenv   112    13K       -      231  16,32,64,128,8192
       kqueue   127    33K       -     2405  64,128,256,512,2048
    proc-args    96     5K       -     1811  16,32,64,128,256
        hhook    13     4K       -       13  256
      ithread    99    17K       -       99  32,128,256
       prison    22     5K       -       22  16,32,4096
 prison_racct     2     1K       -        2  512
       KTRACE   100    13K       -      100  128
       linker   566  2284K       -      761  16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536
        lockf    35     4K       -      178  64,128
   loginclass     3     1K       -        3  64
        cache     1     1K       -        1  32
       devbuf 34421 69774K       -    34693  16,32,64,128,256,512,1024,2048,4096,8192,65536
         temp    68    36K       -    10178  16,32,64,128,256,512,1024,2048,4096,8192,16384,65536
       module   517    65K       -      518  128
     mtx_pool     2    72K       -        2  8192,65536
          osd     6     1K       -       60  16,32,64,128,256
     pmchooks     1     1K       -        1  128
          pmc     1     1K       -        1  64
         pgrp    49     7K       -      242  128
      session    41     6K       -       44  128
         proc     2    64K       -        2  32768
      subproc   228   468K       -     2498  512,4096
         cred   108    27K       -      345  256
        evdev    11    15K       -       17  256,1024,2048,4096
       plimit    34     9K       -      452  256
      uidinfo    10    10K       -       12  128,8192
       dumper     1     1K       -        1  512
       sysctl     0     0K       -       14  64
    sysctloid  6819   349K       -     6911  16,32,64,128
    sysctltmp     0     0K       -     5834  16,64,128,256,1024
     acpiintr     1     1K       -        1  64
      tidhash     1    64K       -        1  65536
      callout     5  2184K       -        5  
         umtx  1224   153K       -     1224  128
     p1003.1b     1     1K       -        1  16
         SWAP     1   132K       -        1  
          bus  1297   115K       -    14738  16,32,64,128,256,512,1024,2048,4096
       bus-sc    78  1939K       -     5471  16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536
       acpica  3134   314K       -   132255  16,32,64,128,256,512,1024,2048
      devstat     6    13K       -        6  32,4096
        epoch     4     1K       -        4  128
 eventhandler   148    13K       -      148  64,128
   gtaskqueue    34    35K       -       34  16,32,256,8192
         kobj   335  1340K       -      484  4096
      Per-cpu     1     1K       -        1  32
         rman   223    27K       -      505  32,128
         sbuf     0     0K       -      765  16,32,64,128,256,512,1024,2048,4096,8192,16384
    toponodes    12     2K       -       12  128
     acpitask     1    64K       -        1  65536
    taskqueue   165    19K       -      441  16,32,64,128,256
     terminal    11     3K       -       11  256
       Unitno    26     2K       -       42  32,64
         vmem     2   264K       -        2  8192
     ioctlops     0     0K       -     1138  256,512,1024,2048,4096
       select    79    10K       -       79  128
          iov     0     0K       -   317888  16,32,64,128,256,512,1024
          msg     4    30K       -        4  2048,4096,8192,16384
          sem     4   106K       -        4  2048,4096
          shm     1    32K       -        1  32768
          tty    17    17K       -       17  1024
          pts     5     2K       -        5  256
     mbuf_tag     0     0K       -      750  32,64,256
        shmfd     1     8K       -        1  8192
       soname    44     5K       -    41834  16,32,64,128
          pcb    32  2201K       -       53  16,32,64,128,1024,2048,8192
      acpisem    52     7K       -       52  128
     vfscache     4  4145K       -        4  256,16384,32768
     vfs_hash     1  2048K       -        1  
       vnodes     2     1K       -        2  32,256
        mount   669    24K       -     1514  16,32,64,128,256,1024
       statfs     0     0K       -     3652  4096
       kbdmux     6    22K       -        6  16,512,1024,2048,16384
  vnodemarker     0     0K       -      138  512
chacha20random     1     1K       -        1  1024
          BPF    28  2077K       -       30  16,128,512,4096
        ifnet     7    13K       -        7  128,2048
       ifaddr    97    19K       -       97  16,32,64,128,256,512,2048,4096
  ether_multi    34     3K       -       39  16,32,64,128
        clone    11     2K       -       11  128
        ipsec     3     1K       -        3  256
      lltable    25     7K       -       25  256,512
        iflib    17   112K       -       21  16,64,128,1024,4096,8192,16384,32768
     routetbl    49    12K       -       65  32,64,128,256,512
         vnet     1     1K       -        1  64
    vnet_data     1   240K       -        1  
vnet_data_free     1     1K       -        1  32
     80211vap     1     4K       -        1  4096
  80211crypto     2     1K       -        4  128,512
    80211node     2    65K       -        9  16,1024,65536
  80211nodeie    12     5K       -       21  32,128,256,512
    80211scan    12    23K       -       12  512,2048,16384
         igmp     6     1K       -        6  128
   in_mfilter     2     1K       -        2  64
     in_multi     6     2K       -        7  256
  ip_moptions     1     1K       -        1  64
encap_export_host    12     1K       -       12  32,64
    sctp_a_it     0     0K       -        4  16
     sctp_vrf     1     1K       -        1  64
     sctp_ifa     5     1K       -        5  128
     sctp_ifn     3     1K       -        3  128
    sctp_iter     0     0K       -        4  256
   tfo_ccache     1   128K       -        1  
    hostcache     1    32K       -        1  32768
          LRO     2    40K       -        2  8192,32768
      tcpfunc     1     1K       -        1  64
     syncache     1    68K       -        1  
    in6_multi    15     2K       -       15  32,256
 ip6_moptions     1     1K       -        1  32
          mld     5     1K       -        5  128
       ip6ndp     6     1K       -        6  64,256
  inpcbpolicy    21     1K       -      197  32
     secasvar     1     1K       -        1  1024
       sahead     1     1K       -        1  1024
  ipsecpolicy     2     2K       -        2  256,1024
    ipsec-saq     2     2K       -        2  1024
       crypto     6     6K       -        8  128,512,1024
          rpc     2     8K       -        2  4096
audit_evclass   230     8K       -      285  32
    ufs_quota     1  2048K       -        1  
    vm_pgdata     1     1K       -        1  128
      UMAHash    17   340K       -       23  512,1024,2048,4096,8192,16384,32768
  fpukern_ctx     4     4K       -        4  1024
      memdesc     1     4K       -        1  4096
     pci_link    16     2K       -       16  64,128
     atkbddev     2     1K       -        2  64
      acpidev    43     3K       -       43  64
      CAM SIM     5     2K       -        5  256
      CAM XPT    29     2K       -       64  16,32,64,128,512,1024,2048,65536
       apmdev     1     1K       -        1  128
   madt_table     0     0K       -        2  32,4096
         intr     4   400K       -        4  65536
      io_apic     1     2K       -        1  2048
   local_apic     1     4K       -        1  4096
          MCA    12     2K       -       12  32,128
         cpus     2     1K       -        2  16
          msi    14     2K       -       14  128
     nexusdev     6     1K       -        6  16
   kstat_data     7     1K       -        7  64
      solaris 25038 57664K       -  1208534  16,32,64,128,256,512,1024,2048,4096,8192,16384,32768
    sfs_nodes   100    50K       -      100  512
     eli data    61    16K       -     9145  64,256,512,1024,2048,4096,8192,16384,32768,65536
   aesni_data     2     1K       -        2  32,256
  tmpfs mount     1     1K       -        1  256
   tmpfs name    12     1K       -       18  16,32,64
  fdesc_mount     1     1K       -        1  16
       cpuctl     1     1K       -        1  32
        linux  2567   497K       -    14077  16,32,64,128,256,512,1024,2048,4096,8192,32768
 linuxcurrent    21     3K       -       36  64,128
          idr    94    45K       -       98  128,512
        radix    12    12K       -       29  1024
          idr     1     1K       -        1  16
   debugfsint   124     8K       -      124  64
   drm_driver     3     1K       -        3  16,32
      drm_kms     2     2K       -        2  64,1024
    acpivideo     3     1K       -        3  128
      pf_hash     5 11524K       -        5  2048
     pf_ifnet    19     6K       -       34  128,256,2048
      pf_osfp  1191   123K       -     1191  64,128
      pf_rule     8     5K       -        8  128,1024
     pf_table     5    10K       -        8  2048
  nullfs_hash     1  2048K       -        1  
  nullfs_node   129     9K       -      129  64
 nullfs_mount     1     1K       -        1  32

------------------------------------------------------------------------
vmstat -z

ITEM                   SIZE  LIMIT     USED     FREE      REQ FAIL SLEEP

UMA Kegs:               224,      0,     272,       0,     272,   0,   0
UMA Zones:              936,      0,     275,       1,     275,   0,   0
UMA Slabs:               80,      0,   42535,      15,   43062,   0,   0
UMA Hash:               256,      0,      91,      29,     108,   0,   0
4 Bucket:                32,      0,     935,    1440,   23271,   0,   0
6 Bucket:                48,      0,     138,     941,    3351,   0,   0
8 Bucket:                64,      0,      17,    1037,     802,  21,   0
12 Bucket:               96,      0,      63,     962,    4007,   0,   0
16 Bucket:              128,      0,     132,     395,    3154,   1,   0
32 Bucket:              256,      0,      89,     286,    1062,   9,   0
64 Bucket:              512,      0,     118,      66,    1130,  53,   0
128 Bucket:            1024,      0,      71,      85,    1089,   1,   0
256 Bucket:            2048,      0,     251,      41,    2055, 123,   0
vmem:                  1856,      0,       3,       1,       3,   0,   0
vmem btag:               56,      0,   21483,     456,   22101, 155,   0
VM OBJECT:              256,      0,    5749,     116,   49019,   0,   0
RADIX NODE:             144,      0,   16495,     110,  100521,   0,   0
MAP:                    240,      0,       3,      61,       3,   0,   0
KMAP ENTRY:             120,      0,      27,     501,      27,   0,   0
MAP ENTRY:              120,      0,    8605,     272,  234977,   0,   0
VMSPACE:               2560,      0,      69,      12,    2340,   0,   0
fakepg:                 104,      0,       0,     152,      17,   0,   0
64 pcpu:                  8,      0,    3045,     795,    3087,   0,   0
mt_stats_zone:           64,      0,     471,     809,     471,   0,   0
mt_zone:                 24,      0,     471,     865,     471,   0,   0
16:                      16,      0,    7286,     997,  390841,   0,   0
32:                      32,      0,   10650,     600,  136148,   0,   0
64:                      64,      0,   27960,    8744,  345996,   0,   0
128:                    128,      0,   10921,     890,  275151,   0,   0
256:                    256,      0,    6621,     219,   65577,   0,   0
512:                    512,      0,    1545,     199,  152795,   0,   0
1024:                  1024,      0,    1600,     120,   36293,   0,   0
2048:                  2048,      0,     193,      49,  400344,   0,   0
4096:                  4096,      0,    1705,       4,   17608,   0,   0
8192:                  8192,      0,      52,       6,    3507,   0,   0
16384:                16384,      0,      25,      13,    2361,   0,   0
32768:                32768,      0,      32,      14,    1007,   0,   0
65536:                65536,      0,      16,       6,     798,   0,   0
SLEEPQUEUE:              80,      0,     613,     162,     613,   0,   0
Files:                   80,      0,     461,     289,   35573,   0,   0
filedesc0:             1104,      0,     101,      43,    2371,   0,   0
rangeset pctrie nodes:    144,      0,       0,       0,       0,   0,   0
rl_entry:                40,      0,     100,    1000,     100,   0,   0
TURNSTILE:              136,      0,     613,     187,     613,   0,   0
umtx pi:                 96,      0,       0,       0,       0,   0,   0
umtx_shm:                88,      0,       0,       0,       0,   0,   0
racct:                  208,      0,     115,     208,    2387,   0,   0
rctl_rule:               80,      0,       0,       0,       0,   0,   0
rctl_rule_link:          32,      0,       0,       0,       0,   0,   0
MAC labels:              40,      0,       0,       0,       0,   0,   0
PROC:                  1328,      0,     100,      26,    2370,   0,   0
THREAD:                1488,      0,     528,      84,    1278,   0,   0
cpuset:                 104,      0,      12,     577,      16,   0,   0
domainset:               40,      0,       0,     558,       4,   0,   0
audit_record:          1280,      0,       0,       0,       0,   0,   0
mbuf_packet:            256, 6474615,     511,    1016,    5387,   0,   0
mbuf:                   256, 6474615,      53,    1474,   45498,   0,   0
mbuf_cluster:          2048, 1011658,    1518,       8,    1518,   0,   0
mbuf_jumbo_page:       4096, 505829,       0,      78,   21017,   0,   0
mbuf_jumbo_9k:         9216, 449625,       0,       0,       0,   0,   0
mbuf_jumbo_16k:       16384, 337216,       0,       0,       0,   0,   0
epoch_record pcpu:      256,      0,       4,      60,       4,   0,   0
ttyinq:                 160,      0,     300,     150,     465,   0,   0
ttyoutq:                256,      0,     158,      97,     246,   0,   0
DMAR_MAP_ENTRY:         120,      0,       0,       0,       0,   0,   0
FPU_save_area:          832,      0,       0,       0,       0,   0,   0
g_bio:                  376,      0,       0,     380,   42853,   0,   0
nvme_request:           128,      0,       0,       0,       0,   0,   0
cryptop:                128,      0,       0,       0,       0,   0,   0
cryptodesc:             120,      0,       0,       0,       0,   0,   0
crypto_session:          24,      0,       4,     330,       5,   0,   0
vtnet_tx_hdr:            24,      0,       0,       0,       0,   0,   0
taskq_zone:              48,      0,       0,    1079,    1170,   0,   0
VNODE:                  480,      0,    4223,      41,    4411,   0,   0
VNODEPOLL:              120,      0,      44,     484,      44,   0,   0
BUF TRIE:               144,      0,       0,  104760,       0,   0,   0
NAMEI:                 1024,      0,       0,      80,   80428,   0,   0
rentr:                   24,      0,       0,     835,       3,   0,   0
S VFS Cache:            108,      0,    4100,     275,    9163,   0,   0
STS VFS Cache:          148,      0,       0,       0,       0,   0,   0
L VFS Cache:            328,      0,      72,      48,      93,   0,   0
LTS VFS Cache:          368,      0,       0,       0,       0,   0,   0
NCLNODE:                592,      0,       0,       0,       0,   0,   0
DIRHASH:               1024,      0,       0,       0,       0,   0,   0
pipe:                   760,      0,      80,      65,    1517,   0,   0
Mountpoints:           2744,      0,      55,       5,      55,   0,   0
procdesc:               136,      0,       1,     144,       2,   0,   0
AIO:                    208,      0,       0,       0,       0,   0,   0
AIOP:                    32,      0,       0,       0,       0,   0,   0
AIOCB:                  752,      0,       0,       0,       0,   0,   0
AIOLIO:                 280,      0,       0,       0,       0,   0,   0
range_seg_cache:         72,      0,   55708,    9907,   78914,   0,   0
zio_cache:             1048,      0,       8,     460,  217845,   0,   0
zio_link_cache:          48,      0,       0,    1328,   68465,   0,   0
zio_buf_512:            512,      0,    4357,      51,   59359,   0,   0
zio_data_buf_512:       512,      0,     235,      85,    3522,   0,   0
zio_buf_1024:          1024,      0,      99,      33,     236,   0,   0
zio_data_buf_1024:     1024,      0,     191,      33,     209,   0,   0
zio_buf_1536:          1536,      0,      80,      20,     113,   0,   0
zio_data_buf_1536:     1536,      0,      82,      18,      87,   0,   0
zio_buf_2048:          2048,      0,     104,      22,     440,   0,   0
zio_data_buf_2048:     2048,      0,      67,      13,      84,   0,   0
zio_buf_2560:          2560,      0,      16,       8,      60,   0,   0
zio_data_buf_2560:     2560,      0,      52,       2,     182,   0,   0
zio_buf_3072:          3072,      0,       8,       7,      22,   0,   0
zio_data_buf_3072:     3072,      0,      34,       5,      38,   0,   0
zio_buf_3584:          3584,      0,      13,       0,      13,   0,   0
zio_data_buf_3584:     3584,      0,      32,       4,     129,   0,   0
zio_buf_4096:          4096,      0,    2635,      22,    5587,   0,   0
zio_data_buf_4096:     4096,      0,     198,       4,    1731,   0,   0
zio_buf_5120:          5120,      0,       0,       6,      10,   0,   0
zio_data_buf_5120:     5120,      0,       1,       7,      20,   0,   0
zio_buf_6144:          6144,      0,      13,       8,      26,   0,   0
zio_data_buf_6144:     6144,      0,       0,      13,      24,   0,   0
zio_buf_7168:          7168,      0,       0,       2,       2,   0,   0
zio_data_buf_7168:     7168,      0,       0,      14,      22,   0,   0
zio_buf_8192:          8192,      0,       0,      11,     977,   0,   0
zio_data_buf_8192:     8192,      0,       0,      62,      98,   0,   0
zio_buf_10240:        10240,      0,       0,       8,      14,   0,   0
zio_data_buf_10240:   10240,      0,       0,      14,      33,   0,   0
zio_buf_12288:        12288,      0,       1,       9,     440,   0,   0
zio_data_buf_12288:   12288,      0,       0,      16,      39,   0,   0
zio_buf_14336:        14336,      0,       0,       5,       5,   0,   0
zio_data_buf_14336:   14336,      0,       0,      16,      29,   0,   0
zio_buf_16384:        16384,      0,    1158,     105,    3098,   0,   0
zio_data_buf_16384:   16384,      0,       6,      41,     108,   0,   0
zio_buf_20480:        20480,      0,       1,       8,     170,   0,   0
zio_data_buf_20480:   20480,      0,       4,      18,      58,   0,   0
zio_buf_24576:        24576,      0,       0,       7,     265,   0,   0
zio_data_buf_24576:   24576,      0,       6,      25,      88,   0,   0
zio_buf_28672:        28672,      0,       0,       8,     166,   0,   0
zio_data_buf_28672:   28672,      0,       1,      12,      39,   0,   0
zio_buf_32768:        32768,      0,       1,       7,     177,   0,   0
zio_data_buf_32768:   32768,      0,       1,      12,      33,   0,   0
zio_buf_40960:        40960,      0,       0,       7,     318,   0,   0
zio_data_buf_40960:   40960,      0,       3,      22,      62,   0,   0
zio_buf_49152:        49152,      0,       1,       8,     421,   0,   0
zio_data_buf_49152:   49152,      0,       3,      14,      63,   0,   0
zio_buf_57344:        57344,      0,       0,       7,     215,   0,   0
zio_data_buf_57344:   57344,      0,       1,      12,      35,   0,   0
zio_buf_65536:        65536,      0,       0,       7,     355,   0,   0
zio_data_buf_65536:   65536,      0,       2,      11,      39,   0,   0
zio_buf_81920:        81920,      0,       0,      12,    1015,   0,   0
zio_data_buf_81920:   81920,      0,       3,      15,      39,   0,   0
zio_buf_98304:        98304,      0,       0,       8,    1004,   0,   0
zio_data_buf_98304:   98304,      0,       3,      10,      29,   0,   0
zio_buf_114688:      114688,      0,       0,       7,      97,   0,   0
zio_data_buf_114688: 114688,      0,       2,      12,      26,   0,   0
zio_buf_131072:      131072,      0,     471,      58,    1372,   0,   0
zio_data_buf_131072: 131072,      0,     359,     300,    1896,   0,   0
zio_buf_163840:      163840,      0,       0,       0,       0,   0,   0
zio_data_buf_163840: 163840,      0,       0,       0,       0,   0,   0
zio_buf_196608:      196608,      0,       0,       0,       0,   0,   0
zio_data_buf_196608: 196608,      0,       0,       0,       0,   0,   0
zio_buf_229376:      229376,      0,       0,       0,       0,   0,   0
zio_data_buf_229376: 229376,      0,       0,       0,       0,   0,   0
zio_buf_262144:      262144,      0,       0,       0,       0,   0,   0
zio_data_buf_262144: 262144,      0,       0,       0,       0,   0,   0
zio_buf_327680:      327680,      0,       0,       0,       0,   0,   0
zio_data_buf_327680: 327680,      0,       0,       0,       0,   0,   0
zio_buf_393216:      393216,      0,       0,       0,       0,   0,   0
zio_data_buf_393216: 393216,      0,       0,       0,       0,   0,   0
zio_buf_458752:      458752,      0,       0,       0,       0,   0,   0
zio_data_buf_458752: 458752,      0,       0,       0,       0,   0,   0
zio_buf_524288:      524288,      0,       0,       0,       0,   0,   0
zio_data_buf_524288: 524288,      0,       0,       0,       0,   0,   0
zio_buf_655360:      655360,      0,       0,       0,       0,   0,   0
zio_data_buf_655360: 655360,      0,       0,       0,       0,   0,   0
zio_buf_786432:      786432,      0,       0,       0,       0,   0,   0
zio_data_buf_786432: 786432,      0,       0,       0,       0,   0,   0
zio_buf_917504:      917504,      0,       0,       0,       0,   0,   0
zio_data_buf_917504: 917504,      0,       0,       0,       0,   0,   0
zio_buf_1048576:     1048576,      0,       0,       0,       0,   0,   0
zio_data_buf_1048576: 1048576,      0,       0,       0,       0,   0,   0
zio_buf_1310720:     1310720,      0,       0,       0,       0,   0,   0
zio_data_buf_1310720: 1310720,      0,       0,       0,       0,   0,   0
zio_buf_1572864:     1572864,      0,       0,       0,       0,   0,   0
zio_data_buf_1572864: 1572864,      0,       0,       0,       0,   0,   0
zio_buf_1835008:     1835008,      0,       0,       0,       0,   0,   0
zio_data_buf_1835008: 1835008,      0,       0,       0,       0,   0,   0
zio_buf_2097152:     2097152,      0,       0,       0,       0,   0,   0
zio_data_buf_2097152: 2097152,      0,       0,       0,       0,   0,   0
zio_buf_2621440:     2621440,      0,       0,       0,       0,   0,   0
zio_data_buf_2621440: 2621440,      0,       0,       0,       0,   0,   0
zio_buf_3145728:     3145728,      0,       0,       0,       0,   0,   0
zio_data_buf_3145728: 3145728,      0,       0,       0,       0,   0,   0
zio_buf_3670016:     3670016,      0,       0,       0,       0,   0,   0
zio_data_buf_3670016: 3670016,      0,       0,       0,       0,   0,   0
zio_buf_4194304:     4194304,      0,       0,       0,       0,   0,   0
zio_data_buf_4194304: 4194304,      0,       0,       0,       0,   0,   0
zio_buf_5242880:     5242880,      0,       0,       0,       0,   0,   0
zio_data_buf_5242880: 5242880,      0,       0,       0,       0,   0,   0
zio_buf_6291456:     6291456,      0,       0,       0,       0,   0,   0
zio_data_buf_6291456: 6291456,      0,       0,       0,       0,   0,   0
zio_buf_7340032:     7340032,      0,       0,       0,       0,   0,   0
zio_data_buf_7340032: 7340032,      0,       0,       0,       0,   0,   0
zio_buf_8388608:     8388608,      0,       0,       0,       0,   0,   0
zio_data_buf_8388608: 8388608,      0,       0,       0,       0,   0,   0
zio_buf_10485760:    10485760,      0,       0,       0,       0,   0,   0
zio_data_buf_10485760: 10485760,      0,       0,       0,       0,   0,   0
zio_buf_12582912:    12582912,      0,       0,       0,       0,   0,   0
zio_data_buf_12582912: 12582912,      0,       0,       0,       0,   0,   0
zio_buf_14680064:    14680064,      0,       0,       0,       0,   0,   0
zio_data_buf_14680064: 14680064,      0,       0,       0,       0,   0,   0
zio_buf_16777216:    16777216,      0,       0,       0,       0,   0,   0
zio_data_buf_16777216: 16777216,      0,       0,       0,       0,   0,   0
lz4_ctx:              16384,      0,       0,       7,    2328,   0,   0
abd_chunk:             4096,      0,   32189,      17,   40492,   0,   0
sa_cache:               144,      0,    3936,     168,    4238,   0,   0
dnode_t:                728,      0,    5008,      27,    6997,   0,   0
arc_buf_hdr_t_full:     256,      0,    6317,      88,   36029,   0,   0
arc_buf_hdr_t_l2only:     96,      0,       0,       0,       0,   0,   0
arc_buf_t:               64,      0,    2119,    1973,   36557,   0,   0
dmu_buf_impl_t:         240,      0,    6361,    1271,   39963,   0,   0
zil_lwb_cache:          320,      0,       3,     117,      93,   0,   0
zil_zcw_cache:           80,      0,       0,     500,     154,   0,   0
sio_cache:              128,      0,       0,       0,       0,   0,   0
zfs_znode_cache:        272,      0,    3936,      68,    4118,   0,   0
ksiginfo:               112,      0,     110,     940,     411,   0,   0
itimer:                 352,      0,       0,       0,       0,   0,   0
KNOTE:                  160,      0,      57,     193,    1516,   0,   0
socket:                 872, 520476,     118,      38,    6837,   0,   0
unpcb:                  256, 520485,      96,     159,    6624,   0,   0
IPsec SA lft_c:          16,      0,       0,       0,       0,   0,   0
ipq:                     56,  31666,       0,       0,       0,   0,   0
udp_inpcb:              488, 520480,       5,     115,     181,   0,   0
udpcb:                   32, 520500,       5,    1120,     181,   0,   0
tcp_inpcb:              488, 520480,      14,     106,      14,   0,   0
tcpcb:                  976, 520476,      12,      40,      14,   0,   0
tcptw:                   88,  27810,       2,     268,       2,   0,   0
syncache:               168,  15364,       0,     184,       3,   0,   0
hostcache:               96,  15375,       0,       0,       0,   0,   0
sackhole:                32,      0,       0,       0,       0,   0,   0
tfo:                      4,      0,       0,       0,       0,   0,   0
tfo_ccache_entries:      80,      0,       0,       0,       0,   0,   0
tcpreass:                48,  63246,       0,       0,       0,   0,   0
tcp_log:                400, 1000000,       0,       0,       0,   0,   0
tcp_log_bucket:         144,      0,       0,       0,       0,   0,   0
tcp_log_node:           120,      0,       0,       0,       0,   0,   0
sctp_ep:               1280, 520476,       0,       0,       0,   0,   0
sctp_asoc:             2408,  40000,       0,       0,       0,   0,   0
sctp_laddr:              48,  80012,       0,     581,       4,   0,   0
sctp_raddr:             736,  80000,       0,       0,       0,   0,   0
sctp_chunk:             152, 400010,       0,       0,       0,   0,   0
sctp_readq:             152, 400010,       0,       0,       0,   0,   0
sctp_stream_msg_out:    112, 400015,       0,       0,       0,   0,   0
sctp_asconf:             40, 400000,       0,       0,       0,   0,   0
sctp_asconf_ack:         48, 400060,       0,       0,       0,   0,   0
udplite_inpcb:          488, 520480,       0,       0,       0,   0,   0
ripcb:                  488, 520480,       2,      62,       2,   0,   0
rtentry:                208,      0,      14,     233,      17,   0,   0
selfd:                   64,      0,     236,    1314, 5237661,   0,   0
swpctrie:               144, 2023353,       0,       0,       0,   0,   0
swblk:                  136, 2023330,       0,       0,       0,   0,   0
TMPFS dirent:            64,      0,      12,    1042,      18,   0,   0
TMPFS node:             232,      0,      13,     242,      18,   0,   0
fuse_ticket:            232,      0,       0,       0,       0,   0,   0
drm_sched_fence:        336,      0,       0,       0,       0,   0,   0
drm_i915_gem_object:    776,      0,     116,      68,     389,   0,   0
i915_vma:               648,      0,     107,      63,     366,   0,   0
i915_lut_handle:         48,      0,      91,     988,     222,   0,   0
drm_i915_gem_request:    696,      0,       0,      80,    1324,   0,   0
i915_dependency:         64,      0,       0,       0,       0,   0,   0
i915_priolist:           48,      0,       0,       0,       0,   0,   0
pf mtags:                48,      0,       0,       0,       0,   0,   0
pf tags:                104,      0,       0,       0,       0,   0,   0
pf states:              296, 100009,       0,       0,       0,   0,   0
pf state keys:           88,      0,       0,       0,       0,   0,   0
pf source nodes:        136,  10005,       0,       0,       0,   0,   0
pf table entries:       216, 200016,       2,     124,       2,   0,   0
pf frags:               112,      0,       0,       0,       0,   0,   0
pf frag entries:         40,   5000,       0,       0,       0,   0,   0
pf state scrubs:         40,      0,       0,       0,       0,   0,   0
bridge_rtnode:           64,      0,       1,     309,       1,   0,   0


------------------------------------------------------------------------
vmstat -i

interrupt                          total       rate
irq1: atkbd0                         336          8
irq9: acpi0                         1550         35
irq12: psm0                         6624        151
irq17: ath0                         1001         23
irq19: ehci1                         194          4
irq21: ehci0                         172          4
cpu0:timer                         42294        966
cpu1:timer                         39815        910
cpu2:timer                         39953        913
cpu3:timer                         38624        882
irq266: sdhci_pci0                    13          0
irq267: ahci0                       9481        217
irq269: vgapci0                      389          9
Total                             180446       4123

------------------------------------------------------------------------
pstat -T

461/520474 files
0M/0M swap space

------------------------------------------------------------------------
dmesg

---<<BOOT>>---
Copyright (c) 1992-2019 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 12.1-RELEASE-p6 118b3d5f0a4(my12.1) MYKERNEL amd64
FreeBSD clang version 8.0.1 (tags/RELEASE_801/final 366581) (based on LLVM 8.0.1)
VT(vga): resolution 640x480
CPU: Intel(R) Core(TM) i7-3520M CPU @ 2.90GHz (2893.50-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x306a9  Family=0x6  Model=0x3a  Stepping=9
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x7fbae3ff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x1<LAHF>
  Structured Extended Features=0x281<FSGSBASE,SMEP,ERMS>
  Structured Extended Features3=0x9c000000<IBPB,STIBP,L1DFL,SSBD>
  XSAVE Features=0x1<XSAVEOPT>
  VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID
  TSC: P-state invariant, performance statistics
real memory  = 17179869184 (16384 MB)
avail memory = 16509857792 (15745 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <COREv4 COREBOOT>
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 2 core(s) x 2 hardware threads
random: unblocking device.
ioapic0 <Version 2.0> irqs 0-23 on motherboard
Launching APs: 1 2 3
Timecounter "TSC-low" frequency 1446747988 Hz quality 1000
random: entropy device external interface
module_register_init: MOD_LOAD (vesa, 0xffffffff8109f0f0, 0) error 19
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
kbd1 at kbdmux0
000.000042 [4335] netmap_init               netmap: loaded module
[ath_hal] loaded
nexus0
vtvga0: <VT VGA driver> on motherboard
cryptosoft0: <software crypto> on motherboard
aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS> on motherboard
acpi0: <COREv4 COREBOOT> on motherboard
acpi0: Power Button (fixed)
ACPI Error: No handler for Region [ERAM] (0xfffff80003936a00) [EmbeddedControl] (20181213/evregion-288)
ACPI Error: Region EmbeddedControl (ID=3) has no handler (20181213/exfldio-428)
ACPI Error: Method parse/execution failed \134_SB.PCI0.LPCB.EC.BAT0._STA, AE_NOT_EXIST (20181213/psparse-689)
ACPI Error: No handler for Region [ERAM] (0xfffff80003936a00) [EmbeddedControl] (20181213/evregion-288)
ACPI Error: Region EmbeddedControl (ID=3) has no handler (20181213/exfldio-428)
ACPI Error: Method parse/execution failed \134_SB.PCI0.LPCB.EC.BAT1._STA, AE_NOT_EXIST (20181213/psparse-689)
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 550
Event timer "HPET1" frequency 14318180 Hz quality 440
Event timer "HPET2" frequency 14318180 Hz quality 440
Event timer "HPET3" frequency 14318180 Hz quality 440
Event timer "HPET4" frequency 14318180 Hz quality 440
cpu0: <ACPI CPU> on acpi0
atrtc0: <AT realtime clock> port 0x70-0x77 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x508-0x50b on acpi0
acpi_ec0: <Embedded Controller: GPE 0x11> port 0x62,0x66 on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
vgapci0: <VGA-compatible display> port 0x3000-0x303f mem 0xe1400000-0xe17fffff,0xd0000000-0xdfffffff irq 16 at device 2.0 on pci0
vgapci0: Boot video device
pci0: <serial bus, USB> at device 20.0 (no driver attached)
em0: <Intel(R) PRO/1000 Network Connection> port 0x3040-0x305f mem 0xe1900000-0xe191ffff,0xe193c000-0xe193cfff at device 25.0 on pci0
em0: Using 1024 TX descriptors and 1024 RX descriptors
em0: Using an MSI interrupt
em0: Ethernet address: 3c:97:0e:b7:35:ea
em0: netmap queues/slots: TX 1/1024, RX 1/1024
pci0: <serial bus, USB> at device 26.0 (no driver attached)
pci0: <multimedia, HDA> at device 27.0 (no driver attached)
pcib1: <ACPI PCI-PCI bridge> irq 21 at device 28.0 on pci0
pci1: <ACPI PCI bus> on pcib1
ath0: <Atheros 9285> mem 0xe1800000-0xe180ffff irq 17 at device 0.0 on pci1
[ath] AR9285 Main LNA config: LNA2
[ath] AR9285 Alt LNA config: LNA1
[ath] LNA diversity enabled, Diversity enabled
[ath] Enabling diversity for Kite
ath0: [HT] enabling HT modes
ath0: [HT] 1 stream STBC receive enabled
ath0: [HT] 1 RX streams; 1 TX streams
ath0: AR9285 mac 192.2 RF5133 phy 14.0
ath0: 2GHz radio: 0x0000; 5GHz radio: 0x00c0
pcib2: <ACPI PCI-PCI bridge> irq 19 at device 28.1 on pci0
pcib2: [GIANT-LOCKED]
pci2: <ACPI PCI bus> on pcib2
sdhci_pci0: <RICOH R5CE822 SD> mem 0xe0800000-0xe08000ff irq 18 at device 0.0 on pci2
sdhci_pci0: 1 slot(s) allocated
mmc0: <MMC/SD bus> on sdhci_pci0
pci0: <serial bus, USB> at device 29.0 (no driver attached)
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
ahci0: <Intel Panther Point AHCI SATA controller> port 0x3080-0x3087,0x3090-0x3093,0x3088-0x308f,0x3094-0x3097,0x3060-0x307f mem 0xe193e000-0xe193e7ff irq 17 at device 31.2 on pci0
ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich4: <AHCI channel> at channel 4 on ahci0
acpi_tz0: <Thermal Zone> on acpi0
acpi_tz1: <Thermal Zone> on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: model Synaptics Touchpad, device ID 0
acpi_acad0: <AC Adapter> on acpi0
battery0: <ACPI Control Method Battery> on acpi0
battery1: <ACPI Control Method Battery> on acpi0
acpi_button0: <Sleep Button> on acpi0
acpi_lid0: <Control Method Lid Switch> on acpi0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xcffff,0xeb800-0xeffff pnpid ORM0000 on isa0
est0: <Enhanced SpeedStep Frequency Control> on cpu0
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
usb_needs_explore_all: no devclass
mmc0: No compatible cards found on bus
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <KINGSTON SUV400S37240G 0C3FD6SD> ACS-4 ATA SATA 3.x device
ada0: Serial Number 50026B776702BB50
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 228936MB (468862128 512 byte sectors)
ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
ada1: <WDC WD10JPVX-08JC3T5 05.01A05> ACS-2 ATA SATA 3.x device
ada1: Serial Number WD-WX51AA4REHPP
ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 953869MB (1953525168 512 byte sectors)
Trying to mount root from zfs:innovator/ROOT/12.1-custom-kernel []...
GEOM_ELI: Device ada0p3.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
Setting hostuuid: bdfd9401-52bd-11cb-b4e4-a1cb71b96b24.
Setting hostid: 0x3f4a7db4.
Starting file system checks:
Mounting local filesystems:.
ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/e2fsprogs /usr/local/lib/gcc9 /usr/local/lib/mysql /usr/local/lib/opencollada /usr/local/lib/perl5/5.30/mach/CORE /usr/local/lib/qt5 /usr/local/lib/vtk-8.2 /usr/local/llvm80/lib /usr/local/llvm90/lib /usr/local/mpi/openmpi/lib /usr/local/mpi/openmpi/lib/openmpi
32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32 /usr/local/lib32/wine
Loading kernel modules:
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
xhci0: <Intel Panther Point USB 3.0 controller> mem 0xe1920000-0xe192ffff irq 16 at device 20.0 on pci0
xhci0: 32 bytes context size, 64-bit DMA
xhci0: Port routing mask set to 0xffffffff
usbus0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
ugen0.1: <0x8086 XHCI root HUB> at usbus0
uhub0: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
ehci0: <Intel Panther Point USB 2.0 controller> mem 0xe193f000-0xe193f3ff irq 21 at device 26.0 on pci0
usbus1: EHCI version 1.0
usbus1 on ehci0
usbus1: 480Mbps High Speed USB v2.0
ehci1: <Intel Panther Point USB 2.0 controller> mem 0xe1940000-0xe19403ff irq 19 at device 29.0 on pci0
usbus2: EHCI version 1.0
ugen1.1: <Intel EHCI root HUB> at usbus1
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
usbus2 on ehci1
usbus2: 480Mbps High Speed USB v2.0
ugen2.1: <Intel EHCI root HUB> at usbus2
uhub2: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus2
uhub0: 8 ports with 8 removable, self powered
drmn0: <drmn> on vgapci0
vgapci0: child drmn0 requested pci_enable_io
vgapci0: child drmn0 requested pci_enable_io
[drm] Unable to create a private tmpfs mount, hugepage support will be disabled(-19).
Successfully added WC MTRR for [0xd0000000-0xdfffffff]: 0; 
[drm] Got stolen memory base 0x80a00000, size 0x2000000
[drm] Supports vblank timestamp caching Rev 2 (21.10.2013).
[drm] Driver supports precise vblank timestamp query.
[drm] Connector LVDS-1: get mode from tunables:
[drm]   - kern.vt.fb.modes.LVDS-1
[drm]   - kern.vt.fb.default_mode
[drm] Connector VGA-1: get mode from tunables:
[drm]   - kern.vt.fb.modes.VGA-1
[drm]   - kern.vt.fb.default_mode
[drm] Connector HDMI-A-1: get mode from tunables:
[drm]   - kern.vt.fb.modes.HDMI-A-1
[drm]   - kern.vt.fb.default_mode
[drm] Connector DP-1: get mode from tunables:
[drm]   - kern.vt.fb.modes.DP-1
[drm]   - kern.vt.fb.default_mode
[drm] Connector HDMI-A-2: get mode from tunables:
[drm]   - kern.vt.fb.modes.HDMI-A-2
[drm]   - kern.vt.fb.default_mode
[drm] Connector HDMI-A-3: get mode from tunables:
[drm]   - kern.vt.fb.modes.HDMI-A-3
[drm]   - kern.vt.fb.default_mode
[drm] Connector DP-2: get mode from tunables:
[drm]   - kern.vt.fb.modes.DP-2
[drm]   - kern.vt.fb.default_mode
[drm] Connector DP-3: get mode from tunables:
[drm]   - kern.vt.fb.modes.DP-3
[drm]   - kern.vt.fb.default_mode
[drm] Initialized i915 1.6.0 20171222 for drmn0 on minor 0
acpi_video0: <ACPI video extension> on vgapci0
acpi_ibm0: <IBM ThinkPad ACPI Extras> on acpi0
acpi_ibm0: Firmware version is 0x100
uhub1: 3 ports with 3 removable, self powered
Setting hostname: innovator.
VT: Replacing driver "vga" with new "fb".
start FB_INFO:
type=11 height=1080 width=1920 depth=32
cmsize=16 size=8294400
pbase=0xd0061000 vbase=0xfffff800d0061000
name=drmn0 flags=0x0 stride=7680 bpp=32
cmap[0]=0 cmap[1]=7f0000 cmap[2]=7f00 cmap[3]=c4a000
end FB_INFO
drmn0: fb0: inteldrmfb frame buffer device
uhub2: 3 ports with 3 removable, self powered
Setting up harvesting: PURE_RDRAND,[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED
Feeding entropy: 
ugen1.2: <vendor 0x8087 product 0x0024> at usbus1
uhub3 on uhub1
uhub3: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus1
ugen2.2: <vendor 0x8087 product 0x0024> at usbus2
uhub4 on uhub2
uhub4: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus2
.
wlan0: Ethernet address: 1c:4b:d6:78:c2:00
Created wlan(4) interfaces: wlan0.
Created clone interfaces: lo1.
lo1: changing name to 'bastille0'
bastille0
lo0: link state changed to UP
Starting wpa_supplicant.
uhub3: 6 ports with 6 removable, self powered
uhub4: 8 ports with 8 removable, self powered
ugen1.3: <Auth Biometric Coprocessor> at usbus1
wlan0: link state changed to UP
Starting Network: lo0 em0 wlan0 bastille0.
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
	options=680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
	inet6 ::1 prefixlen 128
	inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2
	inet 127.0.0.1 netmask 0xff000000
	groups: lo
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
em0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=81249b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LRO,WOL_MAGIC,VLAN_HWFILTER>
	ether 3c:97:0e:b7:35:ea
	media: Ethernet autoselect
	status: no carrier
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
wlan0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
	ether 1c:4b:d6:78:c2:00
	groups: wlan
	ssid WLAN channel 1 (2412 MHz 11g) bssid 11:22:33:44:55:66
	regdomain 96 indoor ecm authmode WPA privacy ON deftxkey UNDEF
	powersavemode CAM powersavesleep 100 txpower 20 bmiss 7 scanvalid 60
	protmode CTS wme burst roaming MANUAL
	media: IEEE 802.11 Wireless Ethernet DS/1Mbps mode 11g
	status: associated
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
bastille0: flags=8008<LOOPBACK,MULTICAST> metric 0 mtu 16384
	options=680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
	groups: lo
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
Starting devd.
Starting Network: em0.
em0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=81249b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LRO,WOL_MAGIC,VLAN_HWFILTER>
	ether 3c:97:0e:b7:35:ea
	media: Ethernet autoselect
	status: no carrier
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
ld-elf.so.1: Shared object "%%LIBCUSE%%" not found
ld-elf.so.1: Shared object "%%LIBCUSE%%" not found
ld-elf.so.1: Shared object "%%LIBCUSE%%" not found
ld-elf.so.1: Shared object "%%LIBCUSE%%" not found
ld-elf.so.1: Shared object "%%LIBCUSE%%" not found
ld-elf.so.1: Shared object "%%LIBCUSE%%" not found
Starting dhclient.
DHCPREQUEST on wlan0 to 255.255.255.255 port 67
wlan0: link state changed to DOWN
wlan0 link state up -> down
wlan0: link state changed to UP
DHCPREQUEST on wlan0 to 255.255.255.255 port 67
wlan0 link state down -> up
DHCPREQUEST on wlan0 to 255.255.255.255 port 67
DHCPACK from 192.168.11.1
bound to 192.168.11.3 -- renewal in 21600 seconds.
Starting pflog.
pflog0: promiscuous mode enabled
2020-06-15T08:46:52.777213+02:00 innovator pflogd 911 - - [priv]: msg PRIV_OPEN_LOG received
Enabling pf.
add host 127.0.0.1: gateway lo0 fib 0: route already in table
Additional inet routing options: gateway=YES.
add host ::1: gateway lo0 fib 0: route already in table
add net fe80::: gateway ::1
add net ff02::: gateway ::1
add net ::ffff:0.0.0.0: gateway ::1
add net ::0.0.0.0: gateway ::1
Creating and/or trimming log files.
Starting syslogd.
Jun 15 08:46:53 innovator kernel: Successfully added WC MTRR for [0xd0000000-0xdfffffff]: 0; 
No core dumps found.
mkdir: /mnt/vm/.iso: File exists
bridge0: Ethernet address: 02:3f:4a:7d:b4:00
bridge0: changing name to 'vm-public'
wlan0: promiscuous mode enabled
vm-public: link state changed to UP
Clearing /tmp.
Updating motd:.
Mounting late filesystems:.
mkdir: /mnt/vm/.iso: File exists
Starting dhcpd.
Listening on vm-public (192.168.4.1).
Can't listen on wlan0 - dhcpd.conf has no subnet declaration for 192.168.11.3.
Starting powerdxx.
Starting dbus.
Starting hald.
Starting slim.
/usr/local/bin/openbox-gnome-session - GNOME/Openbox
/usr/local/bin/openbox-session - Openbox
/usr/local/bin/openbox-kde-session - KDE/Openbox
/usr/local/bin/openbox-gnome-session - GNOME/Openbox
/usr/local/bin/openbox-session - Openbox
/usr/local/bin/openbox-kde-session - KDE/Openbox
Performing sanity check on sshd configuration.
Starting sshd.
Starting avahi-daemon.
Starting cupsd.
Configuring vt: blanktime.
Starting cron.
Starting background file system checks in 60 seconds.




Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address	= 0x538
fault code		= supervisor read data, page not present
instruction pointer	= 0x20:0xffffffff8300210f
stack pointer	        = 0x28:0xfffffe00933e1620
frame pointer	        = 0x28:0xfffffe00933e1650
code segment		= base 0x0, limit 0xfffff, type 0x1b
			= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags	= interrupt enabled, resume, IOPL = 0
current process		= 2354 (ssh)
trap number		= 12
WARNING !drm_modeset_is_locked(&crtc->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:577
WARNING !drm_modeset_is_locked(&crtc->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:577
WARNING !drm_modeset_is_locked(&crtc->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:577
WARNING !drm_modeset_is_locked(&dev->mode_config.connection_mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:622
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:821
WARNING !drm_modeset_is_locked(&plane->mutex) failed at /wrkdirs/usr/ports/graphics/drm-fbsd12.0-kmod/work/kms-drm-99da0ba/drivers/gpu/drm/drm_atomic_helper.c:821
WARN_ON(!mutex_is_locked(&dev->struct_mutex))
                             
WARN_ON(!mutex_is_locked(&fbc->lock))WARN_ON(!mutex_is_locked(&fbc->lock))WARN_ON(!mutex_is_locked(&fbc->lock))
panic: page fault
cpuid = 0
time = 1592203676
KDB: stack backtrace:
#0 0xffffffff80b8d497 at kdb_backtrace+0x67
#1 0xffffffff80b407cd at vpanic+0x19d
#2 0xffffffff80b40623 at panic+0x43
#3 0xffffffff81018dcc at trap_fatal+0x39c
#4 0xffffffff81018e19 at trap_pfault+0x49
#5 0xffffffff8101840f at trap+0x29f
#6 0xffffffff80ff1d8c at calltrap+0x8
#7 0xffffffff80ae81ea at _fdrop+0x1a
#8 0xffffffff80aeb311 at closef+0x241
#9 0xffffffff80be281a at unp_freerights+0x13a
#10 0xffffffff80be1a51 at unp_externalize+0x211
#11 0xffffffff80bd999c at soreceive_generic+0x66c
#12 0xffffffff80bdb3d4 at soreceive+0x44
#13 0xffffffff80baa9d5 at dofileread+0x95
#14 0xffffffff80baa551 at sys_read+0xc1
#15 0xffffffff81019984 at amd64_syscall+0x364
#16 0xffffffff80ff26b0 at fast_syscall_common+0x101
Uptime: 1m20s
Dumping 921 out of 16264 MB:..2%..11%..21%..32%..42%..51%..61%..72%..82%..91%

------------------------------------------------------------------------
kernel config

options	CONFIG_AUTOGENERATED
ident	MYKERNEL
machine	amd64
cpu	HAMMER
makeoptions	WITH_CTF=1
makeoptions	DEBUG=-g
options	EVDEV_SUPPORT
options	XENHVM
options	USB_DEBUG
options	ATH_ENABLE_11N
options	AH_AR5416_INTERRUPT_MITIGATION
options	AH_SUPPORT_AR5416
options	IEEE80211_SUPPORT_MESH
options	IEEE80211_AMPDU_AGE
options	IEEE80211_DEBUG
options	SC_PIXEL_MODE
options	VESA
options	PCI_IOV
options	PCI_HP
options	ACPI_DMAR
options	EARLY_AP_STARTUP
options	SMP
options	NETDUMP
options	ZSTDIO
options	GZIO
options	EKCD
options	KDB_TRACE
options	KDB
options	RCTL
options	RACCT_DEFAULT_TO_DISABLED
options	RACCT
options	INCLUDE_CONFIG_FILE
options	DDB_CTF
options	KDTRACE_HOOKS
options	KDTRACE_FRAME
options	MAC
options	CAPABILITIES
options	CAPABILITY_MODE
options	AUDIT
options	HWPMC_HOOKS
options	KBD_INSTALL_CDEV
options	PRINTF_BUFR_SIZE=128
options	_KPOSIX_PRIORITY_SCHEDULING
options	SYSVSEM
options	SYSVMSG
options	SYSVSHM
options	STACK
options	KTRACE
options	SCSI_DELAY=5000
options	COMPAT_FREEBSD11
options	COMPAT_FREEBSD10
options	COMPAT_FREEBSD9
options	COMPAT_FREEBSD7
options	COMPAT_FREEBSD6
options	COMPAT_FREEBSD5
options	COMPAT_FREEBSD4
options	COMPAT_FREEBSD32
options	EFIRT
options	GEOM_LABEL
options	GEOM_RAID
options	PSEUDOFS
options	PROCFS
options	CD9660
options	MSDOSFS
options	NFS_ROOT
options	NFSLOCKD
options	NFSD
options	NFSCL
options	MD_ROOT
options	QUOTA
options	UFS_GJOURNAL
options	UFS_DIRHASH
options	UFS_ACL
options	SOFTUPDATES
options	FFS
options	SCTP
options	TCP_RFC7413
options	TCP_HHOOK
options	TCP_BLACKBOX
options	TCP_OFFLOAD
options	IPSEC_SUPPORT
options	IPSEC
options	INET6
options	INET
options	VIMAGE
options	PREEMPTION
options	NUMA
options	SCHED_ULE
options	NEW_PCIB
options	GEOM_PART_GPT
options	GEOM_PART_MBR
options	GEOM_PART_EBR_COMPAT
options	GEOM_PART_EBR
options	GEOM_PART_BSD
device	isa
device	mem
device	io
device	uart_ns8250
device	cpufreq
device	acpi
device	pci
device	fdc
device	ahci
device	ata
device	mvs
device	siis
device	ahc
device	ahd
device	esp
device	hptiop
device	isp
device	mpt
device	mps
device	mpr
device	sym
device	trm
device	isci
device	ocs_fc
device	scbus
device	ch
device	da
device	sa
device	cd
device	pass
device	ses
device	amr
device	arcmsr
device	ciss
device	dpt
device	hptmv
device	hptnr
device	hptrr
device	hpt27xx
device	iir
device	ips
device	mly
device	twa
device	smartpqi
device	tws
device	aac
device	aacp
device	aacraid
device	ida
device	mfi
device	mlx
device	mrsas
device	pmspcv
device	twe
device	nvme
device	nvd
device	atkbdc
device	atkbd
device	psm
device	kbdmux
device	vga
device	splash
device	sc
device	vt
device	vt_vga
device	vt_efifb
device	agp
device	cbb
device	pccard
device	cardbus
device	uart
device	ppc
device	ppbus
device	lpt
device	ppi
device	puc
device	iflib
device	em
device	ix
device	ixv
device	ixl
device	iavf
device	vmx
device	bxe
device	de
device	le
device	ti
device	txp
device	vx
device	miibus
device	ae
device	age
device	alc
device	ale
device	bce
device	bfe
device	bge
device	cas
device	dc
device	et
device	fxp
device	gem
device	hme
device	jme
device	lge
device	msk
device	nfe
device	nge
device	pcn
device	re
device	rl
device	sf
device	sge
device	sis
device	sk
device	ste
device	stge
device	tl
device	tx
device	vge
device	vr
device	wb
device	xl
device	wlan
device	wlan_wep
device	wlan_ccmp
device	wlan_tkip
device	wlan_amrr
device	an
device	ath
device	ath_pci
device	ath_hal
device	ath_rate_sample
device	ipw
device	iwi
device	iwn
device	malo
device	mwl
device	ral
device	wi
device	wpi
device	crypto
device	loop
device	random
device	padlock_rng
device	rdrand_rng
device	ether
device	vlan
device	tun
device	md
device	gif
device	firmware
device	bpf
device	usb
device	ukbd
device	umass
device	mmc
device	mmcsd
device	sdhci
device	virtio
device	virtio_pci
device	vtnet
device	virtio_blk
device	virtio_scsi
device	virtio_balloon
device	hyperv
device	xenpci
device	netmap
device	evdev
device	uinput

------------------------------------------------------------------------
ddb capture buffer

ddb: ddb_capture: kvm_nlist
`

[markjdb]

This is a known bug fixed by r356760 and in stable/12. I am working on getting an EN patch released for this, so 12.1 will get updated.

[thefallenidealist]

This is a known bug fixed by r356760 and in stable/12. I am working on getting an EN patch released for this, so 12.1 will get updated.

Importing commit from PR242913 (git hash in -CURRENT: 46085d4187d07e17855920adaea1da443859bd33) solved problem for me :)
Thank you!

[markjdb]

Importing commit from PR242913 (git hash in -CURRENT: 46085d4187d07e17855920adaea1da443859bd33) solved problem for me :)

Great, thanks. I submitted an EN request for a patch for 12.1 several days ago, so I will close this issue. I believe the patch will become available in the next couple of weeks; in the meantime, as you note it is possible to cherry-pick the commit in question.

[outpaddling]

Awesome, thanks!