Andriy Gapon aed3e94d2f 3821 Race in rollback, zil close, and zil flush ... illumos/illumos-gate@43297f973a 43297f973a https://www.illumos.org/issues/3821 We recently had nodes with some of the latest zfs bits panic on us in a rollback-heavy environment. The following is from my preliminary analysis: Let's look at where we died: > $C ffffff01ea6b9a10 taskq_dispatch+0x3a(0, fffffffff7d20450, ffffff5551dea920, 1) ffffff01ea6b9a60 zil_clean+0xce(ffffff4b7106c080, 7e0f1) ffffff01ea6b9aa0 dsl_pool_sync_done+0x47(ffffff4313065680, 7e0f1) ffffff01ea6b9b70 spa_sync+0x55f(ffffff4310c1d040, 7e0f1) ffffff01ea6b9c20 txg_sync_thread+0x20f(ffffff4313065680) ffffff01ea6b9c30 thread_start+8() If we dig in we can find that this dataset corresponds to a zone: > ffffff4b7106c080::print zilog_t zl_os->os_dsl_dataset->ds_dir->dd_myname zl_os->os_dsl_dataset->ds_dir->dd_myname = [ "8ffce16a-13c2-4efa-a233- 9e378e89877b" ] Okay so we have a null taskq pointer. That only happens during the calls to zil_open and zil_close. If we poke around we can see that we're actually in midst of a rollback: > ::pgrep zfs | ::printf "0x%x %s\\n" proc_t . p_user.u_psargs 0xffffff43262800a0 zfs rollback zones/15714eb6-f5ea-469f-ac6d- 4b8ab06213c2@marlin_init 0xffffff54e22a1028 zfs rollback zones/8ffce16a-13c2-4efa-a233- 9e378e89877b@marlin_init 0xffffff4362f3a058 zfs rollback zones/0ddb8e49-ca7e-42e1-8fdc- 4ac4ba8fe9f8@marlin_init 0xffffff5748e8d020 zfs rollback zones/426357b5-832d-4430-953e- 10cd45ff8e9f@marlin_init 0xffffff436b867008 zfs rollback zones/8f36bf37-8a9c-4a44-995c- 6d1b2751e6f5@marlin_init 0xffffff4381ad4090 zfs rollback zones/6c8eca18-fbd6-46dd-ac24- 2ed45cd0da70@marlin_init Reviewed by: Matthew Ahrens <mahrens@delphix.com> Reviewed by: Dan Kimmel <dan.kimmel@delphix.com> Reviewed by: Pavel Zakharov <pavel.zakharov@delphix.com> Reviewed by: Andriy Gapon <avg@FreeBSD.org> Approved by: Richard Lowe <richlowe@richlowe.net> Author: George Wilson <george.wilson@delphix.com>		2016-11-28 15:09:58 +00:00
cmd	7297 clear() on llquantize aggregation causes dtrace to exit	2016-08-26 20:51:09 +00:00
common	5778 nvpair_type_is_array() does not recognize DATA_TYPE_INT8_ARRAY	2016-11-02 17:34:33 +00:00
head	5066 remove support for non-ANSI compilation	2014-08-20 06:29:42 +00:00
lib	6428 set canmount=off on unmounted filesystem tries to unmount children	2016-11-22 11:50:52 +00:00
man	7277 zdb should be able to print zfs_dbgmsg's	2016-08-15 14:24:47 +00:00
tools/ctf	5589 improper use of NULL in tools/ctf	2015-03-09 20:43:14 +00:00
uts	3821 Race in rollback, zil close, and zil flush	2016-11-28 15:09:58 +00:00
OPENSOLARIS.LICENSE	Update vendor/opensolaris to last OpenSolaris state (13149:b23a4dab3d50)	2012-07-18 07:48:04 +00:00