Find a file
Rick Macklem 22df1ffd81 Fix hangs with processes stuck sleeping on btalloc on i386.
r358097 introduced a problem for i386, where kernel builds will intermittently
get hung, typically with many processes sleeping on "btalloc".
I know nothing about VM, but received assistance from rlibby@ and markj@.

rlibby@ stated the following:
   It looks like the problem is that
   for systems that do not have UMA_MD_SMALL_ALLOC, we do
           uma_zone_set_allocf(vmem_bt_zone, vmem_bt_alloc);
   but we haven't set an appropriate free function.  This is probably why
   UMA_ZONE_NOFREE was originally there.  When NOFREE was removed, it was
   appropriate for systems with uma_small_alloc.

   So by default we get page_free as our free function.  That calls
   kmem_free, which calls vmem_free ... but we do our allocs with
   vmem_xalloc.  I'm not positive, but I think the problem is that in
   effect we vmem_xalloc -> vmem_free, not vmem_xfree.

   Three possible fixes:
    1: The one you tested, but this is not best for systems with
       uma_small_alloc.
    2: Pass UMA_ZONE_NOFREE conditional on UMA_MD_SMALL_ALLOC.
    3: Actually provide an appropriate vmem_bt_free function.

   I think we should just do option 2 with a comment, it's simple and it's
   what we used to do.  I'm not sure how much benefit we would see from
   option 3, but it's more work.

This patch implements #2. I haven't done a comment, since I don't know
what the problem is.

markj@ noted the following:
   I think the suggested patch is ok, but not for the reason stated.
   On platforms without a direct map the problem is:
   to allocate btags we need a slab,
   and to allocate a slab we need to map a page, and to map a page we need
   to allocate btags.

   We handle this recursion using a custom slab allocator which specifies
   M_USE_RESERVE, allowing it to dip into a reserve of free btags.
   Because the returned slab can be used to keep the reserve populated,
   this ensures that there are always enough free btags available to
   handle the recursion.

   UMA_ZONE_NOFREE ensures that we never reclaim free slabs from the zone.
   However, when it was removed, an apparent bug in UMA was exposed:
   keg_drain() ignores the reservation set by uma_zone_reserve()
   in vmem_startup().
   So under memory pressure we reclaim the free btags that are needed to
   break the recursion.
   That's why adding _NOFREE back fixes the problem: it disables the
   reclamation.

   We could perhaps fix it more cleverly, by modifying keg_drain() to always
   leave uk_reserve slabs available.

markj@'s initial patch failed testing, so committing this patch was agreed
upon as the interim solution.
Either rlibby@ or markj@ might choose to add a comment to it.

PR:		248008
Reviewed by:	rlibby, markj
2020-08-25 00:58:14 +00:00
bin ls(1): Update POSIX conformance from 2001 to 2008 2020-08-21 06:20:11 +00:00
cddl Fix a typo in r364438 affecting 32-bit platforms. 2020-08-22 14:24:17 +00:00
contrib Vendor import of openzfs master @ 184df27eef 2020-08-24 22:48:19 +00:00
crypto sshd: allow UseBlocklist alias for UseBlacklist 2020-07-29 00:34:24 +00:00
etc Vendor import of openzfs master @ 184df27eef 2020-08-24 22:48:19 +00:00
gnu Remove now-unused GNU as build infrastructure 2020-06-07 13:53:23 +00:00
include Vendor import of openzfs master @ 184df27eef 2020-08-24 22:48:19 +00:00
kerberos5 Update Makefile.depend files 2019-12-11 17:37:53 +00:00
lib Vendor import of openzfs master @ 184df27eef 2020-08-24 22:48:19 +00:00
libexec Don't explicitly specify c99 or gnu99 as the default is now gnu99. 2020-08-17 05:57:02 +00:00
release pkgbase: Replace / with | for PKG_WWW 2020-08-11 10:07:59 +00:00
rescue Move ifconfig SFP status functionality into libifconfig 2020-08-09 16:27:28 +00:00
sbin Change the resume notification event from 'kern' to 'kernel' 2020-08-24 19:35:15 +00:00
secure caroot: switch to using echo+shell glob to enumerate certs 2020-08-23 23:56:57 +00:00
share After r364732, we can now enable MK_OPENMP for aarch64 by default. 2020-08-24 20:40:26 +00:00
stand Avoid adding duplicates to SRCS/OBJS/SOBJS/POBJS 2020-08-24 09:20:33 +00:00
sys Fix hangs with processes stuck sleeping on btalloc on i386. 2020-08-25 00:58:14 +00:00
targets Add WITH_CLANG_FORMAT option 2020-06-24 17:03:42 +00:00
tests Vendor import of openzfs master @ 184df27eef 2020-08-24 22:48:19 +00:00
tools When copying over the binaries, use '-p' to preserve date/time 2020-08-24 16:06:11 +00:00
usr.bin w(1): Add EXAMPLES to man page 2020-08-24 17:57:08 +00:00
usr.sbin Update unbound version number. 2020-08-24 18:17:13 +00:00
.arcconfig callsign isn't required anymore 2016-09-29 06:19:45 +00:00
.arclint arc lint: ignore /tests/ in chmod 2017-12-19 03:38:06 +00:00
.cirrus.yml Cirrus-CI: increase timeout to 120m 2020-02-19 15:56:40 +00:00
.clang-format Clang-format: Avoid hardcoded LLVM include-order style 2020-06-24 23:22:36 +00:00
.gitattributes Add a basic clang-format configuration file 2019-06-07 15:23:52 +00:00
.gitignore .gitignore: Add LINT kernel configurations generated into SRCDIR 2019-08-10 18:22:22 +00:00
COPYRIGHT Vendor import of openzfs master @ 184df27eef 2020-08-24 22:48:19 +00:00
LOCKS LOCKS: update current locks 2018-06-09 03:08:04 +00:00
MAINTAINERS Update bhyve maintainers. 2020-06-26 06:11:50 +00:00
Makefile Add a USE_GCC_TOOLCHAINS knob to make universe. 2020-08-17 20:11:43 +00:00
Makefile.inc1 When copying over the binaries, use '-p' to preserve date/time 2020-08-24 16:06:11 +00:00
Makefile.libcompat Stop building libl and liby 2020-03-26 08:23:09 +00:00
Makefile.sys.inc AUTO_OBJ: For all top-level targets enforce using an OBJDIR. 2017-12-05 21:29:47 +00:00
ObsoleteFiles.inc Add ufm(4) to ObsoleteFiles.inc 2020-08-20 19:14:53 +00:00
README README: add generic notes about GENERIC and NOTES 2018-06-17 19:44:24 +00:00
README.md Vendor import of openzfs master @ 184df27eef 2020-08-24 22:48:19 +00:00
RELNOTES Fix silly typo... 2020-08-24 20:02:13 +00:00
UPDATING Document the kern -> kernel name change for resume events. 2020-08-24 19:35:27 +00:00

FreeBSD Source:

This is the top level of the FreeBSD source directory. This file was last revised on: FreeBSD

FreeBSD is an operating system used to power modern servers, desktops, and embedded platforms. A large community has continually developed it for more than thirty years. Its advanced networking, security, and storage features have made FreeBSD the platform of choice for many of the busiest web sites and most pervasive embedded networking and storage devices.

For copyright information, please see the file COPYRIGHT in this directory. Additional copyright information also exists for some sources in this tree - please see the specific source directories for more information.

The Makefile in this directory supports a number of targets for building components (or all) of the FreeBSD source tree. See build(7), config(8), https://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/makeworld.html, and https://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/kernelconfig.html for more information, including setting make(1) variables.

Source Roadmap:

bin		System/user commands.

cddl		Various commands and libraries under the Common Development
		and Distribution License.

contrib		Packages contributed by 3rd parties.

crypto		Cryptography stuff (see crypto/README).

etc		Template files for /etc.

gnu		Various commands and libraries under the GNU Public License.
		Please see gnu/COPYING* for more information.

include		System include files.

kerberos5	Kerberos5 (Heimdal) package.

lib		System libraries.

libexec		System daemons.

release		Release building Makefile & associated tools.

rescue		Build system for statically linked /rescue utilities.

sbin		System commands.

secure		Cryptographic libraries and commands.

share		Shared resources.

stand		Boot loader sources.

sys		Kernel sources.

sys/<arch>/conf Kernel configuration files. GENERIC is the configuration
		used in release builds. NOTES contains documentation of
		all possible entries.

tests		Regression tests which can be run by Kyua.  See tests/README
		for additional information.

tools		Utilities for regression testing and miscellaneous tasks.

usr.bin		User commands.

usr.sbin	System administration commands.

For information on synchronizing your source tree with one or more of the FreeBSD Project's development branches, please see:

https://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/current-stable.html