go/src
Than McIntosh 39986d28e4 cmd/compile: allow more inlining of functions that construct closures
[This is a roll-forward of CL 479095, which was reverted due to a bad
interaction between inlining and escape analysis since fixed in CL 482355.]

Currently, when the inliner is determining if a function is
inlineable, it descends into the bodies of closures constructed by
that function. This has several unfortunate consequences:

- If the closure contains a disallowed operation (e.g., a defer), then
  the outer function can't be inlined. It makes sense that the
  *closure* can't be inlined in this case, but it doesn't make sense
  to punish the function that constructs the closure.

- The hairiness of the closure counts against the inlining budget of
  the outer function. Since we currently copy the closure body when
  inlining the outer function, this makes sense from the perspective
  of export data size and binary size, but ultimately doesn't make
  much sense from the perspective of what should be inlineable.

- Since the inliner walks into every closure created by an outer
  function in addition to starting a walk at every closure, this adds
  an n^2 factor to inlinability analysis.

This CL simply drops this behavior.

In std, this makes 57 more functions inlinable, and disallows inlining
for 10 (due to the basic instability of our bottom-up inlining
approach), for an net increase of 47 inlinable functions (+0.6%).

This will help significantly with the performance of the functions to
be added for #56102, which have a somewhat complicated nesting of
closures with a performance-critical fast path.

The downside of this seems to be a potential increase in export data
and text size, but the practical impact of this seems to be
negligible:

	       │    before    │           after            │
	       │    bytes     │    bytes      vs base      │
Go/binary        15.12Mi ± 0%   15.14Mi ± 0%  +0.16% (n=1)
Go/text          5.220Mi ± 0%   5.237Mi ± 0%  +0.32% (n=1)
Compile/binary   22.92Mi ± 0%   22.94Mi ± 0%  +0.07% (n=1)
Compile/text     8.428Mi ± 0%   8.435Mi ± 0%  +0.08% (n=1)

Updates #56102.

Change-Id: I1f4fc96c71609c8feb59fecdb92b69ba7e3b5b41
Reviewed-on: https://go-review.googlesource.com/c/go/+/482356
Reviewed-by: Cuong Manh Le <cuong.manhle.vn@gmail.com>
Run-TryBot: Than McIntosh <thanm@google.com>
Reviewed-by: Cherry Mui <cherryyz@google.com>
TryBot-Result: Gopher Robot <gobot@golang.org>
2023-04-07 15:12:08 +00:00
..
archive archive/zip: return ErrInsecurePath for unsafe paths by OpenReader 2023-04-05 15:11:02 +00:00
arena arena: add experimental arena package 2022-10-12 20:23:36 +00:00
bufio bufio: permit r.Reset(r) without infinite recursion 2023-02-10 18:56:01 +00:00
builtin builtin: add documentation for clear 2023-02-01 15:21:00 +00:00
bytes all: fix misuses of "a" vs "an" 2023-04-04 14:20:53 +00:00
cmd cmd/compile: allow more inlining of functions that construct closures 2023-04-07 15:12:08 +00:00
compress compress/zlib: use binary.BigEndian consistently 2023-02-27 18:51:27 +00:00
container
context context: clean up test files 2023-04-05 17:18:14 +00:00
crypto all: fix misuses of "a" vs "an" 2023-04-04 14:20:53 +00:00
database/sql database/sql,testing/quick: use reflect.Value.SetZero 2023-04-04 07:16:34 +00:00
debug all: fix misuses of "a" vs "an" 2023-04-04 14:20:53 +00:00
embed
encoding encoding/binary: add word size to the error message of the failed constraint 2023-04-04 22:12:53 +00:00
errors errors: improve the godoc for Join and Unwrap 2023-03-30 23:49:50 +00:00
expvar expvar: convert f to atomic type 2022-11-10 05:17:55 +00:00
flag flag: add BoolFunc; FlagSet.BoolFunc 2023-03-16 16:44:21 +00:00
fmt src: rename unexported errors by adding prefix err 2023-02-16 23:09:19 +00:00
go go/scanner: align line and column limit with the compiler's limit 2023-04-06 19:14:11 +00:00
hash all: replace leading spaces with tabs in assembly 2023-03-23 20:52:57 +00:00
html html/template,mime/multipart: document new GODEBUG settings 2023-04-05 15:42:48 +00:00
image image/jpeg: return io.ErrUnexpectedEOF on truncated data 2023-02-24 00:03:48 +00:00
index/suffixarray all: fix misuses of "a" vs "an" 2023-04-04 14:20:53 +00:00
internal runtime: add remaining wasip1 files 2023-04-06 17:48:24 +00:00
io io/ioutil: add doc links for deprecated function 2023-02-28 17:00:05 +00:00
log src/log/slog: JSONHandler checks if error implements json.Marshaler 2023-03-29 20:46:52 +00:00
maps maps: new package 2023-02-03 18:22:53 +00:00
math math/rand: clarify Seed deprecation note 2023-04-04 20:18:09 +00:00
mime html/template,mime/multipart: document new GODEBUG settings 2023-04-05 15:42:48 +00:00
net net/http: improve failure mode for TestResponseControllerSetPastReadDeadline 2023-04-06 21:23:31 +00:00
os os/exec: skip remount in TestFindExecutableVsNoexec on EROFS 2023-04-04 21:20:20 +00:00
path all: add a few links in package godocs 2023-03-25 10:16:23 +00:00
plugin Revert "cmd/link: establish dependable package initialization order" 2023-03-09 19:19:41 +00:00
reflect all: fix misuses of "a" vs "an" 2023-04-04 14:20:53 +00:00
regexp regexp/syntax: test for lowercase letters first in IsWordChar 2023-03-14 04:39:42 +00:00
runtime runtime: permit core dumps in darwin-amd64 2023-04-07 14:56:12 +00:00
slices slices: skip TestGrow allocation test if noopt 2023-02-14 17:50:49 +00:00
sort
strconv all: add a few links in package godocs 2023-03-25 10:16:23 +00:00
strings bytes, strings: avoid unnecessary zero initialization 2023-02-27 19:11:00 +00:00
sync sync: implement OnceFunc, OnceValue, and OnceValues 2023-03-31 20:01:17 +00:00
syscall syscall: add remaining wasip1 files 2023-04-06 20:58:35 +00:00
testdata
testing database/sql,testing/quick: use reflect.Value.SetZero 2023-04-04 07:16:34 +00:00
text all: add a few links in package godocs 2023-03-25 10:16:23 +00:00
time time: fix timezone lookup logic for non-DST zones 2023-03-13 17:06:56 +00:00
unicode all: upgrade Unicode from 13.0.0 to 15.0.0 2023-02-06 04:29:53 +00:00
unsafe unsafe: add docs for SliceData, String, and StringData 2022-11-09 22:11:13 +00:00
vendor all: update vendored golang.org/x/net 2023-02-14 18:30:34 +00:00
all.bash
all.bat
all.rc
bootstrap.bash cmd/dist: add map of broken ports and -force flag 2023-01-20 17:52:26 +00:00
buildall.bash all: use grep -E/-F instead of fgrep/egrep 2022-10-06 21:22:22 +00:00
clean.bash
clean.bat
clean.rc
cmp.bash
go.mod all: update vendored golang.org/x/net 2023-02-14 18:30:34 +00:00
go.sum all: update vendored golang.org/x/net 2023-02-14 18:30:34 +00:00
make.bash make.bash, make.rc: fix GOROOT detection when GOEXPERIMENT is set 2023-01-17 22:30:56 +00:00
make.bat make.bat: support existing toolchain paths with spaces 2023-01-19 20:43:23 +00:00
Make.dist
make.rc make.bash, make.rc: fix GOROOT detection when GOEXPERIMENT is set 2023-01-17 22:30:56 +00:00
race.bash
race.bat
README.vendor README.vendor: minor updates 2023-01-03 20:31:59 +00:00
run.bash run.bash: drop 'export GOROOT' and its obsolete comment 2023-03-30 15:55:17 +00:00
run.bat
run.rc

Vendoring in std and cmd
========================

The Go command maintains copies of external packages needed by the
standard library in the src/vendor and src/cmd/vendor directories.

There are two modules, std and cmd, defined in src/go.mod and
src/cmd/go.mod. When a package outside std or cmd is imported
by a package inside std or cmd, the import path is interpreted
as if it had a "vendor/" prefix. For example, within "crypto/tls",
an import of "golang.org/x/crypto/cryptobyte" resolves to
"vendor/golang.org/x/crypto/cryptobyte". When a package with the
same path is imported from a package outside std or cmd, it will
be resolved normally. Consequently, a binary may be built with two
copies of a package at different versions if the package is
imported normally and vendored by the standard library.

Vendored packages are internally renamed with a "vendor/" prefix
to preserve the invariant that all packages have distinct paths.
This is necessary to avoid compiler and linker conflicts. Adding
a "vendor/" prefix also maintains the invariant that standard
library packages begin with a dotless path element.

The module requirements of std and cmd do not influence version
selection in other modules. They are only considered when running
module commands like 'go get' and 'go mod vendor' from a directory
in GOROOT/src.

Maintaining vendor directories
==============================

Before updating vendor directories, ensure that module mode is enabled.
Make sure that GO111MODULE is not set in the environment, or that it is
set to 'on' or 'auto'.

Requirements may be added, updated, and removed with 'go get'.
The vendor directory may be updated with 'go mod vendor'.
A typical sequence might be:

    cd src
    go get golang.org/x/net@latest
    go mod tidy
    go mod vendor

Use caution when passing '-u' to 'go get'. The '-u' flag updates
modules providing all transitively imported packages, not only
the module providing the target package.

Note that 'go mod vendor' only copies packages that are transitively
imported by packages in the current module. If a new package is needed,
it should be imported before running 'go mod vendor'.