mirror of
git://sourceware.org/git/glibc.git
synced 2026-09-08 23:58:31 +08:00
The top-level makefile was marked .NOTPARALLEL and ran the
per-subdirectory sub-makes strictly one at a time in the topological
order computed by scripts/gen-sorted.awk. Only the compilations inside
a single subdirectory could run in parallel, so on wide machines every
subdirectory's compile tail and link steps left most cores idle, once
per subdirectory per pass.
Drop .NOTPARALLEL and encode the ordering the serial recursion relied
on as explicit dependencies between the per-subdirectory targets:
* The subdirectories that generate shared files in $(common-objpfx)
consumed by the rest of the build without explicit dependencies run
serially, in their sorted order, before the rest fan out: csu
provides the tree-wide gen-as-const headers, and on Hurd the mach
and hurd directories generate the MiG RPC headers (every other
subdirectory otherwise runs a nested make in hurd/ to create them,
racing under parallel recursion; see sysdeps/mach/hurd/Makefile).
The first of them also materializes the other shared generated files
(abi-versions.h, sysd-syscalls, before-compile headers).
* The edges requested by the Depend files (now emitted by
gen-sorted.awk as subdir-deps-*) are preserved. Edges pointing to
elf are dropped, as the sorted list already overrides them by
forcing elf last.
* The tests and xtests classes only run the per-directory test
programs, which are mutually independent once the others pass has
built the tree. They therefore carry only the others pass barrier
below and none of the csu-first or Depend edges (+ordered_parallel_-
subdir_targets excludes them); otherwise "make subdir/tests" would
also run the tests of every subdirectory reachable through those
edges, rather than just the requested one.
* elf stays last: its rtld link consumes $(common-objpfx)libc_pic.a,
which aggregates every other subdirectory's objects, and its
rtld-Rules recursion compiles into the other subdirectories' object
directories.
* Pass barriers replace the implicit pass ordering: others after lib
(a subdirectory others sub-make would otherwise race to link
libc.so itself), tests/xtests after others, and the testroot
install behind others.
* The threading (nptl, or htl on Hurd) and realtime (rt) tests are
timing-sensitive and were previously shielded from system load by
the global .NOTPARALLEL. With the recursion now parallel, a full
test run ('make check'/'tests', run-built-tests=yes) orders them
after the rest of the test run and one group at a time -- the
threading subdirectory, then rt -- and each serializes its own run
via a .NOTPARALLEL in its Makefile. A targeted 'make subdir/tests'
is not ordered.
The serialization (the per-subdirectory .NOTPARALLEL and the ordering
above) constrains only the test run, not the build of the test
programs; but building and running a subdirectory's tests are fused
in its sub-make, so under run-built-tests=yes the serialized
subdirectories would also build their test programs serially. To
avoid that, the top-level 'make check' (in Makerules) now runs two
passes: it builds every test program with run-built-tests=no, where
the recursion is fully parallel and none of the serialization
applies, and then runs the tests with run-built-tests=yes. 'make
tests' and a subdirectory's own 'check' stay single pass.
* The subdirectory-built files that the top-level libc.so and
linkobj/libc_pic.a rules list as prerequisites (elf/ld.so,
interp.os, sofini.os, sunrpc/librpc_compat_pic.a, and on Hurd
mach/libmachuser_pic.a and hurd/libhurduser_pic.a, from which the
lib*user-link.so inputs of libc.so are built) get order-only edges
on the corresponding sub-make with an explicit empty recipe. A
prerequisite-only rule would trigger an implicit rule search and
this level would compile them itself in the wrong context.
* The install, clean, abi, and stubs target classes keep the
previous total order via a serial dependency chain.
* The elf DSO sorting test recipes, run when make remakes the
included generated makefiles at parse time, create the elf object
directory before writing into it; the serial recursion no longer
guarantees another rule created it first.
* catgets builds locale-specific message catalogs (and tst-catgets
reads one) by running gencat under de_DE.ISO-8859-1, hr_HR.ISO-8859-2
and ja_JP.SJIS, but never declared those locales as prerequisites: it
relied on localedata running before it in the serial order. Under
the parallel recursion gencat could run before localedata generated
the locale, fall back to C, and fail. catgets/Makefile now pulls the
locales in via gen-locales.mk, like the other subdirectories that use
locales in their tests.
Results on a x86_64 machine [1] with default configuration [3]: a
from-scratch build improves from 78.728s to 61s, and check with
run-built-tests=no from 374s to 190s.
On a 80-core aarch64 machine [2] with default configuration [3]: a
from-scratch build improves from 105.251s to 56.703s, and check with
run-built-tests=no from 886.183s to 298.726s.
Build results are unchanged: all 8919 built objects, archives, and
shared objects are bit-identical to the serial build across 7 clean
parallel builds, the installed tree layout is identical, and the
tests.sum failure sets are identical. i686-gnu was verified with
repeated from-scratch builds.
[1] Ryzen 5900x, 12c/24t, gcc 16.1.1, binutils 2.26, and GNU make 4.3
[2] N1, 80c, gcc 15.1.1, binutils 2.25, GNU make 4.3
[3] --enable-stack-protector=all --enable-bind-now=yes --enable-profile=yes
--enable-fortify-source=2 --enable-hardcoded-path-in-tests
Reviewed-by: Sam James <sam@gentoo.org>
937 lines
30 KiB
Makefile
937 lines
30 KiB
Makefile
# Copyright (C) 1991-2026 Free Software Foundation, Inc.
|
|
# This file is part of the GNU C Library.
|
|
|
|
# The GNU C Library is free software; you can redistribute it and/or
|
|
# modify it under the terms of the GNU Lesser General Public
|
|
# License as published by the Free Software Foundation; either
|
|
# version 2.1 of the License, or (at your option) any later version.
|
|
|
|
# The GNU C Library is distributed in the hope that it will be useful,
|
|
# but WITHOUT ANY WARRANTY; without even the implied warranty of
|
|
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
|
|
# Lesser General Public License for more details.
|
|
|
|
# You should have received a copy of the GNU Lesser General Public
|
|
# License along with the GNU C Library; if not, see
|
|
# <https://www.gnu.org/licenses/>.
|
|
|
|
#
|
|
# Master Makefile for the GNU C library
|
|
#
|
|
ifneq (,)
|
|
This makefile requires GNU Make.
|
|
endif
|
|
|
|
include Makeconfig
|
|
|
|
|
|
# This is the default target; it makes everything except the tests.
|
|
.PHONY: all help minihelp
|
|
all: minihelp lib others
|
|
|
|
help:
|
|
@sed '0,/^help-starts-here$$/d' Makefile.help
|
|
|
|
minihelp:
|
|
@echo
|
|
@echo type \"make help\" for help with common glibc makefile targets
|
|
@echo
|
|
|
|
|
|
ifneq ($(AUTOCONF),no)
|
|
|
|
define autoconf-it
|
|
@-rm -f $@.new
|
|
$(AUTOCONF) $(ACFLAGS) $< > $@.new
|
|
chmod a-w$(patsubst %,$(comma)a+x,$(filter .,$(@D))) $@.new
|
|
mv -f $@.new $@
|
|
endef
|
|
|
|
configure: configure.ac aclocal.m4; $(autoconf-it)
|
|
%/configure: %/configure.ac aclocal.m4; $(autoconf-it)
|
|
%/preconfigure: %/preconfigure.ac aclocal.m4; $(autoconf-it)
|
|
|
|
endif # $(AUTOCONF) = no
|
|
|
|
|
|
# These are the targets that are made by making them in each subdirectory.
|
|
+subdir_targets := subdir_lib objects objs others subdir_mostlyclean \
|
|
subdir_clean subdir_distclean subdir_realclean \
|
|
tests xtests \
|
|
subdir_update-abi subdir_check-abi \
|
|
subdir_update-all-abi \
|
|
subdir_echo-headers \
|
|
subdir_install \
|
|
subdir_objs subdir_stubs subdir_testclean \
|
|
$(addprefix install-, no-libc.a bin lib data headers others)
|
|
|
|
headers := limits.h values.h features.h features-time64.h gnu-versions.h \
|
|
bits/xopen_lim.h gnu/libc-version.h stdc-predef.h \
|
|
bits/libc-header-start.h
|
|
|
|
echo-headers: subdir_echo-headers
|
|
|
|
# The headers are in the include directory.
|
|
subdir-dirs = include
|
|
vpath %.h $(subdir-dirs)
|
|
|
|
# What to install.
|
|
install-others = $(inst_includedir)/gnu/stubs.h
|
|
install-bin-script =
|
|
|
|
ifeq (yes,$(build-shared))
|
|
headers += gnu/lib-names.h
|
|
endif
|
|
|
|
include Makerules
|
|
|
|
ifeq ($(build-programs),yes)
|
|
others: $(addprefix $(objpfx),$(install-bin-script))
|
|
endif
|
|
|
|
# Install from subdirectories too.
|
|
install: subdir_install
|
|
|
|
# Explicit dependency so that `make install-headers' works
|
|
install-headers: install-headers-nosubdir
|
|
|
|
# Make sure that the dynamic linker is installed before libc.
|
|
$(inst_slibdir)/libc-$(version).so: elf/ldso_install
|
|
|
|
.PHONY: elf/ldso_install
|
|
elf/ldso_install:
|
|
$(MAKE) -C $(@D) $(@F)
|
|
|
|
# Create links for shared libraries using the `ldconfig' program if possible.
|
|
# Ignore the error if we cannot update /etc/ld.so.cache.
|
|
ifeq (no,$(cross-compiling))
|
|
ifeq (yes,$(build-shared))
|
|
install:
|
|
-test ! -x $(elf-objpfx)ldconfig || LC_ALL=C \
|
|
$(elf-objpfx)ldconfig $(addprefix -r ,$(install_root)) \
|
|
$(slibdir) $(libdir)
|
|
ifneq (no,$(PERL))
|
|
ifeq (/usr,$(prefix))
|
|
ifeq (,$(install_root))
|
|
LD_SO=$(ld.so-version) CC="$(CC)" $(PERL) scripts/test-installation.pl $(common-objpfx)
|
|
endif
|
|
endif
|
|
endif
|
|
endif
|
|
endif
|
|
|
|
# Build subdirectory lib objects.
|
|
lib-noranlib: subdir_lib
|
|
|
|
ifeq (yes,$(build-shared))
|
|
# Build the shared object from the PIC object library.
|
|
lib: $(common-objpfx)libc.so $(common-objpfx)linkobj/libc.so
|
|
ifdef libc.so-version
|
|
# Every program linked in the others pass lists the versioned name
|
|
# (through link-libc-between-gnulib) as a prerequisite, and the rule
|
|
# creating the symbolic link is visible in every sub-make. Build it
|
|
# here once so the concurrent sub-makes do not race to create it.
|
|
lib: $(common-objpfx)libc.so$(libc.so-version)
|
|
endif
|
|
endif # $(build-shared)
|
|
|
|
# Used to build testrun.sh.
|
|
define testrun-script
|
|
#!/bin/bash
|
|
builddir=`dirname "$$0"`
|
|
GCONV_PATH="$${builddir}/iconvdata"
|
|
|
|
usage () {
|
|
cat << EOF
|
|
Usage: $$0 [OPTIONS] <program> [ARGUMENTS...]
|
|
|
|
--tool=TOOL Run with the specified TOOL. It can be strace, rpctrace,
|
|
valgrind or container. The container will run within
|
|
support/test-container. For strace and valgrind,
|
|
additional arguments can be passed after the tool name.
|
|
EOF
|
|
|
|
exit 1
|
|
}
|
|
|
|
toolname=default
|
|
while test $$# -gt 0 ; do
|
|
case "$$1" in
|
|
--tool=*)
|
|
toolname="$${1:7}"
|
|
shift
|
|
;;
|
|
--*)
|
|
usage
|
|
;;
|
|
*)
|
|
break
|
|
;;
|
|
esac
|
|
done
|
|
|
|
if test $$# -eq 0 ; then
|
|
usage
|
|
fi
|
|
|
|
case "$$toolname" in
|
|
default)
|
|
exec $(subst $(common-objdir),"$${builddir}", $(test-program-prefix)) \
|
|
$${1+"$$@"}
|
|
;;
|
|
strace*)
|
|
exec $$toolname $(patsubst %, -E%, $(run-program-env)) \
|
|
$(test-via-rtld-prefix) $${1+"$$@"}
|
|
;;
|
|
rpctrace)
|
|
exec rpctrace $(patsubst %, -E%, $(run-program-env)) \
|
|
$(test-via-rtld-prefix) $${1+"$$@"}
|
|
;;
|
|
valgrind*)
|
|
exec env $(run-program-env) $$toolname $(test-via-rtld-prefix) $${1+"$$@"}
|
|
;;
|
|
container)
|
|
exec env $(run-program-env) $(test-via-rtld-prefix) \
|
|
$(common-objdir)/support/test-container \
|
|
env $(run-program-env) $(test-via-rtld-prefix) $${1+"$$@"}
|
|
;;
|
|
*)
|
|
usage
|
|
;;
|
|
esac
|
|
endef
|
|
|
|
# This is a handy script for running any dynamically linked program against
|
|
# the current libc build for testing.
|
|
$(common-objpfx)testrun.sh: $(common-objpfx)config.make \
|
|
$(..)Makeconfig $(..)Makefile
|
|
$(file >$@T,$(testrun-script))
|
|
chmod a+x $@T
|
|
mv -f $@T $@
|
|
postclean-generated += testrun.sh
|
|
|
|
define debugglibc
|
|
#!/bin/bash
|
|
|
|
SOURCE_DIR="$(CURDIR)"
|
|
BUILD_DIR="$(common-objpfx)"
|
|
CMD_FILE="$(common-objpfx)debugglibc.gdb"
|
|
CONTAINER=false
|
|
DIRECT=true
|
|
STATIC=false
|
|
SYMBOLSFILE=true
|
|
unset TESTCASE
|
|
unset BREAKPOINTS
|
|
unset ENVVARS
|
|
|
|
usage()
|
|
{
|
|
cat << EOF
|
|
Usage: $$0 [OPTIONS] <program>
|
|
|
|
Or: $$0 [OPTIONS] -- <program> [<args>]...
|
|
|
|
where <program> is the path to the program being tested,
|
|
and <args> are the arguments to be passed to it.
|
|
|
|
Options:
|
|
|
|
-h, --help
|
|
Prints this message and leaves.
|
|
|
|
The following options require one argument:
|
|
|
|
-b, --breakpoint
|
|
Breakpoints to set at the beginning of the execution
|
|
(each breakpoint demands its own -b option, e.g. -b foo -b bar)
|
|
-e, --environment-variable
|
|
Environment variables to be set with 'exec-wrapper env' in GDB
|
|
(each environment variable demands its own -e option, e.g.
|
|
-e FOO=foo -e BAR=bar)
|
|
|
|
The following options do not take arguments:
|
|
|
|
-c, --in-container
|
|
Run the test case inside a container and automatically attach
|
|
GDB to it.
|
|
-i, --no-direct
|
|
Selects whether to pass the --direct flag to the program.
|
|
--direct is useful when debugging glibc test cases. It inhibits the
|
|
tests from forking and executing in a subprocess.
|
|
Default behaviour is to pass the --direct flag, except when the
|
|
program is run with user specified arguments using the "--" separator.
|
|
-s, --no-symbols-file
|
|
Do not tell GDB to load debug symbols from the program.
|
|
EOF
|
|
}
|
|
|
|
# Parse input options
|
|
while [[ $$# > 0 ]]
|
|
do
|
|
key="$$1"
|
|
case $$key in
|
|
-h|--help)
|
|
usage
|
|
exit 0
|
|
;;
|
|
-b|--breakpoint)
|
|
BREAKPOINTS="break $$2\n$$BREAKPOINTS"
|
|
shift
|
|
;;
|
|
-e|--environment-variable)
|
|
ENVVARS="$$2 $$ENVVARS"
|
|
shift
|
|
;;
|
|
-c|--in-container)
|
|
CONTAINER=true
|
|
;;
|
|
-i|--no-direct)
|
|
DIRECT=false
|
|
;;
|
|
-s|--no-symbols-file)
|
|
SYMBOLSFILE=false
|
|
;;
|
|
--)
|
|
shift
|
|
TESTCASE=$$1
|
|
COMMANDLINE="$$@"
|
|
# Don't add --direct when user specifies program arguments
|
|
DIRECT=false
|
|
break
|
|
;;
|
|
*)
|
|
TESTCASE=$$1
|
|
COMMANDLINE=$$TESTCASE
|
|
;;
|
|
esac
|
|
shift
|
|
done
|
|
|
|
# Check for required argument and if the testcase exists
|
|
if [ ! -v TESTCASE ] || [ ! -f $${TESTCASE} ]
|
|
then
|
|
usage
|
|
exit 1
|
|
fi
|
|
|
|
# Container tests needing locale data should install them in-container.
|
|
# Other tests/binaries need to use locale data from the build tree.
|
|
if [ "$$CONTAINER" = false ]
|
|
then
|
|
ENVVARS="GCONV_PATH=$${BUILD_DIR}/iconvdata $$ENVVARS"
|
|
ENVVARS="LOCPATH=$${BUILD_DIR}/localedata $$ENVVARS"
|
|
ENVVARS="LC_ALL=C $$ENVVARS"
|
|
fi
|
|
|
|
# Expand environment setup command
|
|
if [ -v ENVVARS ]
|
|
then
|
|
ENVVARSCMD="set exec-wrapper env $$ENVVARS"
|
|
fi
|
|
|
|
# Expand direct argument
|
|
if [ "$$DIRECT" == true ]
|
|
then
|
|
DIRECT="--direct"
|
|
else
|
|
DIRECT=""
|
|
fi
|
|
|
|
# Check if the test case is static
|
|
if file $${TESTCASE} | grep "statically linked" >/dev/null
|
|
then
|
|
STATIC=true
|
|
else
|
|
STATIC=false
|
|
fi
|
|
|
|
# Expand symbols loading command
|
|
if [ "$$SYMBOLSFILE" == true ]
|
|
then
|
|
SYMBOLSFILE="add-symbol-file $${TESTCASE}"
|
|
else
|
|
SYMBOLSFILE=""
|
|
fi
|
|
|
|
# GDB commands template
|
|
template ()
|
|
{
|
|
cat <<EOF
|
|
set environment C -E -x c-header
|
|
set auto-load safe-path $${BUILD_DIR}/nptl_db:\$$debugdir:\$$datadir/auto-load
|
|
set libthread-db-search-path $${BUILD_DIR}/nptl_db
|
|
__ENVVARS__
|
|
__SYMBOLSFILE__
|
|
break _dl_start_user
|
|
run --library-path $(rpath-link):$${BUILD_DIR}/nptl_db \
|
|
__COMMANDLINE__ __DIRECT__
|
|
__BREAKPOINTS__
|
|
EOF
|
|
}
|
|
|
|
# Generate the commands file for gdb initialization
|
|
template | sed \
|
|
-e "s|__ENVVARS__|$$ENVVARSCMD|" \
|
|
-e "s|__SYMBOLSFILE__|$$SYMBOLSFILE|" \
|
|
-e "s|__COMMANDLINE__|$$COMMANDLINE|" \
|
|
-e "s|__DIRECT__|$$DIRECT|" \
|
|
-e "s|__BREAKPOINTS__|$$BREAKPOINTS|" \
|
|
> $$CMD_FILE
|
|
|
|
echo
|
|
echo "Debugging glibc..."
|
|
echo "Build directory : $$BUILD_DIR"
|
|
echo "Source directory : $$SOURCE_DIR"
|
|
echo "GLIBC Testcase : $$TESTCASE"
|
|
echo "GDB Commands : $$CMD_FILE"
|
|
echo "Env vars : $$ENVVARS"
|
|
echo
|
|
|
|
if [ "$$CONTAINER" == true ]
|
|
then
|
|
# Use testrun.sh to start the test case with WAIT_FOR_DEBUGGER=1, then
|
|
# automatically attach GDB to it.
|
|
WAIT_FOR_DEBUGGER=1 $(common-objpfx)testrun.sh --tool=container $${TESTCASE} &
|
|
gdb -x $${TESTCASE}.gdb
|
|
elif [ "$$STATIC" == true ]
|
|
then
|
|
gdb $${TESTCASE}
|
|
else
|
|
# Start the test case debugging in two steps:
|
|
# 1. the following command invokes gdb to run the loader;
|
|
# 2. the commands file tells the loader to run the test case.
|
|
gdb -q \
|
|
-x $${CMD_FILE} \
|
|
-d $${SOURCE_DIR} \
|
|
$${BUILD_DIR}/elf/ld.so
|
|
fi
|
|
endef
|
|
|
|
# This is another handy script for debugging dynamically linked program
|
|
# against the current libc build for testing.
|
|
$(common-objpfx)debugglibc.sh: $(common-objpfx)config.make \
|
|
$(..)Makeconfig $(..)Makefile
|
|
$(file >$@T,$(debugglibc))
|
|
chmod a+x $@T
|
|
mv -f $@T $@
|
|
postclean-generated += debugglibc.sh debugglibc.gdb
|
|
|
|
others: $(common-objpfx)testrun.sh $(common-objpfx)debugglibc.sh
|
|
|
|
# Makerules creates a file `stubs' in each subdirectory, which
|
|
# contains `#define __stub_FUNCTION' for each function defined in that
|
|
# directory which is a stub.
|
|
# Here we paste all of these together into <gnu/stubs.h>.
|
|
|
|
subdir-stubs := $(foreach dir,$(subdirs),$(common-objpfx)$(dir)/stubs)
|
|
|
|
ifndef abi-variants
|
|
installed-stubs = $(inst_includedir)/gnu/stubs.h
|
|
else
|
|
installed-stubs = $(inst_includedir)/gnu/stubs-$(default-abi).h
|
|
|
|
$(inst_includedir)/gnu/stubs.h: $(+force)
|
|
$(make-target-directory)
|
|
{ \
|
|
echo '/* This file is automatically generated.';\
|
|
echo " This file selects the right generated file of \`__stub_FUNCTION' macros";\
|
|
echo ' based on the architecture being compiled for. */'; \
|
|
echo ''; \
|
|
$(foreach h,$(abi-includes), echo '#include <$(h)>';) \
|
|
echo ''; \
|
|
$(foreach v,$(abi-variants),\
|
|
$(if $(abi-$(v)-condition),\
|
|
echo '#if $(abi-$(v)-condition)'; \
|
|
echo '# include <gnu/stubs-$(v).h>'); \
|
|
$(if $(abi-$(v)-condition),echo '#endif';) \
|
|
rm -f $(@:.d=.h).new$(v); \
|
|
) \
|
|
} > $(@:.d=.h).new
|
|
mv -f $(@:.d=.h).new $(@:.d=.h)
|
|
|
|
install-others-nosubdir: $(installed-stubs)
|
|
endif
|
|
|
|
|
|
# Since stubs.h is never needed when building the library, we simplify the
|
|
# hairy installation process by producing it in place only as the last part
|
|
# of the top-level `make install'. It depends on subdir_install, which
|
|
# iterates over all the subdirs; subdir_install in each subdir depends on
|
|
# the subdir's stubs file. Having more direct dependencies would result in
|
|
# extra iterations over the list for subdirs and many recursive makes.
|
|
$(installed-stubs): include/stubs-prologue.h subdir_install
|
|
$(make-target-directory)
|
|
@rm -f $(objpfx)stubs.h
|
|
(sed '/^@/d' $<; LC_ALL=C sort $(subdir-stubs)) > $(objpfx)stubs.h
|
|
if test -r $@ && cmp -s $(objpfx)stubs.h $@; \
|
|
then echo 'stubs.h unchanged'; \
|
|
else $(INSTALL_DATA) $(objpfx)stubs.h $@; fi
|
|
rm -f $(objpfx)stubs.h
|
|
|
|
# This makes the Info or DVI file of the documentation from the Texinfo source.
|
|
.PHONY: info dvi pdf html
|
|
info dvi pdf html:
|
|
$(MAKE) $(PARALLELMFLAGS) -C manual $@
|
|
|
|
# This makes all the subdirectory targets.
|
|
|
|
# For each target, make it depend on DIR/target for each subdirectory DIR.
|
|
$(+subdir_targets): %: $(addsuffix /%,$(subdirs))
|
|
|
|
# Compute a list of all those targets.
|
|
all-subdirs-targets := $(foreach dir,$(subdirs),\
|
|
$(addprefix $(dir)/,$(+subdir_targets)))
|
|
|
|
# The action for each of those is to cd into the directory and make the
|
|
# target there.
|
|
$(all-subdirs-targets):
|
|
$(MAKE) $(PARALLELMFLAGS) $(subdir-target-args) $(@F)
|
|
|
|
define subdir-target-args
|
|
subdir=$(@D)$(if $($(@D)-srcdir),\
|
|
-C $($(@D)-srcdir) ..=`pwd`/,\
|
|
-C $(@D) ..=../)
|
|
endef
|
|
|
|
.PHONY: $(+subdir_targets) $(all-subdirs-targets)
|
|
|
|
# Encode the topological ordering computed by scripts/gen-sorted.awk as
|
|
# explicit dependencies between the per-subdirectory targets, so that
|
|
# independent subdirectories build concurrently. In summary:
|
|
#
|
|
# * Every subdirectory depends on the first sorted one (csu, or mach on
|
|
# Hurd): its sub-make also materializes the shared generated files in
|
|
# $(common-objpfx) (abi-versions.h, sysd-syscalls, before-compile
|
|
# headers, ...) that concurrent sub-makes would otherwise race to
|
|
# create.
|
|
#
|
|
# * The edges requested by the Depend files (emitted by gen-sorted.awk
|
|
# as subdir-deps-*) are preserved.
|
|
#
|
|
# * elf stays last, as in the sorted list. Its rtld build recurses into
|
|
# the other subdirectories' object directories via elf/rtld-Rules.
|
|
#
|
|
# * Only target classes without cross-directory file conflicts use this
|
|
# sparse ordering; everything else (install, clean, abi, stubs) keeps
|
|
# the previous total order via a serial chain.
|
|
|
|
+parallel_subdir_targets := \
|
|
subdir_lib \
|
|
objects \
|
|
objs \
|
|
others \
|
|
tests \
|
|
xtests \
|
|
subdir_objs \
|
|
# +parallel_subdir_targets
|
|
+serial_subdir_targets := $(filter-out $(+parallel_subdir_targets),\
|
|
$(+subdir_targets))
|
|
|
|
# The tests and xtests classes run, rather than build, the per-directory
|
|
# test programs; once the 'others' pass barrier below has built the tree
|
|
# they are mutually independent and carry no cross-directory ordering.
|
|
# Keeping them out of the generated-file and Depend edges below is what
|
|
# lets 'make subdir/tests' run only that subdirectory's tests.
|
|
+barrier_only_subdir_targets := tests xtests
|
|
+ordered_parallel_subdir_targets := \
|
|
$(filter-out $(+barrier_only_subdir_targets),$(+parallel_subdir_targets))
|
|
|
|
# The subdirectories that generate shared files in $(common-objpfx)
|
|
# consumed by the rest of the build without explicit dependencies: csu
|
|
# provides the gen-as-const headers, and on Hurd the mach and hurd
|
|
# directories generate the MiG RPC headers (every other subdirectory
|
|
# otherwise runs a nested make in hurd/ to create them, racing under
|
|
# parallel recursion; see sysdeps/mach/hurd/Makefile). Run them serially,
|
|
# in their sorted order (mach, hurd, csu).
|
|
+subdir-pregen := $(filter mach hurd csu,$(subdirs))
|
|
+subdir-rest := $(filter-out $(+subdir-pregen),$(subdirs))
|
|
|
|
$(foreach t,$(+ordered_parallel_subdir_targets),$(eval \
|
|
$(addsuffix /$(t),$(+subdir-rest)): $(addsuffix /$(t),$(+subdir-pregen))))
|
|
+subdir-pregen-prev :=
|
|
$(foreach d,$(+subdir-pregen),$(foreach t,$(+ordered_parallel_subdir_targets),$(eval \
|
|
$(d)/$(t): $(addsuffix /$(t),$(+subdir-pregen-prev))))\
|
|
$(eval +subdir-pregen-prev := $(d)))
|
|
# Edges pointing to elf are dropped; the sorted list always forces elf
|
|
# last, overriding any Depend request, and the elf-last edges below would
|
|
# otherwise create a cycle.
|
|
$(foreach t,$(+ordered_parallel_subdir_targets),$(foreach d,$(+subdir-rest),$(eval \
|
|
$(d)/$(t): $(addsuffix /$(t),\
|
|
$(filter-out elf,$(filter $(subdirs),$(subdir-deps-$(d))))))))
|
|
ifneq (,$(filter elf,$(subdirs)))
|
|
$(foreach t,$(+ordered_parallel_subdir_targets),$(eval \
|
|
elf/$(t): $(addsuffix /$(t),$(filter-out elf,$(subdirs)))))
|
|
endif
|
|
|
|
# Pass barriers: a subdirectory 'others' build links programs against
|
|
# the libraries, so the 'lib' pass (including the top-level libc.so
|
|
# link) must have completed.
|
|
# 'tests' and 'xtests' additionally require the 'others' pass. The
|
|
# testroot used by the container tests performs a full installation in
|
|
# its recipe, which must not run concurrently with the build passes.
|
|
$(addsuffix /others,$(subdirs)): lib
|
|
$(addsuffix /tests,$(subdirs)) $(addsuffix /xtests,$(subdirs)): others
|
|
$(objpfx)testroot.pristine/install.stamp: | others
|
|
|
|
# Timing-sensitive test runs: the threading tests (nptl/htl) and the realtime
|
|
# tests (rt) are perturbed by the machine load, so run them after the rest of
|
|
# the test run has finished and one group at a time. Those subdirectories
|
|
# also serialize their own tests (.NOTPARALLEL in their Makefiles).
|
|
#
|
|
# This only orders a full-suite run ('make check'/'tests'); a targeted
|
|
# 'make subdir/tests' is left alone. And it only orders the test run
|
|
# (run-built-tests=yes); the "build the tests" pass (run-built-tests=no)
|
|
# is left fully parallel, so every test program still builds concurrently.
|
|
ifeq ($(run-built-tests),yes)
|
|
ifneq (,$(filter tests xtests check xcheck,$(MAKECMDGOALS)))
|
|
+late-test-subdirs := $(filter nptl htl,$(subdirs)) $(filter rt,$(subdirs))
|
|
+test-run-prev := \
|
|
$(addsuffix /tests,$(filter-out $(+late-test-subdirs),$(subdirs)))
|
|
$(foreach d,$(+late-test-subdirs),\
|
|
$(eval $(d)/tests: $(+test-run-prev))\
|
|
$(eval +test-run-prev += $(d)/tests))
|
|
endif
|
|
endif
|
|
|
|
ifeq (yes,$(build-shared))
|
|
# The top-level libc.so and linkobj/libc_pic.a rules list these
|
|
# subdirectory-built files as prerequisites, but no rule at this level
|
|
# builds them. The explicit empty recipe (';') is required, a
|
|
# prerequisite-only rule would send make on an implicitrule search and
|
|
# have this level compile them itself with the wrong context.
|
|
$(elf-objpfx)ld.so $(elf-objpfx)sofini.os $(elf-objpfx)interp.os: \
|
|
| elf/subdir_lib ;
|
|
ifneq (,$(filter sunrpc,$(subdirs)))
|
|
# Makerules explicit adds librpc_compat_pic.a as a dependency of
|
|
# libc_pic.a.
|
|
$(common-objpfx)sunrpc/librpc_compat_pic.a: | sunrpc/subdir_lib ;
|
|
endif
|
|
# Hurd sysdedp Makeilfe links libc.so against the lib*user-link.so
|
|
# objects, built by the %-link.so: %_pic.a pattern rule from archives
|
|
# that only the mach and hurd sub-makes create.
|
|
ifneq (,$(filter mach,$(subdirs)))
|
|
$(common-objpfx)mach/libmachuser_pic.a: | mach/subdir_lib ;
|
|
endif
|
|
ifneq (,$(filter hurd,$(subdirs)))
|
|
$(common-objpfx)hurd/libhurduser_pic.a: | hurd/subdir_lib ;
|
|
endif
|
|
endif
|
|
|
|
# The remaining target classes keep the old total order.
|
|
+subdir-chain-prev :=
|
|
$(foreach d,$(subdirs),$(foreach t,$(+serial_subdir_targets),$(eval \
|
|
$(d)/$(t): $(addsuffix /$(t),$(+subdir-chain-prev))))\
|
|
$(eval +subdir-chain-prev := $(d)))
|
|
|
|
# Targets to clean things up to various degrees.
|
|
|
|
.PHONY: clean realclean distclean distclean-1 parent-clean parent-mostlyclean \
|
|
tests-clean
|
|
|
|
# Subroutines of all cleaning targets.
|
|
parent-mostlyclean: common-mostlyclean # common-mostlyclean is in Makerules.
|
|
-rm -f $(foreach o,$(object-suffixes-for-libc),\
|
|
$(common-objpfx)$(patsubst %,$(libtype$o),c)) \
|
|
$(addprefix $(objpfx),$(install-lib))
|
|
parent-clean: parent-mostlyclean common-clean
|
|
|
|
postclean = $(addprefix $(common-objpfx),$(postclean-generated)) \
|
|
$(addprefix $(objpfx),sysd-dirs sysd-rules) \
|
|
$(addprefix $(objpfx),sysd-sorted soversions.mk soversions.i)
|
|
|
|
clean: parent-clean
|
|
# This is done this way rather than having `subdir_clean' be a
|
|
# dependency of this target so that libc.a will be removed before the
|
|
# subdirectories are dealt with and so they won't try to remove object
|
|
# files from it when it's going to be removed anyway.
|
|
@$(MAKE) subdir_clean no_deps=t
|
|
-rm -f $(postclean)
|
|
mostlyclean: parent-mostlyclean
|
|
@$(MAKE) subdir_mostlyclean no_deps=t
|
|
-rm -f $(postclean)
|
|
|
|
# Remove test artifacts from the whole glibc build.
|
|
# do-tests-clean removes test artifacts from top-level directory, and
|
|
# subdir_testclean removes them from individual sub-directories.
|
|
tests-clean: do-tests-clean
|
|
@$(MAKE) subdir_testclean no_deps=t
|
|
|
|
ifneq (,$(CXX))
|
|
vpath c++-types.data $(+sysdep_dirs)
|
|
|
|
tests-special += $(objpfx)c++-types-check.out
|
|
$(objpfx)c++-types-check.out: c++-types.data scripts/check-c++-types.sh
|
|
scripts/check-c++-types.sh $< $(CXX) $(filter-out -std=gnu11 $(+gccwarn-c),$(CFLAGS)) $(CPPFLAGS) > $@; \
|
|
$(evaluate-test)
|
|
endif
|
|
|
|
tests-special += $(objpfx)check-local-headers.out
|
|
$(objpfx)check-local-headers.out: scripts/check-local-headers.sh
|
|
AWK='$(AWK)' scripts/check-local-headers.sh \
|
|
"$(includedir)" "$(objpfx)" < /dev/null > $@; \
|
|
$(evaluate-test)
|
|
|
|
ifneq "$(headers)" ""
|
|
# Special test of all the installed headers in this directory.
|
|
tests-special += $(objpfx)check-installed-headers-c.out
|
|
libof-check-installed-headers-c := testsuite
|
|
$(objpfx)check-installed-headers-c.out: \
|
|
scripts/check-installed-headers.sh $(headers)
|
|
$(SHELL) $(..)scripts/check-installed-headers.sh c $(supported-fortify) \
|
|
"$(CC) $(test-config-cflags-finput-charset-ascii) \
|
|
$(filter-out -std=%,$(CFLAGS)) -D_ISOMAC $(+includes)" \
|
|
$(headers) > $@; \
|
|
$(evaluate-test)
|
|
|
|
ifneq "$(CXX)" ""
|
|
tests-special += $(objpfx)check-installed-headers-cxx.out
|
|
libof-check-installed-headers-cxx := testsuite
|
|
$(objpfx)check-installed-headers-cxx.out: \
|
|
scripts/check-installed-headers.sh $(headers)
|
|
$(SHELL) $(..)scripts/check-installed-headers.sh c++ $(supported-fortify) \
|
|
"$(CXX) $(test-config-cxxflags-finput-charset-ascii) \
|
|
$(filter-out -std=%,$(CXXFLAGS)) -D_ISOMAC $(+includes)" \
|
|
$(headers) > $@; \
|
|
$(evaluate-test)
|
|
endif # $(CXX)
|
|
|
|
tests-special += $(objpfx)check-wrapper-headers.out
|
|
$(objpfx)check-wrapper-headers.out: scripts/check-wrapper-headers.py $(headers)
|
|
$(PYTHON) $< --root=. --subdir=. $(headers) \
|
|
--generated $(common-generated) > $@; $(evaluate-test)
|
|
endif # $(headers)
|
|
|
|
# Lint all Makefiles; including this one. Pass `pwd` as the source
|
|
# directory since the top-level Makefile is in the root of the source
|
|
# tree and these tests are run from there. We add light-weight linting
|
|
# to the 'check' target to support the existing developer workflow of:
|
|
# edit -> make -> make check; without needing an additional step.
|
|
tests-special += $(objpfx)lint-makefiles.out
|
|
$(objpfx)lint-makefiles.out: scripts/lint-makefiles.sh
|
|
$(SHELL) $< "$(PYTHON)" `pwd` > $@ ; \
|
|
$(evaluate-test)
|
|
|
|
# Link libc.a as a whole to verify that it does not contain multiple
|
|
# definitions of any symbols.
|
|
tests-special += $(objpfx)link-static-libc.out
|
|
$(objpfx)link-static-libc.out:
|
|
$(LINK.o) $(whole-archive) -nostdlib -nostartfiles -r \
|
|
$(objpfx)libc.a -o /dev/null > $@ 2>&1; \
|
|
$(evaluate-test)
|
|
|
|
# Print test summary for tests in $1 .sum file;
|
|
# $2 is optional test identifier.
|
|
# Fail if there are unexpected failures in the test results.
|
|
define summarize-tests
|
|
@grep -E '^[A-Z]+:' $(objpfx)$1 | grep -E -v '^(PASS|XFAIL):' || true
|
|
@echo " === Summary of results$2 ==="
|
|
@sed -e '/:.*/!d' -e 's/:.*//' < $(objpfx)$1 | sort | uniq -c
|
|
@{ \
|
|
grep -E '^[A-Z]+:' $(objpfx)$1 | \
|
|
grep -E -v '^(X?PASS|XFAIL|UNSUPPORTED):' | \
|
|
( \
|
|
if ! test -f $(..)allowed-failures.txt; then \
|
|
read -r _; exit $$(( $$? == 0 )); \
|
|
fi; \
|
|
status=0; \
|
|
while IFS= read -r line; do \
|
|
case "$$line" in \
|
|
FAIL:*) \
|
|
name=$${line#FAIL: }; \
|
|
escaped_name=`printf '%s' "$$name" | sed 's/[.+]/\\&/g'`; \
|
|
if grep -Eq -- "^$${escaped_name}[[:space:]]*#" \
|
|
$(..)allowed-failures.txt; then \
|
|
echo "Ignoring allowed FAIL: $${name}"; \
|
|
continue; \
|
|
fi; \
|
|
echo "Unallowed FAIL: $${name}"; \
|
|
status=1; \
|
|
;; \
|
|
*) \
|
|
status=1; \
|
|
;; \
|
|
esac; \
|
|
done; \
|
|
exit $$status; \
|
|
); \
|
|
}
|
|
endef
|
|
|
|
# The intention here is to do ONE install of our build into the
|
|
# testroot.pristine/ directory, then rsync (internal to
|
|
# support/test-container) that to testroot.root/ at the start of each
|
|
# test. That way we can promise each test a "clean" install, without
|
|
# having to do the install for each test.
|
|
#
|
|
# In addition, we have to copy some files (which we build) into this
|
|
# root in addition to what glibc installs. For example, many tests
|
|
# require additional programs including /bin/sh, /bin/true, and
|
|
# /bin/echo, all of which we build below to limit library dependencies
|
|
# to just those things in glibc and language support libraries which
|
|
# we also copy into the into the rootfs. To determine what language
|
|
# support libraries we need we build a "test" program in either C or
|
|
# (if available) C++ just so we can copy in any shared objects
|
|
# (which we do not build) that GCC-compiled programs depend on.
|
|
|
|
|
|
ifeq (,$(CXX))
|
|
LINKS_DSO_PROGRAM = links-dso-program-c
|
|
else
|
|
LINKS_DSO_PROGRAM = links-dso-program
|
|
endif
|
|
|
|
$(tests-container) $(addsuffix /tests,$(subdirs)) : \
|
|
$(objpfx)testroot.pristine/install.stamp
|
|
$(objpfx)testroot.pristine/install.stamp :
|
|
test -d $(objpfx)testroot.pristine || \
|
|
mkdir $(objpfx)testroot.pristine
|
|
# We need a working /bin/sh for some of the tests.
|
|
test -d $(objpfx)testroot.pristine/bin || \
|
|
mkdir $(objpfx)testroot.pristine/bin
|
|
# We need the compiled locale dir for localedef tests.
|
|
test -d $(objpfx)testroot.pristine/$(complocaledir) || \
|
|
mkdir -p $(objpfx)testroot.pristine/$(complocaledir)
|
|
cp $(objpfx)support/shell-container $(objpfx)testroot.pristine/bin/sh
|
|
cp $(objpfx)support/echo-container $(objpfx)testroot.pristine/bin/echo
|
|
cp $(objpfx)support/true-container $(objpfx)testroot.pristine/bin/true
|
|
# We need to be able to load extra language libraries.
|
|
mkdir -p $(objpfx)testroot.pristine/etc/ld.so.conf.d
|
|
echo 'include ld.so.conf.d/*.conf' > $(objpfx)testroot.pristine/etc/ld.so.conf
|
|
echo $(gnulib-extralibdir) >> $(objpfx)testroot.pristine/etc/ld.so.conf
|
|
echo '# file without content' > $(objpfx)testroot.pristine/etc/ld.so.conf.d/999-empty.conf
|
|
ifeq ($(run-built-tests),yes)
|
|
# Copy these DSOs first so we can overwrite them with our own.
|
|
for dso in `$(test-wrapper-env) LD_TRACE_LOADED_OBJECTS=1 \
|
|
$(rtld-prefix) --inhibit-cache \
|
|
$(objpfx)testroot.pristine/bin/sh \
|
|
| sed -n '/\//{s@.*=> /@/@;s/^[^/]*//;s/ .*//p;}'` ;\
|
|
do \
|
|
test -d `dirname $(objpfx)testroot.pristine$$dso` || \
|
|
mkdir -p `dirname $(objpfx)testroot.pristine$$dso` ;\
|
|
$(test-wrapper) cp $$dso $(objpfx)testroot.pristine$$dso ;\
|
|
done
|
|
for dso in `$(test-wrapper-env) LD_TRACE_LOADED_OBJECTS=1 \
|
|
$(rtld-prefix) --inhibit-cache \
|
|
$(objpfx)support/$(LINKS_DSO_PROGRAM) \
|
|
| sed -n '/\//{s@.*=> /@/@;s/^[^/]*//;s/ .*//p;}'` ;\
|
|
do \
|
|
test -d `dirname $(objpfx)testroot.pristine$$dso` || \
|
|
mkdir -p `dirname $(objpfx)testroot.pristine$$dso` ;\
|
|
$(test-wrapper) cp $$dso $(objpfx)testroot.pristine$$dso ;\
|
|
done
|
|
endif
|
|
# $(symbolic-link-list) is a file that encodes $(DESTDIR) so we
|
|
# have to purge it
|
|
rm -f $(symbolic-link-list)
|
|
# Setting INSTALL_UNCOMPRESSED causes localedata/Makefile to
|
|
# install the charmaps uncompressed, as the testroot does not
|
|
# provide a gunzip program.
|
|
$(MAKE) install DESTDIR=$(objpfx)testroot.pristine \
|
|
INSTALL_UNCOMPRESSED=yes subdirs='$(sorted-subdirs)'
|
|
rm -f $(symbolic-link-list)
|
|
touch $(objpfx)testroot.pristine/install.stamp
|
|
|
|
tests-special-notdir = $(patsubst $(objpfx)%, %, $(tests-special))
|
|
tests: $(tests-special)
|
|
$(..)scripts/merge-test-results.sh -s $(objpfx) "" \
|
|
$(sort $(tests-special-notdir:.out=)) \
|
|
> $(objpfx)subdir-tests.sum
|
|
$(..)scripts/merge-test-results.sh -t $(objpfx) subdir-tests.sum \
|
|
$(sort $(subdirs) .) \
|
|
> $(objpfx)tests.sum
|
|
$(call summarize-tests,tests.sum)
|
|
xtests:
|
|
$(..)scripts/merge-test-results.sh -t $(objpfx) subdir-xtests.sum \
|
|
$(sort $(subdirs)) \
|
|
> $(objpfx)xtests.sum
|
|
$(call summarize-tests,xtests.sum, for extra tests)
|
|
|
|
# The realclean target is just like distclean for the parent, but we want
|
|
# the subdirs to know the difference in case they care.
|
|
realclean distclean: parent-clean
|
|
# This is done this way rather than having `subdir_distclean' be a
|
|
# dependency of this target so that libc.a will be removed before the
|
|
# subdirectories are dealt with and so they won't try to remove object
|
|
# files from it when it's going to be removed anyway.
|
|
@$(MAKE) distclean-1 no_deps=t distclean-1=$@ avoid-generated=yes \
|
|
sysdep-subdirs="$(sysdep-subdirs)"
|
|
-rm -f $(postclean)
|
|
|
|
# Subroutine of distclean and realclean.
|
|
distclean-1: subdir_$(distclean-1)
|
|
-rm -f $(config-generated)
|
|
-rm -f $(addprefix $(objpfx),config.status config.cache config.log)
|
|
-rm -f $(addprefix $(objpfx),config.make config-name.h config.h)
|
|
ifdef objdir
|
|
-rm -f $(objpfx)Makefile
|
|
endif
|
|
-rm -f $(sysdep-$(distclean-1))
|
|
|
|
# Make the TAGS file for Emacs users.
|
|
|
|
.PHONY: TAGS
|
|
TAGS:
|
|
scripts/list-sources.sh | sed -n -e '/Makefile/p' \
|
|
$(foreach S,[chsSyl] cxx sh bash pl,\
|
|
$(subst .,\.,-e '/.$S\(.in\)*$$/p')) \
|
|
| $(ETAGS) -o $@ -
|
|
|
|
# Make the distribution tarfile.
|
|
.PHONY: dist dist-prepare
|
|
|
|
generated := $(generated) stubs.h
|
|
|
|
files-for-dist := README INSTALL configure NEWS
|
|
|
|
# Regenerate stuff, then error if these things are not committed yet.
|
|
dist-prepare: $(files-for-dist)
|
|
conf=`find sysdeps -name configure`; \
|
|
$(MAKE) $$conf && \
|
|
git diff --stat HEAD -- $^ $$conf \
|
|
| $(AWK) '{ print; rc=1 } END { exit rc }'
|
|
|
|
%.tar: FORCE
|
|
git archive --prefix=$*/ $* > $@.new
|
|
mv -f $@.new $@
|
|
|
|
# Do `make dist dist-version=X.Y.Z' to make tar files of an older version.
|
|
|
|
ifneq (,$(strip $(dist-version)))
|
|
dist: $(foreach Z,.bz2 .gz .xz,$(dist-version).tar$Z)
|
|
md5sum $^
|
|
else
|
|
dist: dist-prepare
|
|
@if v=`git describe`; then \
|
|
echo Distribution version $$v; \
|
|
$(MAKE) dist dist-version=$$v; \
|
|
else \
|
|
false; \
|
|
fi
|
|
endif
|
|
|
|
INSTALL: manual/install-plain.texi manual/macros.texi \
|
|
$(common-objpfx)manual/pkgvers.texi manual/install.texi
|
|
makeinfo --no-validate --plaintext --no-number-sections \
|
|
--disable-encoding -I$(common-objpfx)manual $< -o $@-tmp
|
|
$(AWK) 'NF == 0 { ++n; next } \
|
|
NF != 0 { while (n-- > 0) print ""; n = 0; print }' \
|
|
< $@-tmp > $@-tmp2
|
|
rm -f $@-tmp
|
|
-chmod a-w $@-tmp2
|
|
mv -f $@-tmp2 $@
|
|
$(common-objpfx)manual/%: FORCE
|
|
$(MAKE) $(PARALLELMFLAGS) -C manual $@
|
|
FORCE:
|
|
|
|
iconvdata/% localedata/% po/%: FORCE
|
|
$(MAKE) $(PARALLELMFLAGS) -C $(@D) $(@F)
|
|
|
|
# Convenience target to rerun one test, from the top of the build tree
|
|
# Example: make test t=wcsmbs/test-wcsnlen
|
|
.PHONY: test
|
|
test :
|
|
@-rm -f $(objpfx)$t.out
|
|
$(MAKE) subdir=$(patsubst %/,%,$(dir $t)) -C $(dir $t) ..=../ $(objpfx)$t.out
|
|
@cat $(objpfx)$t.test-result
|
|
@cat $(objpfx)$t.out
|