OSchip
/
llvm-project
mirror of https://github.com/THU-DSP-LAB/llvm-project.git
13
0
Fork 6
Code Issues Packages Projects Releases Wiki Activity
llvm-project/llvm/lib/Support
History
Fangrui Song 3b4d800911 [ELF] Parallelize writes of different OutputSections 
We currently process one OutputSection at a time and for each OutputSection
write contained input sections in parallel. This strategy does not leverage
multi-threading well. Instead, parallelize writes of different OutputSections.

The default TaskSize for parallelFor often leads to inferior sharding. We
prepare the task in the caller instead.

* Move llvm::parallel::detail::TaskGroup to llvm::parallel::TaskGroup
* Add llvm::parallel::TaskGroup::execute.
* Change writeSections to declare TaskGroup and pass it to writeTo.

Speed-up with --threads=8:

* clang -DCMAKE_BUILD_TYPE=Release: 1.11x as fast
* clang -DCMAKE_BUILD_TYPE=Debug: 1.10x as fast
* chrome -DCMAKE_BUILD_TYPE=Release: 1.04x as fast
* scylladb build/release: 1.09x as fast

On M1, many benchmarks are a small fraction of a percentage faster. Mozilla showed the largest difference with the patch being about 1.03x as fast.

Differential Revision: https://reviews.llvm.org/D131247
 		2022-08-24 09:40:03 -07:00
..
BLAKE3 [Support/BLAKE3] Fix error in prior commit, apply `-mavx512vl` for `blake3_avx512_x86-64_unix.S` when including it 2022-06-22 10:51:19 -07:00
Unix [llvm] Fix assertion when stat fails in remove_directories 2022-08-12 11:32:04 -07:00
Windows [Support] Fix Windows dump file hang with multi-threaded crashes 2022-07-08 10:31:35 +01:00
AArch64TargetParser.cpp [llvm][AArch64] Generate getExtensionFeatures from the list of extensions 2022-04-11 13:42:24 +00:00
ABIBreak.cpp
…
AMDGPUMetadata.cpp
…
APFixedPoint.cpp [APInt] Remove all uses of zextOrSelf, sextOrSelf and truncOrSelf 2022-05-19 11:23:13 +01:00
APFloat.cpp [llvm] LLVM_FALLTHROUGH => [[fallthrough]]. NFC 2022-08-08 11:24:15 -07:00
APInt.cpp [ISel] Match all bits when merge undefs for DAG combine 2022-07-01 09:09:43 +08:00
APSInt.cpp
…
ARMAttributeParser.cpp [ARM] Fix bug in also_compatible_with attribute parser 2022-08-22 09:40:37 +01:00
ARMBuildAttrs.cpp Ensure newlines at the end of files (NFC) 2022-08-20 21:18:23 -07:00
ARMTargetParser.cpp [ARM][AArch64] Introduce Armv9.3-A 2022-01-03 12:40:43 +00:00
ARMWinEH.cpp [llvm-readobj] Improve printing of Windows ARM packed unwind info 2022-05-18 21:33:08 +03:00
AddressRanges.cpp [Reland][DebugInfo][llvm-dwarfutil] Combine overlapped address ranges. 2022-07-21 14:15:39 +03:00
Allocator.cpp
…
Atomic.cpp
…
AutoConvert.cpp
…
BinaryStreamError.cpp [NFC] Additional header dependency cleanup LLVMSupport 2022-01-26 11:16:15 +01:00
BinaryStreamReader.cpp [Support] Convert BinaryStream class zoo to 64-bit offsets 2021-09-16 19:14:52 -04:00
BinaryStreamRef.cpp [Support] Convert BinaryStream class zoo to 64-bit offsets 2021-09-16 19:14:52 -04:00
BinaryStreamWriter.cpp [iwyu] Handle regressions in libLLVM header include 2022-05-26 08:12:34 +02:00
BlockFrequency.cpp [llvm] Cleanup header dependencies in ADT and Support 2022-01-21 13:54:49 +01:00
BranchProbability.cpp
…
BuryPointer.cpp
…
CMakeLists.txt [Support] Handle SPARC in sys::getHostCPUName 2022-07-27 12:21:03 +02:00
COM.cpp
…
COPYRIGHT.regex
…
CRC.cpp
…
CSKYAttributeParser.cpp Use range-based for loops (NFC) 2022-08-20 21:18:32 -07:00
CSKYAttributes.cpp [Support] Add CSKY target parser and attributes parser 2022-02-28 11:35:07 +08:00
CSKYTargetParser.cpp [CSKY] Fix the conflict of default fpu features and -mfpu option 2022-05-23 10:44:55 +08:00
CachePruning.cpp
…
Caching.cpp [Support] [DebugInfo] Lazily create cache dir. 2022-01-20 19:27:15 +00:00
Chrono.cpp
…
CodeGenCoverage.cpp [llvm] Use = default (NFC) 2022-02-06 22:18:35 -08:00
CommandLine.cpp [llvm] LLVM_FALLTHROUGH => [[fallthrough]]. NFC 2022-08-08 11:24:15 -07:00
Compression.cpp [llvm] add zstd to `llvm::compression` namespace 2022-07-19 10:54:36 -07:00
ConvertUTF.cpp Update license on Unicode.org's ConvertUTF code. 2022-08-12 16:51:08 +00:00
ConvertUTFWrapper.cpp Re-land c346068928 with fixes 2022-03-23 08:13:17 -04:00
CrashRecoveryContext.cpp ManagedStatic: remove from CrashRecoveryContext 2022-08-03 14:35:30 +02:00
DAGDeltaAlgorithm.cpp [llvm] Cleanup header dependencies in ADT and Support 2022-01-21 13:54:49 +01:00
DJB.cpp
…
DataExtractor.cpp [llvm] Cleanup header dependencies in ADT and Support 2022-01-21 13:54:49 +01:00
Debug.cpp Revert "[Support] Remove redundant declaration setCurrentDebugTypes (NFC)" 2022-07-16 17:19:27 -07:00
DebugCounter.cpp Remove unneeded cl::ZeroOrMore for cl::opt/cl::list options 2022-06-05 01:07:51 -07:00
DebugOptions.h Ensure newlines at the end of files (NFC) 2021-10-23 08:45:29 -07:00
DeltaAlgorithm.cpp [llvm] Use = default (NFC) 2022-02-06 22:18:35 -08:00
DivisionByConstantInfo.cpp [Support][CodeGen] Fix spelling Divison->Division. NFC 2022-07-17 23:16:29 -07:00
DynamicLibrary.cpp Revert "ManagedStatic: remove from DynamicLibrary" 2022-08-03 17:56:46 +02:00
ELFAttributeParser.cpp [ARM] Fix bug in also_compatible_with attribute parser 2022-08-22 09:40:37 +01:00
ELFAttributes.cpp
…
Errno.cpp Cleanup include: TableGen 2022-03-11 11:41:32 +01:00
Error.cpp ManagedStatic: remove many straightforward uses in llvm 2022-07-10 10:29:15 +02:00
ErrorHandling.cpp fix tests after my commit 80b3dcc045 2022-05-30 19:44:06 +01:00
ExtensibleRTTI.cpp [llvm][clang][NFC] updates inline licence info 2021-08-11 02:48:53 +00:00
FileCollector.cpp
…
FileOutputBuffer.cpp [llvm] Cleanup header dependencies in ADT and Support 2022-01-21 13:54:49 +01:00
FileUtilities.cpp [llvm-objcopy][NFC] refactor restoreStatOnFile out of llvm-objcopy. 2022-04-22 20:06:01 +03:00
FoldingSet.cpp [llvm] LLVM_FALLTHROUGH => [[fallthrough]]. NFC 2022-08-08 11:24:15 -07:00
FormatVariadic.cpp [llvm] Don't use Optional::hasValue (NFC) 2022-06-20 10:38:12 -07:00
FormattedStream.cpp [llvm] LLVM_FALLTHROUGH => [[fallthrough]]. NFC 2022-08-08 11:24:15 -07:00
GlobPattern.cpp [llvm] LLVM_FALLTHROUGH => [[fallthrough]]. NFC 2022-08-08 11:24:15 -07:00
GraphWriter.cpp [llvm] LLVM_FALLTHROUGH => [[fallthrough]]. NFC 2022-08-08 11:24:15 -07:00
Hashing.cpp
…
Host.cpp [Support] computeHostNumPhysicalCores: use sched_getaffinity for all non-Android Linux with no custom implementation 2022-08-13 01:36:13 -07:00
InitLLVM.cpp Add ms-specific missing header in Support/InitLLVM.cpp 2022-01-21 14:28:47 +01:00
InstructionCost.cpp
…
IntEqClasses.cpp
…
IntervalMap.cpp
…
ItaniumManglingCanonicalizer.cpp Revert "Use std::is_same_v instead of std::is_same (NFC)" 2022-08-20 23:00:39 -07:00
JSON.cpp [llvm][json] Fix UINT64 json parsing 2022-05-17 09:11:45 -07:00
KnownBits.cpp [llvm] Don't use Optional::getValue (NFC) 2022-06-20 22:45:45 -07:00
LEB128.cpp
…
LineIterator.cpp [Support] Use default member initialization (NFC) 2022-06-18 15:46:09 -07:00
Locale.cpp
…
LockFileManager.cpp [libc++] Remove unused macro in __config 2021-09-23 13:09:32 -04:00
LowLevelType.cpp [MachineValueType] Don't allow MVT::getVectorNumElements() to be called for scalable vectors. 2022-01-13 09:16:25 -08:00
MD5.cpp [Support/Hash functions] Change the `final()` and `result()` of the hashing functions to return an array of bytes 2022-04-05 21:38:06 -07:00
MSP430AttributeParser.cpp [llvm] Cleanup header dependencies in ADT and Support 2022-01-21 13:54:49 +01:00
MSP430Attributes.cpp [llvm-readobj] Support dumping of MSP430 ELF attributes 2021-09-28 00:56:11 +03:00
ManagedStatic.cpp
…
MathExtras.cpp Cleanup include: TableGen 2022-03-11 11:41:32 +01:00
MemAlloc.cpp [Support] #include <new> for std::align_val_t 2022-01-25 19:40:00 +01:00
Memory.cpp Cleanup include: TableGen 2022-03-11 11:41:32 +01:00
MemoryBuffer.cpp Fix issing header on z/OS 2022-03-14 17:29:08 +01:00
MemoryBufferRef.cpp
…
NativeFormatting.cpp Revert "[Support] Workaround compiler bug in MSVC" 2022-07-26 15:49:35 -07:00
OptimizedStructLayout.cpp Fix a bug in OptimizedStructLayout when filling gaps before 2021-07-21 15:47:18 -04:00
Optional.cpp
…
Parallel.cpp [ELF] Parallelize writes of different OutputSections 2022-08-24 09:40:03 -07:00
Path.cpp LLVM Driver Multicall tool 2022-06-06 04:27:32 +00:00
PluginLoader.cpp ManagedStatic: remove from PluginLoader 2022-08-03 10:41:58 +02:00
PrettyStackTrace.cpp Add apple-specific missing include 2022-01-21 14:18:29 +01:00
Process.cpp [llvm] Use value instead of getValue (NFC) 2022-07-13 23:11:56 -07:00
Program.cpp Cleanup include: TableGen 2022-03-11 11:41:32 +01:00
RISCVAttributeParser.cpp Use range-based for loops (NFC) 2022-08-20 21:18:32 -07:00
RISCVAttributes.cpp Use ManagedStatic and lazy initialization of cl::opt in libSupport to make it free of global initializer 2021-07-16 07:38:16 +00:00
RISCVISAInfo.cpp [RISCV] Add zihintntl instructions 2022-08-22 12:06:30 +08:00
RWMutex.cpp
…
RandomNumberGenerator.cpp Use ManagedStatic and lazy initialization of cl::opt in libSupport to make it free of global initializer 2021-07-16 07:38:16 +00:00
Regex.cpp [llvm] Use range-based for loops (NFC) 2021-12-02 09:27:47 -08:00
SHA1.cpp [Support/Hash functions] Change the `final()` and `result()` of the hashing functions to return an array of bytes 2022-04-05 21:38:06 -07:00
SHA256.cpp [Support/Hash functions] Change the `final()` and `result()` of the hashing functions to return an array of bytes 2022-04-05 21:38:06 -07:00
ScaledNumber.cpp
…
ScopedPrinter.cpp Replace to_hexString by touhexstr [NFC] 2022-06-16 17:29:50 +02:00
Signals.cpp [libSupport] make CallBacksToRun static local 2022-03-19 20:31:04 +00:00
Signposts.cpp Change the LLVM signpost category 2022-04-05 12:18:31 -07:00
SmallPtrSet.cpp [llvm] Cleanup header dependencies in ADT and Support 2022-01-21 13:54:49 +01:00
SmallVector.cpp [llvm] Cleanup header dependencies in ADT and Support 2022-01-21 13:54:49 +01:00
SourceMgr.cpp [PDLL] Add support for tablegen includes and importing ODS information 2022-03-03 16:14:03 -08:00
SpecialCaseList.cpp [llvm] Use = default (NFC) 2022-02-06 22:18:35 -08:00
Statistic.cpp [Support] Drop unnecessary const from a return type (NFC) 2022-08-14 12:51:56 -07:00
StringExtras.cpp [llvm] Use range-based for loops (NFC) 2021-12-02 09:27:47 -08:00
StringMap.cpp [NFC][llvm][StringMap]Extract createTable and getHashTable functions and add the inline attribute to the getMinBucketToReserveForEntries function. 2022-03-23 10:09:59 +08:00
StringRef.cpp [ADT] Add edit_distance_insensitive to StringRef 2022-06-05 12:03:09 +01:00
StringSaver.cpp
…
SuffixTree.cpp
…
SymbolRemappingReader.cpp [llvm] Cleanup header dependencies in ADT and Support 2022-01-21 13:54:49 +01:00
SystemUtils.cpp
…
TarWriter.cpp
…
TargetParser.cpp [RISCV] Change how mtune aliases are implemented. 2022-08-18 16:22:25 -07:00
ThreadLocal.cpp
…
ThreadPool.cpp [ThreadPool] delete debug global variable if not needed 2022-05-04 08:12:45 +02:00
Threading.cpp Remove redundant initialization of Optional (NFC) 2022-08-20 21:18:28 -07:00
TimeProfiler.cpp ManagedStatic: remove from TimeProfiler 2022-08-03 10:41:58 +02:00
Timer.cpp [llvm] Use llvm::reverse (NFC) 2021-11-06 19:31:18 -07:00
ToolOutputFile.cpp [llvm] Cleanup header dependencies in ADT and Support 2022-01-21 13:54:49 +01:00
TrigramIndex.cpp TrigramIndex.h - move unnecessary StringRef include down to TrigramIndex.cpp 2022-02-02 16:29:47 +00:00
Triple.cpp [llvm] LLVM_FALLTHROUGH => [[fallthrough]]. NFC 2022-08-08 11:24:15 -07:00
Twine.cpp Consolidate string types into ptr and length representations. 2021-07-20 13:29:57 -07:00
TypeSize.cpp Remove unneeded cl::ZeroOrMore for cl::opt/cl::list options 2022-06-05 01:07:51 -07:00
Unicode.cpp [Clang][NFC] fix typo 2022-07-06 16:05:23 +02:00
UnicodeCaseFold.cpp
…
UnicodeNameToCodepoint.cpp [Support] Work around an issue when building with old versions of libstdc++ 2022-06-26 12:55:51 +02:00
UnicodeNameToCodepointGenerated.cpp [Clang][C++23] P2071 Named universal character escapes 2022-06-25 19:03:33 +02:00
Valgrind.cpp Work around a Clang modules build issue. 2022-01-31 12:03:00 -08:00
VersionTuple.cpp
…
VirtualFileSystem.cpp [llvm] LLVM_FALLTHROUGH => [[fallthrough]]. NFC 2022-08-08 11:24:15 -07:00
Watchdog.cpp
…
WithColor.cpp [Support] Allow the ability to change WithColor's auto detection function 2022-02-28 20:30:06 -08:00
X86TargetParser.cpp [X86] Add RDPRU instruction 2022-07-06 07:17:47 -07:00
YAMLParser.cpp [llvm] LLVM_FALLTHROUGH => [[fallthrough]]. NFC 2022-08-08 11:24:15 -07:00
YAMLTraits.cpp [llvm][support] Replace `std::vector<bool>` use in YAMLTraits 2022-01-26 11:20:18 +01:00
Z3Solver.cpp [analyzer] Fix include typo introduced by e61a1a9 2022-03-11 16:09:25 +01:00
circular_raw_ostream.cpp
…
raw_os_ostream.cpp
…
raw_ostream.cpp [llvm] LLVM_FALLTHROUGH => [[fallthrough]]. NFC 2022-08-08 11:24:15 -07:00
regcomp.c [Support] unsafe pointer arithmetic in llvm_regcomp() 2022-02-03 19:59:27 -05:00
regengine.inc [Support] Optimize (.*) regex matches 2022-04-19 09:55:21 +02:00
regerror.c
…
regex2.h
…
regex_impl.h
…
regexec.c
…
regfree.c
…
regstrlcpy.c
…
regutils.h
…
xxhash.cpp Cleanup include: TableGen 2022-03-11 11:41:32 +01:00