No description
Find a file
Dmitry Ilvokhin ad108d50f1 Extend purging algorithm with peak demand tracking
Implementation inspired by idea described in "Beyond malloc efficiency
to fleet efficiency: a hugepage-aware memory allocator" paper [1].

Primary idea is to track maximum number (peak) of active pages in use
with sliding window and then use this number to decide how many dirty
pages we would like to keep.

We are trying to estimate maximum amount of active memory we'll need in
the near future. We do so by projecting future active memory demand
(based on peak active memory usage we observed in the past within
sliding window) and adding slack on top of it (an overhead is reasonable
to have in exchange of higher hugepages coverage). When peak demand
tracking is off, projection of future active memory is active memory we
are having right now.

Estimation is essentially the same as `nactive_max * (1 + dirty_mult)`.

Peak demand purging algorithm controlled by two config options. Option
`hpa_peak_demand_window_ms` controls duration of sliding window we track
maximum active memory usage in and option `hpa_dirty_mult` controls
amount of slack we are allowed to have as a percent from maximum active
memory usage. By default `hpa_peak_demand_window_ms == 0` now and we
have same behaviour (ratio based purging) that we had before this
commit.

[1]: https://storage.googleapis.com/gweb-research2023-media/pubtools/6170.pdf
2025-03-13 10:12:22 -07:00
.github/workflows Update acitons/checkout and actions/upload-artifact to v4 2024-03-12 12:59:15 -07:00
bin Updated jeprof with more symbols to filter. 2024-10-14 10:31:58 -07:00
build-aux Remove trailing whitespace 2023-06-23 11:58:18 -07:00
doc Update doc to reflect muzzy decay is disabled by default. 2024-10-10 16:41:23 -07:00
doc_internal update PROFILING_INTERNALS.md 2022-10-03 10:48:29 -07:00
include Extend purging algorithm with peak demand tracking 2025-03-13 10:12:22 -07:00
m4 Support C++17 over-aligned allocation 2019-11-22 10:14:16 -08:00
msvc Extend purging algorithm with peak demand tracking 2025-03-13 10:12:22 -07:00
scripts Enable limit-usize-gap in CI tests. 2025-03-06 15:08:13 -08:00
src Extend purging algorithm with peak demand tracking 2025-03-13 10:12:22 -07:00
test Extend purging algorithm with peak demand tracking 2025-03-13 10:12:22 -07:00
.appveyor.yml Enable limit-usize-gap in CI tests. 2025-03-06 15:08:13 -08:00
.autom4te.cfg Disable autom4te cache. 2014-09-02 17:49:29 -07:00
.cirrus.yml Enable limit-usize-gap in CI tests. 2025-03-06 15:08:13 -08:00
.clang-format Add a .clang-format file. 2020-10-02 14:49:56 -07:00
.gitattributes fix git handling of newlines on windows 2014-05-07 18:48:39 -04:00
.gitignore gitignore: Start ignoring clangd dirs. 2024-01-23 17:02:01 -08:00
.travis.yml Enable limit-usize-gap in CI tests. 2025-03-06 15:08:13 -08:00
autogen.sh build: Make autogen.sh accept quoted extra options 2024-01-03 14:20:34 -08:00
ChangeLog Update ChangeLog for 5.3.0. 2022-05-06 11:24:21 -07:00
config.stamp.in Move repo contents in jemalloc/ to top level. 2011-03-31 20:36:17 -07:00
configure.ac Implement process_madvise support. 2025-03-07 15:32:32 -08:00
COPYING Update copyright dates. 2019-01-25 13:25:20 -08:00
INSTALL.md Update the configure cache file example in INSTALL.md 2024-10-10 16:41:48 -07:00
jemalloc.pc.in Expose jemalloc_prefix via pkg-config 2023-09-05 14:30:21 -07:00
Makefile.in Extend purging algorithm with peak demand tracking 2025-03-13 10:12:22 -07:00
README switch to https 2023-03-09 11:44:02 -08:00
run_tests.sh Introduce scripts to run all possible tests 2017-01-30 17:51:57 -08:00
TUNING.md switch to https 2023-03-09 11:44:02 -08:00

jemalloc is a general purpose malloc(3) implementation that emphasizes
fragmentation avoidance and scalable concurrency support.  jemalloc first came
into use as the FreeBSD libc allocator in 2005, and since then it has found its
way into numerous applications that rely on its predictable behavior.  In 2010
jemalloc development efforts broadened to include developer support features
such as heap profiling and extensive monitoring/tuning hooks.  Modern jemalloc
releases continue to be integrated back into FreeBSD, and therefore versatility
remains critical.  Ongoing development efforts trend toward making jemalloc
among the best allocators for a broad range of demanding applications, and
eliminating/mitigating weaknesses that have practical repercussions for real
world applications.

The COPYING file contains copyright and licensing information.

The INSTALL file contains information on how to configure, build, and install
jemalloc.

The ChangeLog file contains a brief summary of changes for each release.

URL: https://jemalloc.net/