[PATCHv2 0/3] zram: optimal post-processing target selection

Sergey Senozhatsky posted 3 patches 2 months, 3 weeks ago
There is a newer version of this series
drivers/block/zram/zram_drv.c | 279 ++++++++++++++++++++++++++++------
drivers/block/zram/zram_drv.h |   1 +
2 files changed, 235 insertions(+), 45 deletions(-)
[PATCHv2 0/3] zram: optimal post-processing target selection
Posted by Sergey Senozhatsky 2 months, 3 weeks ago
Problem:
--------
Both recompression and writeback perform a very simple linear scan
of all zram slots in search for post-processing (writeback or
recompress) candidate slots.  This often means that we pick the
worst candidate for pp (post-processing), e.g. a 48 bytes object for
writeback, which is nearly useless, because it only releases 48
bytes from zsmalloc pool, but consumes an entire 4K slot in the
backing device.  Similarly, recompression of an 48 bytes objects
is unlikely to save more memory that recompression of a 3000 bytes
object.  Both recompression and writeback consume constrained
resources (CPU time, batter, backing device storage space) and
quite often have a (daily) limit on the number of items they
post-process, so we should utilize those constrained resources in
the most optimal way.

Solution:
---------
This patch reworks the way we select pp targets.  We, quite clearly,
want to sort all the candidates and always pick the largest, be it
recompression or writeback.  Especially for writeback, because the
larger object we writeback the more memory we release.  This series
introduces concept of pp buckets and pp scan/selection.

The scan step is a simple iteration over all zram->table entries,
just like what we currently do, but we don't post-process a candidate
slot immediately.  Instead we assign it to a PP (post-processing)
bucket.  PP bucket is, basically, a list which holds pp candidate
slots that belong to the same size class.  PP buckets are 64 bytes
apart, slots are not strictly sorted within a bucket there is a
64 bytes variance.

The select step simply iterates over pp buckets from highest to lowest
and picks all candidate slots a particular buckets contains.  So this
gives us sorted candidates (in linear time) and allows us to select
most optimal (largest) candidates for post-processing first.

v2..v1:
-- clear PP_SLOT when slot is accessed
-- kmalloc pp_ctl instead of keeoing it on the stack
-- increase the number of pp-buckets and rework the way it's defined
-- code reshuffle and refactoring

Sergey Senozhatsky (3):
  zram: introduce ZRAM_PP_SLOT flag
  zram: rework recompress target selection strategy
  zram: rework writeback target selection strategy

 drivers/block/zram/zram_drv.c | 279 ++++++++++++++++++++++++++++------
 drivers/block/zram/zram_drv.h |   1 +
 2 files changed, 235 insertions(+), 45 deletions(-)

--
2.46.0.469.g59c65b2a67-goog
Re: [PATCHv2 0/3] zram: optimal post-processing target selection
Posted by Sergey Senozhatsky 2 months, 3 weeks ago
On (24/09/08 20:45), Sergey Senozhatsky wrote:
> v2..v1:
> -- clear PP_SLOT when slot is accessed
> -- kmalloc pp_ctl instead of keeoing it on the stack
> -- increase the number of pp-buckets and rework the way it's defined
> -- code reshuffle and refactoring

Folks, ignore this series for now, I'm working on v3.