Skip to content

Tiered storage not offloading HASH values – Enabled experimental hash support #6799

@jahnavilatha589

Description

@jahnavilatha589

I am testing this feature : #6015

I executed: HSET test abc {{$value}}
The value size is 4098 characters.

Even though tiering is enabled and tiered_experimental_hash_support is set to true, the data is not being offloaded to SSD.

After 151mb reached, server is throwing an out-of-memory error. Is this expected? Shared Info details here.


config get tiered*
 1) "tiered_upload_threshold"
 2) "0.1"
 3) "tiered_storage_write_depth"
 4) "50"
 5) "tiered_offload_threshold"
 6) "0.2"
 7) "tiered_min_value_size"
 8) "64"
 9) "tiered_experimental_cooling"
10) "true"
11) "tiered_experimental_hash_support"
12) "true"

info memory
# Memory
used_memory:159044864
used_memory_human:151.68MiB
used_memory_peak:162538736
used_memory_peak_human:155.01MiB
fibers_stack_vms:655328
fibers_count:11
used_memory_rss:336957440
used_memory_rss_human:321.35MiB
used_memory_peak_rss:162538736
maxmemory:269484032
maxmemory_human:257.00MiB
used_memory_lua:0
object_used_memory:158475376
type_used_memory_hash:158475376
table_used_memory:540408
prime_capacity:13440
expire_capacity:840
num_entries:7690
inline_keys:7690
small_string_bytes:0
pipeline_cache_bytes:0
dispatch_queue_bytes:0
pipeline_queue_bytes:0
dispatch_queue_subscriber_bytes:0
dispatch_queue_peak_bytes:0
client_read_buffer_peak_bytes:8448
tls_bytes:0
snapshot_serialization_bytes:0
commands_squashing_replies_bytes:0
psync_buffer_size:8192
psync_buffer_bytes:137492500
cache_mode:store
maxmemory_policy:noeviction
replication_streaming_buffer_bytes:0
replication_full_sync_buffer_bytes:0


info tiered
# Tiered
tiered_entries:0
tiered_entries_bytes:0
tiered_entries_bytes_human:0B
tiered_total_stashes:88070
tiered_total_fetches:2752
tiered_total_cancels:0
tiered_total_deletes:0
tiered_total_uploads:0
tiered_total_stash_overflows:0
tiered_heap_buf_allocations:2624
tiered_registered_buf_allocations:2886
tiered_allocated_bytes:0
tiered_capacity_bytes:268435456
tiered_pending_read_cnt:0
tiered_pending_stash_cnt:0
tiered_small_bins_cnt:0
tiered_small_bins_entries_cnt:0
tiered_small_bins_filling_bytes:0
tiered_cold_storage_bytes:0
tiered_offloading_steps:169588917
tiered_offloading_stashes:0
tiered_ram_hits:4
tiered_ram_cool_hits:1
tiered_ram_misses:0
tiered_clients_throttled:0
tiered_total_clients_throttled:0

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions