HiveBrain v1.2.0
Get Started
← Back to all entries
patternMinor

if the bottle neck is the number of connections, is it better to scale redis by sharding or by replication?

Submitted by: @import:stackexchange-devops··
0
Viewed 0 times
redisnumberthebottlebetterreplicationneckscaleshardingconnections

Problem

Background

last week we had a major outage, we identified the bottle neck to be redis number of connections:

Our quick fix was to scale redis from cache.m4.4xlarge to chache.m4.10xlarge (vertical scaling)

However this scaling is quite expensive:

we would like to scale horizontally:

Unfortunately, the application code we are using now only allows us to either create a redis cluster with multiple shards, or using a single shard with multiple replicas (see discussion here).

Question

considering that our bottle neck is the connection limit, would it be getter to scale by clustering and increasing the shard number, or by having a single shard and replicating it?

Solution

Redis Cluster could be considered as an OOTB solution for the Scalability requirements. There is another interesting open source library known as Redis Shard for sharding implementations on Redis. Please find the GitHub repository here.

Context

StackExchange DevOps Q#9078, answer score: 1

Revisions (0)

No revisions yet.