redis cluster集群搭建
1、环境说明
系统版本：CentOS Linux release 7.2.1511 (Core)
Redis 版本：3.2.5
Ruby 版本：2.4.4
数据目录：/data/redis/{6379,6380,6381}/
安装位置：/data/software/
日志目录：/data/logs/redis/{6379,6380,6381}/
端口：1.247： 6379 6380 6381 :1.248： 6379 6380 6381
2、创建 redis 数据目录，日志目录
mkdir -p /data/redis/{6379,6380,6381}
mkdir -p /data/logs/redis/{6379,6380,6381}
3、安装 ruby 及 redis 模块
3.1 安装 rvm：
gpg --keyserver hkp://keys.gnupg.net --recv-keys 409B6B1796C275462A1703113804BB82D39DC0E3 7D2BAF1CF37B13E2069D6956105BD0E739499BDB
curl -sSL https://get.rvm.io | bash -s stable
source /usr/local/rvm/bin/ruby-rvm-env
source /etc/profile.d/rvm.sh
备注：第一步如因网络问题导致失败，可多尝试几次
参考：http://rvm.io/
3.2 安装ruby
查看 rvm 库中已知的 ruby 版本，安装一个较新 ruby 版本：
rvm list known
rvm install 2.4
3.3安装 redis 模块：
gem install redis
4. 安装Redis
4.1 下载redis
cd /data/software/
wget http://download.redis.io/releases/redis-3.2.5.tar.gz
4.2 解压安装redis
tar xf redis-3.2.5.tar.gz
cd redis-3.2.5
make && make install
cd utils/
+./install_server.sh
Welcome to the redis service installer
This script will help you easily set up a running redis server
.......
Starting Redis server...
Installation successful!
备注：执行install_server.sh脚本后，一路回车即可，或者根据需要修改相关配置，脚本执行完毕后会自动启动实例，此时先停止实例，继续修改配置文件。
关闭redisl
/etc/init.d/redis_6379 stop
5.修改配置文件，并启动多实例
5.1 修改redis-cluster配置参数
bind 192.168.1.247
appendonly yes
cluster-enabled yes
cluster-config-file /data/tools/redis/conf/6379-node.conf
cluster-node-timeout 15000
cluster-slave-validity-factor 10 master
cluster-migration-barrier 1
cluster-require-full-coverage no
5.2 创建多实例
修改配置文件和启动文件中的端口即可。其他配置一样，注意数据目录和配置目录要创建好
以下为2启动程序和配置文件的示例，修改端口即可。
6379启动程序
#!/bin/sh
#Configurations injected by install_server below....
EXEC=/usr/local/bin/redis-server
CLIEXEC=/usr/local/bin/redis-cli
PIDFILE=/var/run/redis_6379.pid
CONF="/data/tools/redis/conf/6379/6379.conf"
REDISPORT="6379"
###############
# SysV Init Information
# chkconfig: - 58 74
# description: redis_6379 is the redis daemon.
### BEGIN INIT INFO
# Provides: redis_6379
# Required-Start: $network $local_fs $remote_fs
# Required-Stop: $network $local_fs $remote_fs
# Default-Start: 2 3 4 5
# Default-Stop: 0 1 6
# Should-Start: $syslog $named
# Should-Stop: $syslog $named
# Short-Description: start and stop redis_6379
# Description: Redis daemon
### END INIT INFO
case "$1" in
start)
if [ -f $PIDFILE ]
then
echo "$PIDFILE exists, process is already running or crashed"
else
echo "Starting Redis server..."
$EXEC $CONF
fi
;;
stop)
if [ ! -f $PIDFILE ]
then
echo "$PIDFILE does not exist, process is not running"
else
PID=$(cat $PIDFILE)
echo "Stopping ..."
$CLIEXEC -p $REDISPORT shutdown
while [ -x /proc/${PID} ]
do
echo "Waiting for Redis to shutdown ..."
sleep 1
done
echo "Redis stopped"
fi
;;
status)
PID=$(cat $PIDFILE)
if [ ! -x /proc/${PID} ]
then
echo 'Redis is not running'
else
echo "Redis is running ($PID)"
fi
;;
restart)
$0 stop
$0 start
;;
*)
echo "Please use start, stop, restart or status as first argument"
;;
esac
6379配置文件
bind 192.168.1.248
protected-mode yes
port 6379
tcp-backlog 511
timeout 0
tcp-keepalive 300
daemonize yes
supervised no
pidfile /var/run/redis.pid
loglevel notice
logfile "/data/logs/redis/6379/redis.log"
databases 16
save ""
stop-writes-on-bgsave-error yes
rdbcompression yes
rdbchecksum yes
dbfilename dump.rdb
dir /data/redis/6379
slave-serve-stale-data yes
slave-read-only yes
repl-diskless-sync no
repl-diskless-sync-delay 5
repl-disable-tcp-nodelay no
slave-priority 100
maxmemory 4gb
appendonly yes
appendfilename "appendonly.aof"
appendfsync everysec
no-appendfsync-on-rewrite no
auto-aof-rewrite-percentage 100
auto-aof-rewrite-min-size 64mb
aof-load-truncated yes
lua-time-limit 5000
cluster-enabled yes
cluster-config-file /data/tools/redis/conf/6379/6379-node.conf
cluster-node-timeout 5000
slowlog-log-slower-than 10000
slowlog-max-len 128
latency-monitor-threshold 0
notify-keyspace-events ""
hash-max-ziplist-entries 512
hash-max-ziplist-value 64
list-max-ziplist-size -2
list-compress-depth 0
set-max-intset-entries 512
zset-max-ziplist-entries 128
zset-max-ziplist-value 64
hll-sparse-max-bytes 3000
activerehashing yes
client-output-buffer-limit normal 0 0 0
client-output-buffer-limit slave 256mb 64mb 60
client-output-buffer-limit pubsub 32mb 8mb 60
hz 10
aof-rewrite-incremental-fsync yes
5.3 启动redis，2台机器分别执行
/etc/init.d/redis_6379 start
/etc/init.d/redis_6380 start
/etc/init.d/redis_6381 start
6、启动redis-cluster
6.1 初始化redis-cluster
redis-trib.rb create --replicas 1 192.168.1.247:6379 192.168.1.247:6380 192.168.1.247:6381 192.168.1.248:6379 192.168.1.248:6380 192.168.1.248:6381
6.2 基本测试，命令行进入cluster 需要 加上-c参数，由于bind了IP，因此此处要-h 指定ip
redis-cli -c -h 192.168.1.247
192.168.1.247:6379> cluster info
cluster_state:ok
cluster_slots_assigned:16384
cluster_slots_ok:16384
cluster_slots_pfail:0
cluster_slots_fail:0
cluster_known_nodes:6
cluster_size:3
cluster_current_epoch:6
cluster_my_epoch:1
cluster_stats_messages_sent:57818
cluster_stats_messages_received:57818
192.168.1.247:6379>
从上可以看出，节点状态是ok，有6个节点。此命令也可用于监控redis-cluster的集群状态。
监控脚本
redis-cli -c -h 192.168.1.247 cluster info|grep 'cluster_state:ok'|wc -l