一、需求说明
最近一直在学习mysql-mmm，想以后这个架构也能用在我们公司的业务上，我们公司的业务是单机多实例部署，所以也想把mysql-mmm部署成这样，功夫不负有心人，我成功了，和大家分享一下：
二、环境说明
| 集群 | 角色 | 主机名 | IP | Mysql Port | Server ID | VIP Writer | VIP READER |
| navy2 | Agent | db1 | 172.28.26.101 | 3307 | 11 | 172.28.26.107 | |
| navy3 |
Agent
|
db2 | 172.28.26.102 | 3308 | 1 | |
172.28.26.110
|
| navy2 |
Agent
|
db1 |
172.28.26.101
|
3307 | 22 | |
172.28.26.108
|
| navy3 |
Agent
|
db2 |
172.28.26.102
|
3308 | 2 |
172.28.26.109
|
|
| navy2/navy3 | Monitor |
Monitor
|
172.28.26.103
|
| | | |
PS：db1和db2上分别有两个库navy2和navy3，互为主主，172.28.26.107是navy2的写入虚拟IP，172.28.26.108是navy2的读虚拟IP，172.28.26.109是navy2的写入虚拟IP，172.28.26.110是navy3的读虚拟IP。
三、部署
1、mysql和mysql-mmm的安装及mysql的主从配置请查看前面的博文：http://navyaijm.blog.51cto.com/4647068/1230674，这里只介绍mmm多实例配置。
2、db1上：
vi /etc/mysql-mmm/mmm_common_navy2.conf（navy2的配置文件）
1 vi /etc/mysql-mmm/mmm_common_navy2.conf 2 active_master_role writer 3 <host default> 4 cluster_interface eth1 5 agent_port 9912 6 mysql_port 3307 7 pid_path /var/run/mysql-mmm/mmm_agentd_navy2.pid 8 bin_path /usr/libexec/mysql-mmm/ 9 replication_user slave 10 replication_password 123456 11 agent_user mmm_agent 12 agent_password 123456 13 </host> 14 <host db1> 15 ip 172.28.26.101 16 mysql_port 3307 17 mode master 18 peer db2 19 </host> 20 <host db2> 21 ip 172.28.26.102 22 mysql_port 3307 23 mode master 24 peer db1 25 </host> 26 <role writer> 27 hosts db1, db2 28 ips 172.28.26.107 29 mode exclusive 30 </role> 31 <role reader> 32 hosts db1, db2 33 ips 172.28.26.108 34 mode balanced 35 </role>
vi /etc/mysql-mmm/mmm_common_navy3.conf（navy的配置文件）
1 active_master_role writer 2 <host default> 3 cluster_interface eth1 4 agent_port 9913 5 mysql_port 3308 6 pid_path /var/run/mysql-mmm/mmm_agentd_navy3.pid 7 bin_path /usr/libexec/mysql-mmm/ 8 replication_user slave 9 replication_password 123456 10 agent_user mmm_agent 11 agent_password 123456 12 </host> 13 <host db1> 14 ip 172.28.26.101 15 mysql_port 3308 16 mode master 17 peer db2 18 </host> 19 <host db2> 20 ip 172.28.26.102 21 mysql_port 3308 22 mode master 23 peer db1 24 </host> 25 <role writer> 26 hosts db1, db2 27 ips 172.28.26.109 28 mode exclusive 29 </role> 30 <role reader> 31 hosts db1, db2 32 ips 172.28.26.110 33 mode balanced 34 </role>
vi /etc/mysql-mmm/mmm_agent_navy2.conf（navy2的agent配置文件）
1 include mmm_common_navy2.conf 2 this db1
vi /etc/mysql-mmm/mmm_agent_navy3.conf（navy3的agent配置文件）
1 include mmm_common_navy3.conf 2 this db1
vi /etc/init.d/mysql-mmm-agent-navy2（navy2的agent启动脚本）
1 #!/bin/sh
2 # chkconfig: - 64 36
3 # description: MMM Agent.
4 # processname: mmm_agentd
5 # config: /etc/mysql-mmm/mmm_agent.conf
6 # pidfile: /var/run/mysql-mmm/mmm_agentd.pid
7 # Source function library and defaults file.
8 . /etc/rc.d/init.d/functions
9 . /etc/default/mysql-mmm-agent
10 # Cluster name (it can be empty for default cases)
11 CLUSTER='navy2'
12 LOCKFILE='/var/lock/subsys/mysql-mmm-agent_navy2'
13 prog='MMM Agent Daemon'
14 #-----------------------------------------------------------------------
15 # Paths
16 if [ "$CLUSTER" != "" ]; then
17 MMMD_AGENT_BIN="/usr/sbin/mmm_agentd @$CLUSTER"
18 MMMD_AGENT_PIDFILE="/var/run/mysql-mmm/mmm_agentd_$CLUSTER.pid"
19 else
20 MMMD_AGENT_BIN="/usr/sbin/mmm_agentd"
21 MMMD_AGENT_PIDFILE="/var/run/mysql-mmm/mmm_agentd.pid"
22 fi
23 start() {
24 if [ "${ENABLED}" != "1" ]; then
25 echo "$prog is disabled!"
26 exit 1
27 fi
28 echo -n "Starting $prog: "
29 if [ -s $MMMD_AGENT_PIDFILE ] && kill -0 `cat $MMMD_AGENT_PIDFILE` 2> /dev/null; then
30 echo " already running."
31 exit 0
32 fi
33 daemon $MMMD_AGENT_BIN
34 RETVAL=$?
35 echo
36 [ $RETVAL = 0 ] && touch $LOCKFILE
37 return $RETVAL
38 }
39 stop() {
40 # Stop daemon.
41 echo -n "Stopping $prog: "
42 killproc -p $MMMD_AGENT_PIDFILE $MMMD_AGENT_BIN
43 RETVAL=$?
44 echo
45 [ $RETVAL = 0 ] && rm -f $LOCKFILE
46 return $RETVAL
47 }
48 case "$1" in
49 start)
50 start
51 ;;
52 stop)
53 stop
54 ;;
55 status)
56 status -p $MMMD_AGENT_PIDFILE $MMMD_AGENT_BIN
57 RETVAL=$?
58 ;;
59 restart|reload)
60 stop
61 start
62 ;;
63 condrestart)
64 if [ -f $LOCKFILE ]; then
65 stop
66 start
67 fi
68 ;;
69 *)
70 echo "Usage: $0 {start|stop|restart|condrestart|status}"
71 ;;
72 esac
73 exit $RETVAL
赋予执行权限：
1 chmod +x /etc/init.d/mysql-mmm-agent-navy2
vi /etc/init.d/mysql-mmm-agent-navy3（navy3的agent启动脚本）
1 #!/bin/sh
2 # chkconfig: - 64 36
3 # description: MMM Agent.
4 # processname: mmm_agentd
5 # config: /etc/mysql-mmm/mmm_agent.conf
6 # pidfile: /var/run/mysql-mmm/mmm_agentd.pid
7 # Source function library and defaults file.
8 . /etc/rc.d/init.d/functions
9 . /etc/default/mysql-mmm-agent
10 ## Paths
11 #MMMD_AGENT_BIN="/usr/sbin/mmm_agentd"
12 #MMMD_AGENT_PIDFILE="/var/run/mysql-mmm/mmm_agentd.pid"
13 #LOCKFILE='/var/lock/subsys/mysql-mmm-agent'
14 #prog='MMM Agent Daemon'
15 # Cluster name (it can be empty for default cases)
16 CLUSTER='navy3'
17 LOCKFILE='/var/lock/subsys/mysql-mmm-agent_navy3'
18 prog='MMM Agent Daemon'
19 #-----------------------------------------------------------------------
20 # Paths
21 if [ "$CLUSTER" != "" ]; then
22 MMMD_AGENT_BIN="/usr/sbin/mmm_agentd @$CLUSTER"
23 MMMD_AGENT_PIDFILE="/var/run/mysql-mmm/mmm_agentd_$CLUSTER.pid"
24 else
25 MMMD_AGENT_BIN="/usr/sbin/mmm_agentd"
26 MMMD_AGENT_PIDFILE="/var/run/mysql-mmm/mmm_agentd.pid"
27 fi
28 start() {
29 if [ "${ENABLED}" != "1" ]; then
30 echo "$prog is disabled!"
31 exit 1
32 fi
33 echo -n "Starting $prog: "
34 if [ -s $MMMD_AGENT_PIDFILE ] && kill -0 `cat $MMMD_AGENT_PIDFILE` 2> /dev/null; then
35 echo " already running."
36 exit 0
37 fi
38 daemon $MMMD_AGENT_BIN
39 RETVAL=$?
40 echo
41 [ $RETVAL = 0 ] && touch $LOCKFILE
42 return $RETVAL
43 }
44 stop() {
45 # Stop daemon.
46 echo -n "Stopping $prog: "
47 killproc -p $MMMD_AGENT_PIDFILE $MMMD_AGENT_BIN
48 RETVAL=$?
49 echo
50 [ $RETVAL = 0 ] && rm -f $LOCKFILE
51 return $RETVAL
52 }
53 case "$1" in
54 start)
55 start
56 ;;
57 stop)
58 stop
59 ;;
60 status)
61 status -p $MMMD_AGENT_PIDFILE $MMMD_AGENT_BIN
62 RETVAL=$?
63 ;;
64 restart|reload)
65 stop
66 start
67 ;;
68 condrestart)
69 if [ -f $LOCKFILE ]; then
70 stop
71 start
72 fi
73 ;;
74 *)
75 echo "Usage: $0 {start|stop|restart|condrestart|status}"
76 ;;
77 esac
78 exit $RETVAL
赋予可执行权限：
1 chmod +x /etc/init.d/mysql-mmm-agent-navy3
启动服务：
1 /etc/init.d/mysql-mmm-agent-navy2 start 2 /etc/init.d/mysql-mmm-agent-navy3 start
3、db2上：
复制db1上的文件到相应的目录下：
1 scp /etc/mysql-mmm/mmm_common_navy2.conf 172.28.26.102:/etc/mysql-mmm/ 2 scp /etc/mysql-mmm/mmm_common_navy3.conf 172.28.26.102:/etc/mysql-mmm/ 3 scp /etc/mysql-mmm/mmm_agent_navy2.conf 172.28.26.102:/etc/mysql-mmm/ 4 scp /etc/mysql-mmm/mmm_agent_navy3.conf 172.28.26.102:/etc/mysql-mmm/ 5 scp /etc/init.d/mysql-mmm-agent-navy2 172.28.26.102:/etc/init.d/ 6 scp /etc/init.d/mysql-mmm-agent-navy3 172.28.26.102:/etc/init.d/
修改agent配置文件：
1 sed -i 's/this db1/this db2/' /etc/mysql-mmm/mmm_agent_navy2.conf 2 sed -i 's/this db1/this db2/' /etc/mysql-mmm/mmm_agent_navy3.conf
赋予可执行权限
1 chmod +x /etc/init.d/mysql-mmm-agent-navy2 2 chmod +x /etc/init.d/mysql-mmm-agent-navy3
启动服务：
1 /etc/init.d/mysql-mmm-agent-navy2 start 2 /etc/init.d/mysql-mmm-agent-navy3 start
4、monitor上
复制db1上的配置文件：
1 scp /etc/mysql-mmm/mmm_common_navy2.conf 172.28.26.103:/etc/mysql-mmm/ 2 scp /etc/mysql-mmm/mmm_common_navy3.conf 172.28.26.103:/etc/mysql-mmm/
vi /etc/mysql-mmm/mmm_mon_navy2.conf
1 include mmm_common_navy2.conf 2 <monitor> 3 ip 127.0.0.1 4 port 9992 5 pid_path /var/run/mysql-mmm/mmm_mond_navy2.pid 6 bin_path /usr/libexec/mysql-mmm 7 status_path /var/lib/mysql-mmm/mmm_mond_navy2.status 8 ping_ips 172.28.26.101,172.28.26.102 9 auto_set_online 10 10 # wait_for_other_master 2 11 # The kill_host_bin does not exist by default, though the monitor will 12 # throw a warning about it missing. See the section 5.10 "Kill Host 13 # Functionality" in the PDF documentation. 14 # 15 # kill_host_bin /usr/libexec/mysql-mmm/monitor/kill_host 16 # 17 </monitor> 18 <host default> 19 monitor_user mmm_monitor 20 monitor_password 123456 21 </host> 22 debug 0
vi /etc/mysql-mmm/mmm_mon_navy3.conf
1 include mmm_common_navy3.conf 2 <monitor> 3 ip 127.0.0.1 4 port 9993 5 pid_path /var/run/mysql-mmm/mmm_mond_navy3.pid 6 bin_path /usr/libexec/mysql-mmm 7 status_path /var/lib/mysql-mmm/mmm_mond_navy3.status 8 ping_ips 172.28.26.101,172.28.26.102 9 auto_set_online 10 10 # wait_for_other_master 2 11 # The kill_host_bin does not exist by default, though the monitor will 12 # throw a warning about it missing. See the section 5.10 "Kill Host 13 # Functionality" in the PDF documentation. 14 # 15 # kill_host_bin /usr/libexec/mysql-mmm/monitor/kill_host 16 # 17 </monitor> 18 <host default> 19 monitor_user mmm_monitor 20 monitor_password 123456 21 </host> 22 debug 0
vi /etc/mysql-mmm/mmm_mon_log_navy2.conf
1 #log4perl.logger = FATAL, MMMLog, MailFatal 2 log4perl.logger = FATAL, MMMLog 3 log4perl.appender.MMMLog = Log::Log4perl::Appender::File 4 log4perl.appender.MMMLog.Threshold = INFO 5 log4perl.appender.MMMLog.filename = /var/log/mysql-mmm/mmm_mond_navy2.log 6 log4perl.appender.MMMLog.recreate = 1 7 log4perl.appender.MMMLog.layout = PatternLayout 8 log4perl.appender.MMMLog.layout.ConversionPattern = %d %5p %m%n 9 #log4perl.appender.MailFatal = Log::Dispatch::Email::MailSender 10 #log4perl.appender.MailFatal.Threshold = FATAL 11 #log4perl.appender.MailFatal.from = mmm@example.com 12 #log4perl.appender.MailFatal.to = root 13 #log4perl.appender.MailFatal.buffered = 0 14 #log4perl.appender.MailFatal.subject = FATAL error in mysql-mmm-monitor 15 #log4perl.appender.MailFatal.layout = PatternLayout 16 #log4perl.appender.MailFatal.layout.ConversionPattern = %d %m%n
vi /etc/mysql-mmm/mmm_mon_log_navy3.conf
1 #log4perl.logger = FATAL, MMMLog, MailFatal 2 log4perl.logger = FATAL, MMMLog 3 log4perl.appender.MMMLog = Log::Log4perl::Appender::File 4 log4perl.appender.MMMLog.Threshold = INFO 5 log4perl.appender.MMMLog.filename = /var/log/mysql-mmm/mmm_mond_navy3.log 6 log4perl.appender.MMMLog.recreate = 1 7 log4perl.appender.MMMLog.layout = PatternLayout 8 log4perl.appender.MMMLog.layout.ConversionPattern = %d %5p %m%n 9 #log4perl.appender.MailFatal = Log::Dispatch::Email::MailSender 10 #log4perl.appender.MailFatal.Threshold = FATAL 11 #log4perl.appender.MailFatal.from = mmm@example.com 12 #log4perl.appender.MailFatal.to = root 13 #log4perl.appender.MailFatal.buffered = 0 14 #log4perl.appender.MailFatal.subject = FATAL error in mysql-mmm-monitor 15 #log4perl.appender.MailFatal.layout = PatternLayout 16 #log4perl.appender.MailFatal.layout.ConversionPattern = %d %m%n
vi /etc/init.d/mysql-mmm-monitor-navy2
1 #!/bin/sh
2 #
3 # mysql-mmm-monitor This shell script takes care of starting and stopping
4 # the mmm monitoring daemon.
5 #
6 # chkconfig: - 64 36
7 # description: MMM Monitor.
8 # processname: mmm_mond
9 # config: /etc/mysql-mmm/mmm_mon.conf
10 # pidfile: /var/run/mysql-mmm/mmm_mond.pid
11 # Source function library and defaults file.
12 . /etc/rc.d/init.d/functions
13 . /etc/default/mysql-mmm-monitor
14 # Cluster name (it can be empty for default cases)
15 CLUSTER='navy2'
16 LOCKFILE='/var/lock/subsys/mysql-mmm-monitor_navy2'
17 prog='MMM Monitor Daemon'
18 if [ "$CLUSTER" != "" ]; then
19 MMMD_MON_BIN="/usr/sbin/mmm_mond @$CLUSTER"
20 MMMD_MON_PIDFILE="/var/run/mysql-mmm/mmm_mond-$CLUSTER.pid"
21 else
22 MMMD_MON_BIN="/usr/sbin/mmm_mond"
23 MMMD_MON_PIDFILE="/var/run/mysql-mmm/mmm_mond.pid"
24 fi
25 start() {
26 if [ "${ENABLED}" != "1" ]; then
27 echo "$prog is disabled!"
28 exit 1
29 fi
30 echo -n "Starting $prog: "
31 if [ -s $MMMD_MON_PIDFILE ] && kill -0 `cat $MMMD_MON_PIDFILE` 2> /dev/null; then
32 echo " already running."
33 exit 0
34 fi
35 daemon $MMMD_MON_BIN
36 RETVAL=$?
37 echo
38 [ $RETVAL = 0 ] && touch $LOCKFILE
39 return $RETVAL
40 }
41 stop() {
42 # Stop daemon.
43 echo -n "Stopping $prog: "
44 killproc -p $MMMD_MON_PIDFILE $MMMD_MON_BIN
45 RETVAL=$?
46 echo
47 [ $RETVAL = 0 ] && rm -f $LOCKFILE
48 return $RETVAL
49 }
50 case "$1" in
51 start)
52 start
53 ;;
54 stop)
55 stop
56 ;;
57 status)
58 status -p $MMMD_MON_PIDFILE $MMMD_MON_BIN
59 RETVAL=$?
60 ;;
61 restart|reload)
62 stop
63 start
64 ;;
65 condrestart)
66 if [ -f $LOCKFILE ]; then
67 stop
68 start
69 fi
70 ;;
71 *)
72 echo "Usage: $0 {start|stop|restart|condrestart|status}"
73 ;;
74 esac
75 exit $RETVAL
vi /etc/init.d/mysql-mmm-monitor-navy3
1 #!/bin/sh
2 #
3 # mysql-mmm-monitor This shell script takes care of starting and stopping
4 # the mmm monitoring daemon.
5 #
6 # chkconfig: - 64 36
7 # description: MMM Monitor.
8 # processname: mmm_mond
9 # config: /etc/mysql-mmm/mmm_mon.conf
10 # pidfile: /var/run/mysql-mmm/mmm_mond.pid
11 # Source function library and defaults file.
12 . /etc/rc.d/init.d/functions
13 . /etc/default/mysql-mmm-monitor
14 # Cluster name (it can be empty for default cases)
15 CLUSTER='navy3'
16 LOCKFILE='/var/lock/subsys/mysql-mmm-monitor_navy3'
17 prog='MMM Monitor Daemon'
18 if [ "$CLUSTER" != "" ]; then
19 MMMD_MON_BIN="/usr/sbin/mmm_mond @$CLUSTER"
20 MMMD_MON_PIDFILE="/var/run/mysql-mmm/mmm_mond-$CLUSTER.pid"
21 else
22 MMMD_MON_BIN="/usr/sbin/mmm_mond"
23 MMMD_MON_PIDFILE="/var/run/mysql-mmm/mmm_mond.pid"
24 fi
25 start() {
26 if [ "${ENABLED}" != "1" ]; then
27 echo "$prog is disabled!"
28 exit 1
29 fi
30 echo -n "Starting $prog: "
31 if [ -s $MMMD_MON_PIDFILE ] && kill -0 `cat $MMMD_MON_PIDFILE` 2> /dev/null; then
32 echo " already running."
33 exit 0
34 fi
35 daemon $MMMD_MON_BIN
36 RETVAL=$?
37 echo
38 [ $RETVAL = 0 ] && touch $LOCKFILE
39 return $RETVAL
40 }
41 stop() {
42 # Stop daemon.
43 echo -n "Stopping $prog: "
44 killproc -p $MMMD_MON_PIDFILE $MMMD_MON_BIN
45 RETVAL=$?
46 echo
47 [ $RETVAL = 0 ] && rm -f $LOCKFILE
48 return $RETVAL
49 }
50 case "$1" in
51 start)
52 start
53 ;;
54 stop)
55 stop
56 ;;
57 status)
58 status -p $MMMD_MON_PIDFILE $MMMD_MON_BIN
59 RETVAL=$?
60 ;;
61 restart|reload)
62 stop
63 start
64 ;;
65 condrestart)
66 if [ -f $LOCKFILE ]; then
67 stop
68 start
69 fi
70 ;;
71 *)
72 echo "Usage: $0 {start|stop|restart|condrestart|status}"
73 ;;
74 esac
75 exit $RETVAL
赋予可执行权限：
1 chmod +x /etc/init.d/mysql-mmm-monitor-navy2 2 chmod +x /etc/init.d/mysql-mmm-monitor-navy3
启动监控服务：
/etc/init.d/mysql-mmm-monitor-navy2 start /etc/init.d/mysql-mmm-monitor-navy3 start
结果
1 [root@monitor ~]# mmm_control show 2 db1(172.28.26.101) master/ONLINE. Roles: writer(172.28.26.104) 3 db2(172.28.26.102) master/ONLINE. Roles: 4 db3(172.28.26.188) slave/ONLINE. Roles: reader(172.28.26.105) 5 db4(172.28.26.189) slave/ONLINE. Roles: reader(172.28.26.106) 6 [root@monitor ~]# mmm_control @navy2 show 7 db1(172.28.26.101) master/ONLINE. Roles: writer(172.28.26.107) 8 db2(172.28.26.102) master/ONLINE. Roles: reader(172.28.26.108) 9 [root@monitor ~]# mmm_control @navy3 show 10 db1(172.28.26.101) master/ONLINE. Roles: writer(172.28.26.109) 11 db2(172.28.26.102) master/ONLINE. Roles: reader(172.28.26.110) 12 [root@monitor ~]#