通过Ops Manager安装管理mongodb-3.4集群

通过Ops Manager安装管理mongodb-3.4集群

 

node1

Ops Manager,mongodb,agent

node2 mongodb,agent
node3 mongodb,agent

参考文档

NUMA Settings

sysctl -w vm.zone_reclaim_mode=0

NTP Settings

yum install -y ntp
/etc/init.d/ntpd start

Turn off Atime

vim /etc/fstab
/dev/mapper/VolGroup-lv_data /data                       ext4    defaults,noatime,nodiratime        1 1

ulimt settings

ulimit -a
 
修改/etc/security/limits.conf
    mongod soft nproc 65535
    mongod hard nproc 65535

Disable Transparent Huge Pages

通过启动脚本可以在每次启动时关闭THP

复制代码
vim /etc/init.d/disable-transparent-hugepages
#以下为脚本内容
 
#!/bin/bash
### BEGIN INIT INFO
# Provides:          disable-transparent-hugepages
# Required-Start:    $local_fs
# Required-Stop:
# X-Start-Before:    mongod mongodb-mms-automation-agent
# Default-Start:     2 3 4 5
# Default-Stop:      0 1 6
# Short-Description: Disable Linux transparent huge pages
# Description:       Disable Linux transparent huge pages, to improve
#                    database performance.
### END INIT INFO
 
case $1 in
  start)
    if [ -d /sys/kernel/mm/transparent_hugepage ]; then
      thp_path=/sys/kernel/mm/transparent_hugepage
    elif [ -d /sys/kernel/mm/redhat_transparent_hugepage ]; then
      thp_path=/sys/kernel/mm/redhat_transparent_hugepage
    else
      return 0
    fi
 
    echo 'never' > ${thp_path}/enabled
    echo 'never' > ${thp_path}/defrag
 
    re='^[0-1]+$'
    if [[ $(cat ${thp_path}/khugepaged/defrag) =~ $re ]]
    then
      # RHEL 7
      echo 0  > ${thp_path}/khugepaged/defrag
    else
      # RHEL 6
      echo 'no' > ${thp_path}/khugepaged/defrag
    fi
 
    unset re
    unset thp_path
    ;;
esac
复制代码

执行脚本

chmod +x /etc/init.d/disable-transparent-hugepages
chkconfig --add disable-transparent-hugepages
/etc/init.d/disable-transparent-hugepages start

检查是否生效

cat /sys/kernel/mm/transparent_hugepage/enabled
cat /sys/kernel/mm/transparent_hugepage/defrag

#有以下输出表示正确
always madvise [never]

Install the Ops Manager Application Database

Ops Manager需要先安装mongodb,创建其数据库副本集后才能部署安装。

创建yum repo

在每台节点上执行以下命令创建官方3.4版本的repo文件

官方的yum源比较慢,推荐使用阿里云yum源

复制代码
#官方repo
cat > /etc/yum.repos.d/mongodb-org-3.4.repo << EOF
[mongodb-org-3.4]
name=MongoDB Repository
baseurl=https://repo.mongodb.org/yum/redhat/$releasever/mongodb-org/3.4/x86_64/
gpgcheck=1
enabled=1
gpgkey=https://www.mongodb.org/static/pgp/server-3.4.asc
EOF
 
  
# 阿里云repo
cat > /etc/yum.repos.d/mongodb-org-3.4.repo << EOF
[mongodb-org-3.4]
name=MongoDB Repository
#baseurl=https://repo.mongodb.org/yum/redhat/$releasever/mongodb-org/3.4/x86_64/
baseurl=https://mirrors.aliyun.com/mongodb/yum/redhat/$releasever/mongodb-org/3.4/x86_64/
gpgcheck=0
enabled=1
gpgkey=https://www.mongodb.org/static/pgp/server-3.4.asc
EOF
复制代码

安装mongod

在每台节点上执行以下步骤

yum install -y mongodb-org
chkconfig mongod on

修改配置

复制代码
vim /etc/mongod.conf
#修改为数据分区,需创建该目录,并确保mongod用户可读写
# Where and how to store data.
storage:
  dbPath: /data/mongo  
  journal:
    enabled: true
 
#默认监听本地lo,注释掉
# network interfaces
net:
  port: 27017
#  bindIp: 127.0.0.1  # Listen to local interface only, comment to listen on all interfaces.
复制代码

启动服务

service mongod start

部署Ops Manager副本集

参考 https://docs.mongodb.com/manual/tutorial/deploy-replica-set/

通过修改配置文件的方式创建Ops Manager所需副本集。

注:也可以通过命令行方式指定副本集启动。修改配置文件的方式便于通过init script管理。

在所有节点上修改配置

复制代码
vim mongod.conf
#添加以下内容
replication:
  replSetName: rs_ops_manager
 
#重启生效
service mongod restart
复制代码

在任一节点上执行mongo shell,添加副本集节点,此处使用node1节点

复制代码
mongo --host localhost --port 27017

#Initiate the replica set
rs.initiate()
#display the replica set configuration object
rs.conf()
#Add the remaining members to the replica set
rs.add("node2_fqdn")
rs.add("node3_fqdn")
#Check the status of the replica set
rs.status()
复制代码

Install Ops Manager

#下载安装
wget -c https://downloads.mongodb.com/on-prem-mms/rpm/mongodb-mms-3.4.2.389-1.x86_64.rpm
rpm -ivh mongodb-mms-<version>.x86_64.rpm

Configure the Ops Manager connection to the Ops Manager Application Database

vim /opt/mongodb/mms/conf/conf-mms.properties
#设置mongo.mongoUri
mongo.mongoUri=mongodb://node1:27017,node2:27017,node3:27017/?replicaSet=rs_ops_manager
/etc/init.d/mongodb-mms start 启动
 

Open the Ops Manager home page and register the first user.

  • http://<host>:8080
  • Click the Register link and follow the prompts to register the first user and create the first group. The first user is automatically assigned the Global Owner role.

Configure Local Mode for Ops Manager Servers without Internet Access(Optional)

Set Ops Manager to Local Mode.

  • Click Admin in the upper right corner to open system administration.
  • From the General tab, click Ops Manager Config.
  • Click the Miscellaneous button at the top of the page.
  • For Version Manifest Source, select Local.
  • Note the directory specified in Versions Directory. This is the directory on your Ops Manager servers where you will store the MongoDB binaries.
  • For Backup Version Auto Download, select false.

Download the required MongoDB archives

wget -c http://fastdl.mongodb.org/linux/mongodb-linux-x86_64-rhel62-3.4.2.tgz

Populate all Ops Manager servers with the necessary MongoDB binaries and archives

tar xzf mongodb-linux-x86_64-rhel62-3.4.2.tgz -C /opt/mongodb/mms/mongodb-releases/
chown -R mongodb-mms.mongodb-mms /opt/mongodb/mms/mongodb-releases/mongodb-linux-x86_64-rhel62-3.4.2/
 chown -R mongodb-mms:mongodb-mms /opt/mongodb/mms/mongodb-releases
 chmod -R 640 /opt/mongodb/mms/mongodb-releases

Download the version manifest for Ops Manager.

Paste the contents the version manifest into the Ops Manager application on each Ops Manager server.

  • In Ops Manager, click Admin in the upper right corner to open system administration.
  • Click the General tab.
  • Click Version Manifest.
  • Click the Update the MongoDB Version Manifest button.
  • Paste the version manifest.

For each group, specify which versions are available for download by Automation Agents.

  • In Ops Manager, click Back To Group in the upper left to exit system administration.
  • Click the Group link at the top of the page and select the desired group.
  • Click Deployment, then the More drop-down list, then Version Manager.
  • Select the checkboxes for the versions of MongoDB that you have made available on the Ops Manager Application server.

Review and approve your changes.

Ops Manager displays your proposed changes.

If you are satisfied, click Confirm & Deploy.
Otherwise, click Cancel and you can make additional changes.

Configure Ops Manager agents

参考https://docs.opsmanager.mongodb.com/current/tutorial/install-automation-agent-with-rpm-package/

在node1,node2,node3上安装mongodb-mms-automation-agent-manager
curl -OL http://172.17.20.127:8080/download/agent/automation/mongodb-mms-automation-agent-manager-latest.x86_64.rpm
rpm -U mongodb-mms-automation-agent-manager-latest.x86_64.rpm

按上图ID修改

复制代码
vim /etc/mongodb-mms/automation-agent.config
#get id and key from Group Settings
mmsGroupId=<Group ID>
mmsApiKey=<agent API key>
mmsBaseUrl=<application URL>

#启动agent
/etc/init.d/mongodb-mms-automation-agent start
复制代码

查看各个节点的agent是否连接上

通过Ops Manager安装配置管理mongodb集群

导入已经存在的mongodb集群到Ops Manager

 准备工作

解压mongodb压缩包,避免部署的时候在线下载这个包
tar xvf mongodb-linux-x86_64-rhel62-3.4.2.tgz -C /var/lib/mongodb-mms-automation/mongodb-linux-x86_64-3.4.2
chown -R mongod.mongod /var/lib/mongodb-mms-automation/mongodb-linux-x86_64-3.4.2/
检查各个节点的mongodb-mms-automation-agent是否连接上了

点击ADD添加已经存在的集群

查看集群状态(mongodb启动程序有警告,所以status有警告)

通过Ops Manager自动化部署mongodb shard集群

#创建mongodb数据存放目录,后面部署时要填写
mkdir /mongodata
chown mongod:mongod /mongodata

确认后点击REVIEW&DEPLOY

部署中可查看日志/var/log/mongodb-mms-automation/automation-agent.log排查错误,错误解决后点击REVIEW&DEPLOY继续部署。

 其他配置可参考官网

原文地址:https://www.cnblogs.com/vilenx/p/12373639.html