Liunx安装并配置multipath多路径,并为oracle asm磁盘组配置权限和规则
在生产环境中,Oracle RAC的搭建需要有共享存储的支持,而共享存储上的每个LUN挂载到服务器上通常是多条路径的,这样就需要在服务器上安装多路径软件来整合一个LUN的多条链路。有的存储厂商会有自己的多路径软件,但有的却没有,这就需要我们自己来安装多路径软件,在Linux系统上,multipath多路径软件无疑是较好的选择。
multipath常用命令:
multipath -r (修改multipath.conf配置文件之后重新加载)
multipath -ll (查看多路径状态)
multipath -v2 (格式化路径,检测路径,合并路径)
multipath -v3 (查看多路径详情blacklist、whitelist和设备wwid)
multipath -F (删除现有链路)
环境介绍:
RHEL6.8 (已配置本地yum源)
Oracle 11gR2 RAC
一、multipath安装配置:
1、通过yum命令安装:
yum -y install device-mapper*
2、 尝试命令:multipath -v2
[root@ora11g ~]# multipath -v2
Oct 16 15:04:56 | DM multipath kernel driver not loaded
Oct 16 15:04:56 | /etc/multipath.conf does not exist, blacklisting all devices.
Oct 16 15:04:56 | A sample multipath.conf file is located at
Oct 16 15:04:56 | /usr/share/doc/device-mapper-multipath-0.4.9/multipath.conf
Oct 16 15:04:56 | You can run /sbin/mpathconf to create or modify /etc/multipath.conf
Oct 16 15:04:56 | DM multipath kernel driver not loaded
3、需要加载DM模块:
modprobe dm-multipath
modprobe dm-round-robin
4、启动服务并设置开机自启动:
service multipathd start
chkconfig --level 2345 multipathd on
5、尝试命令:multipath -v2
[root@ora11g ~]# multipath -v2
Oct 16 15:15:24 | /etc/multipath.conf does not exist, blacklisting all devices.
Oct 16 15:15:24 | A sample multipath.conf file is located at
Oct 16 15:15:24 | /usr/share/doc/device-mapper-multipath-0.4.9/multipath.conf
Oct 16 15:15:24 | You can run /sbin/mpathconf to create or modify /etc/multipath.conf
6、创建/etc/multipath.conf,可以从“/usr/share/doc/device-mapper-multipath-0.4.9/multipath.conf” 复制:
cp /usr/share/doc/device-mapper-multipath-0.4.9/multipath.conf /etc/
7、用命令查看设备wwid:
multipath -v3
8、配置/etc/multipath.conf,添加每个存储LUN的wwid号并设置对应的别名:
defaults {
user_friendly_names yes
}
blacklist {
devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"
devnode "^hd[a-z]"
devnode "^dcssblk[0-9]*"
wwid "*" # 此处开启表示设置所有设备都不使用多路径软件管理
}
blacklist_exceptions {
wwid "360002ac0000000000000000200021dbf"
wwid "360002ac0000000000000000300021dbf"
wwid "360002ac0000000000000000400021dbf"
wwid "360002ac0000000000000000700021dbf"
wwid "360002ac0000000000000000900021dbf"
wwid "360002ac0000000000000000a00021dbf"
wwid "360002ac0000000000000000800021dbf"
}
multipaths {
multipath {
wwid "360002ac0000000000000000200021dbf"
alias data01
}
multipath {
wwid "360002ac0000000000000000300021dbf"
alias data02
}
multipath {
wwid "360002ac0000000000000000400021dbf"
alias data03
}
multipath {
wwid "360002ac0000000000000000700021dbf"
alias data04
}
multipath {
wwid "360002ac0000000000000000900021dbf"
alias crs01
}
multipath {
wwid "360002ac0000000000000000a00021dbf"
alias crs02
}
multipath {
wwid "360002ac0000000000000000800021dbf"
alias crs03
}
}
9、重新加载配置文件并合并路径:
multipath -r
multipath -F
multipath -v2
10、查看路径:
multipath -ll
[root@hnxnb1 ~]# multipath -ll
data01 (360002ac0000000000000000200021dbf) dm-5 3PARdata,VV
size=1.0T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
|- 0:0:1:0 sdh 8:112 active ready running
|- 2:0:0:0 sdo 8:224 active ready running
|- 0:0:0:0 sda 8:0 active ready running
`- 2:0:1:0 sdv 65:80 active ready running
crs03 (360002ac0000000000000000800021dbf) dm-3 3PARdata,VV
size=5.0G features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
|- 0:0:0:4 sde 8:64 active ready running
|- 2:0:0:4 sds 65:32 active ready running
|- 0:0:1:4 sdl 8:176 active ready running
`- 2:0:1:4 sdz 65:144 active ready running
crs02 (360002ac0000000000000000a00021dbf) dm-4 3PARdata,VV
size=5.0G features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
|- 0:0:0:6 sdg 8:96 active ready running
|- 2:0:0:6 sdu 65:64 active ready running
|- 0:0:1:6 sdn 8:208 active ready running
`- 2:0:1:6 sdab 65:176 active ready running
crs01 (360002ac0000000000000000900021dbf) dm-6 3PARdata,VV
size=5.0G features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
|- 0:0:1:5 sdm 8:192 active ready running
|- 2:0:0:5 sdt 65:48 active ready running
|- 0:0:0:5 sdf 8:80 active ready running
`- 2:0:1:5 sdaa 65:160 active ready running
data04 (360002ac0000000000000000700021dbf) dm-1 3PARdata,VV
size=1.0T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
|- 0:0:0:3 sdd 8:48 active ready running
|- 2:0:0:3 sdr 65:16 active ready running
|- 0:0:1:3 sdk 8:160 active ready running
`- 2:0:1:3 sdy 65:128 active ready running
data03 (360002ac0000000000000000400021dbf) dm-2 3PARdata,VV
size=1.0T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
|- 0:0:0:2 sdc 8:32 active ready running
|- 2:0:0:2 sdq 65:0 active ready running
|- 0:0:1:2 sdj 8:144 active ready running
`- 2:0:1:2 sdx 65:112 active ready running
data02 (360002ac0000000000000000300021dbf) dm-0 3PARdata,VV
size=1.0T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
|- 0:0:0:1 sdb 8:16 active ready running
|- 2:0:0:1 sdp 8:240 active ready running
|- 0:0:1:1 sdi 8:128 active ready running
`- 2:0:1:1 sdw 65:96 active ready running
二、配置dm权限与规则:
1、为每个LUN分区:
fdisk /dev/mapper/data01
fdisk /dev/mapper/data02
fdisk /dev/mapper/data03
fdisk /dev/mapper/data04
fdisk /dev/mapper/crs01
fdisk /dev/mapper/crs02
fdisk /dev/mapper/crs03
分区后可以在/dev/mapper目录下查看结果,每个分区别名指向一个dm号:
[root@hnxnb1 ~]# ll /dev/mapper/
total 0
crw-rw---- 1 root root 10, 58 Oct 15 17:46 control
lrwxrwxrwx 1 root root 7 Oct 16 15:42 crs01 -> ../dm-6
lrwxrwxrwx 1 root root 8 Oct 16 15:42 crs01p1 -> ../dm-13
lrwxrwxrwx 1 root root 7 Oct 16 15:42 crs02 -> ../dm-4
lrwxrwxrwx 1 root root 8 Oct 16 15:42 crs02p1 -> ../dm-12
lrwxrwxrwx 1 root root 7 Oct 16 15:42 crs03 -> ../dm-3
lrwxrwxrwx 1 root root 7 Oct 16 15:42 crs03p1 -> ../dm-9
lrwxrwxrwx 1 root root 7 Oct 16 15:42 data01 -> ../dm-5
lrwxrwxrwx 1 root root 8 Oct 16 15:53 data01p1 -> ../dm-11
lrwxrwxrwx 1 root root 7 Oct 16 15:42 data02 -> ../dm-0
lrwxrwxrwx 1 root root 7 Oct 16 15:42 data02p1 -> ../dm-7
lrwxrwxrwx 1 root root 7 Oct 16 15:42 data03 -> ../dm-2
lrwxrwxrwx 1 root root 8 Oct 16 15:53 data03p1 -> ../dm-10
lrwxrwxrwx 1 root root 7 Oct 16 15:42 data04 -> ../dm-1
lrwxrwxrwx 1 root root 7 Oct 16 15:53 data04p1 -> ../dm-8
2、配置dm规则:
vi /etc/udev/rules.d/12-dm-permissions.rules
ENV{DM_NAME}=="data01p1",OWNER:="grid",GROUP:="asmadmin",MODE:="660",SYMLINK+="mapper/$env{DM_NAME}"
ENV{DM_NAME}=="data02p1",OWNER:="grid",GROUP:="asmadmin",MODE:="660",SYMLINK+="mapper/$env{DM_NAME}"
ENV{DM_NAME}=="data03p1",OWNER:="grid",GROUP:="asmadmin",MODE:="660",SYMLINK+="mapper/$env{DM_NAME}"
ENV{DM_NAME}=="data04p1",OWNER:="grid",GROUP:="asmadmin",MODE:="660",SYMLINK+="mapper/$env{DM_NAME}"
ENV{DM_NAME}=="crs01p1",OWNER:="grid",GROUP:="asmadmin",MODE:="660",SYMLINK+="mapper/$env{DM_NAME}"
ENV{DM_NAME}=="crs02p1",OWNER:="grid",GROUP:="asmadmin",MODE:="660",SYMLINK+="mapper/$env{DM_NAME}"
ENV{DM_NAME}=="crs03p1",OWNER:="grid",GROUP:="asmadmin",MODE:="660",SYMLINK+="mapper/$env{DM_NAME}"
3、重启UDEV Service
udevadm control --reload-rules
/sbin/start_udev
4、查看所有者和权限
更多推荐
所有评论(0)