阿里云-云小站(无限量代金券发放中)
【腾讯云】云服务器、云数据库、COS、CDN、短信等热卖云产品特惠抢购

从Oracle ASMLIB迁移到ASM Filter Driver

237次阅读
没有评论

共计 5347 个字符,预计需要花费 14 分钟才能阅读完成。

ASM Filter Driver 是一个可以取代 ASMLIB 和 udev 设置的新功能,它可以一举取代 ASMLIB 和手动设置 udev rules 文件的繁琐,并且最重要的是 I/O Filter 功能。所谓的 I /O Filter 功能可以拒绝所有无效的 I/O 请求,最主要的作用是防止意外覆写 ASM 磁盘的底层盘,在后面的测试中可以看到对于 root 用户的 dd 全盘清零这样的变态操作也都是可以过滤的。

1、查询集群状态

[root@odb02 ~]# crsctl check cluster -all
**************************************************************
odb02:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
odb03:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************

2、查询集群模式

[root@odb02 ~]# crsctl get cluster mode status
Cluster is running in "flex" mode

从 12c R2 以后,默认的集群模式为 flex。

3、查询当前的 ASM 磁盘以及发现路径

[root@odb02 ~]# Oracleasm listdisks | xargs oracleasm querydisk -p
Disk "DATA01" is a valid ASM disk
/dev/sdb1: LABEL="DATA01" TYPE="oracleasm" 
Disk "FRA001" is a valid ASM disk
/dev/sdc1: LABEL="FRA001" TYPE="oracleasm" 
[root@odb02 ~]# asmcmd dsget
parameter:/dev/oracleasm/disks/*
profile:/dev/oracleasm/disks/*

4、设置新的 ASM 磁盘发现路径

[grid@odb02 ~]$ asmcmd dsset '/dev/oracleasm/disks/*','AFD:*'
[grid@odb02 ~]$ asmcmd  dsget
parameter:/dev/oracleasm/disks/*, AFD:*
profile:/dev/oracleasm/disks/*,AFD:*

5、检查 GI 环境中的节点

[grid@odb02 ~]$ olsnodes 
odb02
odb03

6、RAC 所有节点停止集群服务

[root@odb02 ~]# crsctl stop crs
[root@odb03 ~]# crsctl stop crs

7、RAC 所有节点卸载 ASMLIB 软件

  • odb02
    [root@odb02 ~]# systemctl disable oracleasm
    Removed symlink /etc/systemd/system/multi-user.target.wants/oracleasm.service.
    [root@odb02 ~]# oracleasm status
    Checking if ASM is loaded: yes
    Checking if /dev/oracleasm is mounted: yes
    [root@odb02 ~]# oracleasm exit
    Unmounting ASMlib driver filesystem: /dev/oracleasm
    Unloading module "oracleasm": oracleasm
    [root@odb02 ~]# ls -ltr /dev/oracleasm/
    total 0
    [root@odb02 ~]# yum -y remove oracleasm-support
  • odb03
    [root@odb03 ~]# systemctl disable oracleasm
    Removed symlink /etc/systemd/system/multi-user.target.wants/oracleasm.service.
    [root@odb03 ~]# oracleasm status
    Checking if ASM is loaded: yes
    Checking if /dev/oracleasm is mounted: yes
    [root@odb03 ~]# oracleasm exit
    Unmounting ASMlib driver filesystem: /dev/oracleasm
    Unloading module "oracleasm": oracleasm
    [root@odb03 ~]# ls -ltr /dev/oracleasm/
    total 0
    [root@odb03 ~]# yum -y remove oracleasm-support

    8、RAC 所有节点停止 acfsload 服务

    [root@odb02 ~]# lsmod|grep acfs
    [root@odb02 ~]# acfsload stop
    [root@odb02 ~]# lsmod|grep acfs

    9、RAC 所有节点配置 AFD

    AFD Configure,实际上这是一个解压程序包,安装,并加载 Driver 的过程,需要消耗一些时间。

    [root@odb02 ~]# asmcmd afd_configure
    ASMCMD-9523: command cannot be used when Oracle Clusterware stack is up
    -- 如果遇到以上报错,先停止 has,再执行一次。[root@odb02 ~]# crsctl stop has
    [root@odb02 ~]# asmcmd afd_configure
    AFD-627: AFD distribution files found.
    AFD-634: Removing previous AFD installation.
    AFD-635: Previous AFD components successfully removed.
    AFD-636: Installing requested AFD software.
    AFD-637: Loading installed AFD drivers.
    AFD-9321: Creating udev for AFD.
    AFD-9323: Creating module dependencies - this may take some time.
    AFD-9154: Loading 'oracleafd.ko' driver.
    AFD-649: Verifying AFD devices.
    AFD-9156: Detecting control device '/dev/oracleafd/admin'.
    AFD-638: AFD installation correctness verified.
    Modifying resource dependencies - this may take some time.

    配置完成后,验证下状态:

    [root@odb02 ~]# asmcmd afd_state
    ASMCMD-9526: The AFD state is 'LOADED' and filtering is 'ENABLED' on host 'odb02'
    [root@odb03 ~]# asmcmd afd_state
    ASMCMD-9526: The AFD state is 'LOADED' and filtering is 'ENABLED' on host 'odb03'
    -- 如果上述的状态为 disabled,则使用下面的命令启用
    [root@odb02 ~]# asmcmd afd_filter -e

    另外,会生成一个 /etc/oracleafd.conf 文件,内容如下:

    [root@odb02 ~]# cat /etc/oracleafd.conf
    afd_diskstring='/dev/oracleasm/disks/*'

    如果其他节点没有,就把这个文件复制一份过去,避免启动 crs 的时候出错。

    10、迁移所有 ASM 磁盘

    这个在一个节点操作,在其他的节点中,不再需要作 label,而是直接 scan 即可,这跟使用 ASMLIB 的操作非常相似。另外命令后面必须加 migrate 参数,才可以成功。

[root@odb02 ~]# asmcmd afd_label data01 /dev/sdb1 --migrate
[root@odb02 ~]# asmcmd afd_label fra001 /dev/sdc1 --migrate    
[root@odb02 ~]# asmcmd afd_lsdsk
--------------------------------------------------------------------------------
Label                     Filtering   Path
================================================================================
DATA01                      ENABLED   /dev/sdb1
FRA001                      ENABLED   /dev/sdc1

其他节点执行扫描操作:

[grid@odb03 ~]$ asmcmd afd_scan
[grid@odb03 ~]$ asmcmd afd_lsdsk
--------------------------------------------------------------------------------
Label                     Filtering   Path
================================================================================
DATA01                      ENABLED   /dev/sdb1
FRA001                      ENABLED   /dev/sdc1

最后,更新 /etc/oracleafd.conf 的内容如下:

[root@odb02 ~]# cat /etc/oracleafd.conf 
afd_diskstring='/dev/sd*

11、RAC 所有节点启动 acfsload

[root@odb02 ~]# acfsload start
ACFS-9391: Checking for existing ADVM/ACFS installation.
ACFS-9392: Validating ADVM/ACFS installation files for operating system.
ACFS-9393: Verifying ASM Administrator setup.
ACFS-9308: Loading installed ADVM/ACFS drivers.
ACFS-9327: Verifying ADVM/ACFS devices.
ACFS-9156: Detecting control device '/dev/asm/.asm_ctl_spec'.
ACFS-9156: Detecting control device '/dev/ofsctl'.
ACFS-9322: completed

12、RAC 所有节点启动 CRS

[root@odb02 ~]# crsctl start crs 
[root@odb03 ~]# crsctl start crs 

待所有服务启动后,检查下 diskstring 参数设置:

[grid@odb02 ~]$ asmcmd dsget
parameter:/dev/oracleasm/disks/*, AFD:*
profile:/dev/oracleasm/disks/*,AFD:*
[grid@odb02 ~]$ asmcmd dsset 'AFD:*'
[grid@odb02 ~]$ asmcmd dsget
parameter:AFD:*
profile:AFD:*
[grid@odb02 ~]$ asmcmd lsdsk
Path
AFD:DATA01
AFD:FRA001

最后通过 SQLplus 执行下面的 SQL 进行验证:

set linesize 300
col PATH for a20
set pages 20
col LIBRARY for a45
col NAME for a15
select inst_id,group_number grp_num,name,state,header_status header,mount_status mount,path, library
from gv$asm_disk order by inst_id,group_number,name;

从 Oracle ASMLIB 迁移到 ASM Filter Driver

参考文献:
1、Oracle ASM Filter Driver (ASMFD)
2、Migrating from ASMLIB to ASMFD

更多 Oracle 相关信息见 Oracle 专题页面 https://www.linuxidc.com/topicnews.aspx?tid=12

正文完
星哥玩云-微信公众号
post-qrcode
 0
星锅
版权声明:本站原创文章,由 星锅 于2022-01-22发表,共计5347字。
转载说明:除特殊说明外本站文章皆由CC-4.0协议发布,转载请注明出处。
【腾讯云】推广者专属福利,新客户无门槛领取总价值高达2860元代金券,每种代金券限量500张,先到先得。
阿里云-最新活动爆款每日限量供应
评论(没有评论)
验证码
【腾讯云】云服务器、云数据库、COS、CDN、短信等云产品特惠热卖中