一、在MySQL创建一个子账号

        最小权限原则,创建账号,给权限(拉binary log,查看主库的权限等)

-- 账号:canal 密码: canal
create user 'canal'@'%' identified by 'canal';
-- 授权
grant SELECT, REPLICATION SLAVE, REPLICATION CLIENT on *.* to 'canal'@'%' identified by 'canal';

二、MySQL开启binlog

1. 找到 MySQL 的安装文件。

2. 与bin目录同级创建my.cnf

3. 写如下配置:

[mysqld]
log-bitn=mysql-bin 
binlog-format=ROW
server_id=1       

三、下载Canal

https://github.com/alibaba/canal/releases

找到最新版本:

解压即可:windows打开git bash即可,执行命令:tar -xzf canal.deployer-1.1.8.tar.gz解压,得到如下文件夹:

四、配置Canal

1. 进入conf目录下的example,对instance.properties进行配置。

2. 主库地址配置好,记得看一下端口和ip:canal.instance.master.address=127.0.0.1:3306

3. canal的账号密码配置好:canal.instance.dbUsername=canal 与canal.instance.dbPassword=canal

五、启动Canal

1. 进入bin目录,打开cmd,执行startup.bat命令,看到如下信息执行成功:

如果遇到报错(遇到错误才看):

1.  如果你不是java8的环境,请你编辑startup.bat,并且去掉其中的:

-XX:PermSize=128m,并且之后再次执行该文件。

六、java后端引入依赖

1. 引入pom.xml如下信息:

    <dependency>
            <groupId>com.alibaba.otter</groupId>
            <artifactId>canal.client</artifactId>
            <version>1.1.8</version>
     </dependency>
     <dependency>
            <groupId>com.alibaba.otter</groupId>
            <artifactId>canal.protocol</artifactId>
            <version>1.1.8</version>
     </dependency>

2. 编写一段监听代码:

public static void main(String args[]) {
    // 创建链接
    CanalConnector connector = CanalConnectors.newSingleConnector(new InetSocketAddress(AddressUtils.getHostIp(),
                                                                                        11111), "example", "", "");
    int batchSize = 1000;
    int emptyCount = 0;
    try {
        connector.connect();
        connector.subscribe(".*\\..*");
        connector.rollback();
        int totalEmptyCount = 120;
        while (emptyCount < totalEmptyCount) {
            Message message = connector.getWithoutAck(batchSize); // 获取指定数量的数据
            long batchId = message.getId();
            int size = message.getEntries().size();
            if (batchId == -1 || size == 0) {
                emptyCount++;
                System.out.println("empty count : " + emptyCount);
                try {
                    Thread.sleep(1000);
                } catch (InterruptedException e) {
                }
            } else {
                emptyCount = 0;
                // System.out.printf("message[batchId=%s,size=%s] \n", batchId, size);
                printEntry(message.getEntries());
            }

            connector.ack(batchId); // 提交确认
            // connector.rollback(batchId); // 处理失败, 回滚数据
        }

        System.out.println("empty too many times, exit");
    } finally {
        connector.disconnect();
    }
}

private static void printEntry(List<Entry> entrys) {
    for (Entry entry : entrys) {
        if (entry.getEntryType() == EntryType.TRANSACTIONBEGIN || entry.getEntryType() == EntryType.TRANSACTIONEND) {
            continue;
        }

        RowChange rowChage = null;
        try {
            rowChage = RowChange.parseFrom(entry.getStoreValue());
        } catch (Exception e) {
            throw new RuntimeException("ERROR ## parser of eromanga-event has an error , data:" + entry.toString(),
                                       e);
        }

        EventType eventType = rowChage.getEventType();
        System.out.println(String.format("================&gt; binlog[%s:%s] , name[%s,%s] , eventType : %s",
                                         entry.getHeader().getLogfileName(), entry.getHeader().getLogfileOffset(),
                                         entry.getHeader().getSchemaName(), entry.getHeader().getTableName(),
                                         eventType));

        for (RowData rowData : rowChage.getRowDatasList()) {
            if (eventType == EventType.DELETE) {
                printColumn(rowData.getBeforeColumnsList());
            } else if (eventType == EventType.INSERT) {
                printColumn(rowData.getAfterColumnsList());
            } else {
                System.out.println("-------&gt; before");
                printColumn(rowData.getBeforeColumnsList());
                System.out.println("-------&gt; after");
                printColumn(rowData.getAfterColumnsList());
            }
        }
    }
}

private static void printColumn(List<Column> columns) {
    for (Column column : columns) {
        System.out.println(column.getName() + " : " + column.getValue() + "    update=" + column.getUpdated());
    }
}

3. mysql插入一条数据测试

通过mysql插入的数据被监听成功了,完成。

七、安装MQ

1. 输入https://github.com/rabbitmq/rabbitmq-server/releases

2. 选择对应的版本解压。

3. 解压进入到sbin目录执行15672控制面板,执行enable命令:

 rabbitmq-plugins enable rabbitmq_management

八、Canal推送MQ

1. 进入canal的配置文件

更多推荐