Canal在windows下的安装和监听初体验
·
一、在MySQL创建一个子账号
最小权限原则,创建账号,给权限(拉binary log,查看主库的权限等)
-- 账号:canal 密码: canal
create user 'canal'@'%' identified by 'canal';
-- 授权
grant SELECT, REPLICATION SLAVE, REPLICATION CLIENT on *.* to 'canal'@'%' identified by 'canal';
二、MySQL开启binlog
1. 找到 MySQL 的安装文件。
2. 与bin目录同级创建my.cnf
3. 写如下配置:
[mysqld]
log-bitn=mysql-bin
binlog-format=ROW
server_id=1
三、下载Canal
https://github.com/alibaba/canal/releases
找到最新版本:

解压即可:windows打开git bash即可,执行命令:tar -xzf canal.deployer-1.1.8.tar.gz解压,得到如下文件夹:

四、配置Canal
1. 进入conf目录下的example,对instance.properties进行配置。
2. 主库地址配置好,记得看一下端口和ip:canal.instance.master.address=127.0.0.1:3306
3. canal的账号密码配置好:canal.instance.dbUsername=canal 与canal.instance.dbPassword=canal
五、启动Canal
1. 进入bin目录,打开cmd,执行startup.bat命令,看到如下信息执行成功:

如果遇到报错(遇到错误才看):
1. 如果你不是java8的环境,请你编辑startup.bat,并且去掉其中的:
-XX:PermSize=128m,并且之后再次执行该文件。
六、java后端引入依赖
1. 引入pom.xml如下信息:
<dependency>
<groupId>com.alibaba.otter</groupId>
<artifactId>canal.client</artifactId>
<version>1.1.8</version>
</dependency>
<dependency>
<groupId>com.alibaba.otter</groupId>
<artifactId>canal.protocol</artifactId>
<version>1.1.8</version>
</dependency>
2. 编写一段监听代码:
public static void main(String args[]) {
// 创建链接
CanalConnector connector = CanalConnectors.newSingleConnector(new InetSocketAddress(AddressUtils.getHostIp(),
11111), "example", "", "");
int batchSize = 1000;
int emptyCount = 0;
try {
connector.connect();
connector.subscribe(".*\\..*");
connector.rollback();
int totalEmptyCount = 120;
while (emptyCount < totalEmptyCount) {
Message message = connector.getWithoutAck(batchSize); // 获取指定数量的数据
long batchId = message.getId();
int size = message.getEntries().size();
if (batchId == -1 || size == 0) {
emptyCount++;
System.out.println("empty count : " + emptyCount);
try {
Thread.sleep(1000);
} catch (InterruptedException e) {
}
} else {
emptyCount = 0;
// System.out.printf("message[batchId=%s,size=%s] \n", batchId, size);
printEntry(message.getEntries());
}
connector.ack(batchId); // 提交确认
// connector.rollback(batchId); // 处理失败, 回滚数据
}
System.out.println("empty too many times, exit");
} finally {
connector.disconnect();
}
}
private static void printEntry(List<Entry> entrys) {
for (Entry entry : entrys) {
if (entry.getEntryType() == EntryType.TRANSACTIONBEGIN || entry.getEntryType() == EntryType.TRANSACTIONEND) {
continue;
}
RowChange rowChage = null;
try {
rowChage = RowChange.parseFrom(entry.getStoreValue());
} catch (Exception e) {
throw new RuntimeException("ERROR ## parser of eromanga-event has an error , data:" + entry.toString(),
e);
}
EventType eventType = rowChage.getEventType();
System.out.println(String.format("================> binlog[%s:%s] , name[%s,%s] , eventType : %s",
entry.getHeader().getLogfileName(), entry.getHeader().getLogfileOffset(),
entry.getHeader().getSchemaName(), entry.getHeader().getTableName(),
eventType));
for (RowData rowData : rowChage.getRowDatasList()) {
if (eventType == EventType.DELETE) {
printColumn(rowData.getBeforeColumnsList());
} else if (eventType == EventType.INSERT) {
printColumn(rowData.getAfterColumnsList());
} else {
System.out.println("-------> before");
printColumn(rowData.getBeforeColumnsList());
System.out.println("-------> after");
printColumn(rowData.getAfterColumnsList());
}
}
}
}
private static void printColumn(List<Column> columns) {
for (Column column : columns) {
System.out.println(column.getName() + " : " + column.getValue() + " update=" + column.getUpdated());
}
}
3. mysql插入一条数据测试

通过mysql插入的数据被监听成功了,完成。
七、安装MQ
1. 输入https://github.com/rabbitmq/rabbitmq-server/releases
2. 选择对应的版本解压。

3. 解压进入到sbin目录执行15672控制面板,执行enable命令:
rabbitmq-plugins enable rabbitmq_management
八、Canal推送MQ
1. 进入canal的配置文件
更多推荐


所有评论(0)