阿里巴巴Canal Server搭建

参考：https://github.com/alibaba/canal/wiki

准备

• 对于自建 MySQL，需要先开启Binlog写入功能，配置binlog-format为ROW模式，my.cnf中配置如下

[mysqld]
log-bin=mysql-bin # 开启 binlog
binlog_format=ROW # 选择 ROW 模式
server_id=1 # 配置 MySQL replaction 需要定义，不要和 canal 的 slaveId 重复

注意：针对阿里云 RDS for MySQL，默认打开了binlog，并且账号默认具有binlog dump权限，不需要任何权限或者binlog设置，可以直接跳过这一步
注意：针对AWS RDS for MySQL，需配置自定义参数组

• 授权canal连接 MySQL 账号具有作为MySQL slave的权限，如果已有账户可直接grant

CREATE USER canal IDENTIFIED BY 'canal';  
GRANT SELECT, REPLICATION SLAVE, REPLICATION CLIENT ON *.* TO 'canal'@'%';
-- GRANT ALL PRIVILEGES ON *.* TO 'canal'@'%' ;
FLUSH PRIVILEGES;

启动

（1）下载 canal，访问 release 页面，选择需要的包下载，如以 1.1.4 版本为例

$ wget https://github.com/alibaba/canal/releases/download/canal-1.1.4/canal.deployer-1.1.4.tar.gz

（2）解压缩

$ mkdir /tmp/canal
$ tar zxvf canal.deployer-$version.tar.gz  -C /tmp/canal
# 解压完成后，进入 /tmp/canal 目录，可以看到如下结构
drwxr-xr-x 2 yezhou yezhou  136 2020-02-05 21:51 bin
drwxr-xr-x 4 yezhou yezhou  160 2020-02-05 21:51 conf
drwxr-xr-x 2 yezhou yezhou 1.3K 2020-02-05 21:51 lib
drwxr-xr-x 2 yezhou yezhou   48 2020-02-05 21:29 logs

（3）配置修改

$ vim conf/example/instance.properties

## mysql serverId
canal.instance.mysql.slaveId = 1234
#position info，需要改成自己的数据库信息
canal.instance.master.address = 127.0.0.1:3306 
canal.instance.master.journal.name = 
canal.instance.master.position = 
canal.instance.master.timestamp = 
#canal.instance.standby.address = 
#canal.instance.standby.journal.name =
#canal.instance.standby.position = 
#canal.instance.standby.timestamp = 
#username/password，需要改成自己的数据库信息
canal.instance.dbUsername = canal  
canal.instance.dbPassword = canal
canal.instance.defaultDatabaseName =
canal.instance.connectionCharset = UTF-8
#table regex
canal.instance.filter.regex = .\*\\\\..\*

• canal.instance.connectionCharset代表数据库的编码方式对应到 Java 中的编码类型，比如UTF-8，GBK，ISO-8859-1
• 如果系统是1个 cpu，需要将canal.instance.parser.parallel设置为false

（4）启动

$ sh bin/startup.sh

（5）查看 server 日志

$ tail -f logs/canal/canal.log
2020-02-05 22:45:27.967 [main] INFO  com.alibaba.otter.canal.deployer.CanalLauncher - ## start the canal server.
2020-02-05 22:45:28.113 [main] INFO  com.alibaba.otter.canal.deployer.CanalController - ## start the canal server[10.1.29.120:11111]
2020-02-05 22:45:28.210 [main] INFO  com.alibaba.otter.canal.deployer.CanalLauncher - ## the canal server is running now ......

（6）查看 instance 的日志

$ tail -f logs/example/example.log
2020-02-05 22:50:45.636 [main] INFO  c.a.o.c.i.spring.support.PropertyPlaceholderConfigurer - Loading properties file from class path resource [canal.properties]
2020-02-05 22:50:45.641 [main] INFO  c.a.o.c.i.spring.support.PropertyPlaceholderConfigurer - Loading properties file from class path resource [example/instance.properties]
2020-02-05 22:50:45.803 [main] INFO  c.a.otter.canal.instance.spring.CanalInstanceWithSpring - start CannalInstance for 1-example 
2020-02-05 22:50:45.810 [main] INFO  c.a.otter.canal.instance.spring.CanalInstanceWithSpring - start successful....

（7）关闭

$ sh bin/stop.sh

其他方式

• canal 的 docker 模式快速启动，参考：Docker QuickStart
• canal 链接 Aliyun RDS for MySQL，参考：Aliyun RDS QuickStart
• canal 消息投递给 kafka/RocketMQ，参考：Canal-Kafka-RocketMQ-QuickStart