测试flinkcdc3.0 同步mysql到doris，就是docs里的例子，怎么都不成功？

测试flinkcdc3.0 同步mysql到doris，就是docs里的例子，17kb的源库，怎么都不成功？flink版本1.17.2source: type: mysql hostname: localhost port: 3306 username: root password: 123456 tables: app_db..* server-id: 5400 server-time-zone: UTCsink: type: doris fenodes: 127.0.0.1:8030 username: root password: "" table.create.properties.light_schema_change: true table.create.properties.replication_num: 1pipeline: name: Sync MySQL Database to Doris parallelism: 1``2023-12-13 22:47:11java.lang.IllegalStateException: Failed to send request to coordinator: com.ververica.cdc.runtime.operators.schema.event.SchemaChangeRequest@9b5c3d87Caused by: java.util.concurrent.ExecutionException: java.util.concurrent.TimeoutException: Invocation of [RemoteRpcInvocation(JobMasterOperatorEventGateway.sendRequestToCoordinator(OperatorID, SerializedValue))] at recipient [akka.tcp://flink@localhost:6123/user/rpc/jobmanager_3] timed out. This is usually caused by: 1) Akka failed sending the message silently, due to problems like oversized payload or serialization failures. In that case, you should find detailed error information in the logs. 2) The recipient needs more time for responding, due to problems like slow machines or network jitters. In that case, you can try to increase akka.ask.timeout. at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395) at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999) at com.ververica.cdc.runtime.operators.schema.SchemaOperator.sendRequestToCoordinator(SchemaOperator.java:123) ... 26 moreCaused by: java.util.concurrent.TimeoutException: Invocation of [RemoteRpcInvocation(JobMasterOperatorEventGateway.sendRequestToCoordinator(OperatorID, SerializedValue))] at recipient [akka.tcp://flink@localhost:6123/user/rpc/jobmanager_3] timed out. This is usually caused by: 1) Akka failed sending the message silently, due to problems like oversized payload or serialization failures. In that case, you should find detailed error information in the logs. 2) The recipient needs more time for responding, due to problems like slow machines or network jitters. In that case, you can try to increase akka.ask.timeout. at com.sun.proxy.$Proxy25.sendRequestToCoordinator(Unknown Source) at org.apache.flink.runtime.taskexecutor.rpc.RpcTaskOperatorEventGateway.sendRequestToCoordinator(RpcTaskOperatorEventGateway.java:73) at com.ververica.cdc.runtime.operators.schema.SchemaOperator.sendRequestToCoordinator(SchemaOperator.java:121) ... 26 moreCaused by: akka.pattern.AskTimeoutException: Ask timed out on [Actor[akka.tcp://flink@localhost:6123/user/rpc/jobmanager_3#1975425594]] after [10000 ms]. Message of type [org.apache.flink.runtime.rpc.messages.RemoteFencedMessage]. A typical reason forAskTimeoutException` is that the recipient actor didn't send a reply.

展开

收起

cuicuicuic 2023-12-20 08:25:59 142 0

2 条回答

写回答

取消提交回答

小Lee

2000元阿里云代金券免费领取，2核4G云服务器仅664元/3年，新老用户都有优惠，立即抢购>>>
从你提供的错误信息来看，问题可能是由于Flink CDC在向JobManager发送请求时超时导致的。以下是一些可能的解决方法：
1. 网络问题：检查本地网络连接是否正常，确保Flink和MySQL之间的通信没有被阻塞。
2. Akka ask timeout：根据错误信息，你可以尝试增加Akka的ask timeout值。在Flink的flink-conf.yaml配置文件中添加或修改以下配置：
  akka.ask.timeout: 30 s
  这将把默认的10秒超时时间增加到30秒。你可以根据实际情况调整这个值。
3. Flink版本兼容性：确认你使用的Flink版本（1.17.2）与Flink CDC 3.0是否兼容。如果存在兼容性问题，尝试使用与Flink CDC 3.0兼容的Flink版本。
4. 检查Flink和MySQL的配置：确保你在Flink CDC配置中提供的MySQL主机名、端口、用户名和密码是正确的，并且MySQL服务器允许来自Flink CDC的连接。
5. 查看Flink和MySQL的日志：查看Flink和MySQL的日志，查找可能的错误或警告信息，这些信息可能会帮助你找到问题的原因。
6. 确认Doris配置：确保你在Flink CDC配置中提供的Doris Fenodes地址、用户名和密码是正确的，并且Doris服务器允许来自Flink CDC的连接。
7. 更新或重新安装Flink CDC：如果你已经确认了所有的配置都是正确的，但问题仍然存在，你可能需要更新或重新安装Flink CDC，以确保你正在使用的是最新版本并且没有安装错误。
2023-12-20 16:11:31

赞同展开评论打赏
xin在这

2000元阿里云代金券免费领取，2核4G云服务器仅664元/3年，新老用户都有优惠，立即抢购>>>
增加一下 akka.ask.timeout 这个参数试下。doris 里 app_db 这个数据库要先创建一下，还没支持自动创建数据库。，此回答整理自钉群“Flink CDC 社区”

2023-12-20 09:32:30

赞同展开评论打赏