Sun.Zhu's Blog

Thinking will not overcome fear but action will.

Flink多并行度下watermark生成规则

Flink多并行度下watermark生成规则

一、多并加粗样式行度流的watermarks 注意：多并行度的情况下，watermark对齐会取所有channel最小的watermark 二、单个流多并行度测试代码如下： public class MutiParaWatermarkTest { public static void main(String[] args) throws Exception { ...

Posted by Sun.Zhu on August 28, 2019

Flink源码阅读之AssignerWithPeriodicWatermarks和AssignerWithPunctuatedWatermarks的区别

AssignerWithPeriodicWatermarks和AssignerWithPunctuatedWatermarks的区别

任务提交和任务执行分别参考后面文章。从OneInputStreamTask入口，init（）方法会初始化StreamInputProcessor对象， public void init() throws Exception { StreamConfig configuration = getConfiguration(); TypeSerializer<IN>...

Posted by Sun.Zhu on August 18, 2019

FEATURED TAGS

Flink watermark Checkpoint

ABOUT ME

热衷于大数据实时计算 Flink

✉️ 17626017841@163.com

FRIENDS