PyFlink 1.16 Documentationimport Types from pyflink.datastream import StreamExecutionEnvironment from pyflink.table import StreamTableEnvironment # create a StreamExecutionEnvironment which is the entry point of 'DataStream' 'DataStream' program. env = StreamExecutionEnvironment.get_execution_environment() t_env = StreamTableEnvironment.create(env) ds = env.from_collection([(1, 'Hi'), (2, 'Hello'), you can refer to the latest version of PyFlink DataStream API doc ## StreamExecutionEnvironment Creation StreamExecutionEnvironment is the entry point and central concept for creating DataStream API programs0 码力 | 36 页 | 266.80 KB | 2 年前3
PyFlink 1.15 Documentationimport Types from pyflink.datastream import StreamExecutionEnvironment from pyflink.table import StreamTableEnvironment # create a StreamExecutionEnvironment which is the entry point of 'DataStream' 'DataStream' program. env = StreamExecutionEnvironment.get_execution_environment() t_env = StreamTableEnvironment.create(env) ds = env.from_collection([(1, 'Hi'), (2, 'Hello'), you can refer to the latest version of PyFlink DataStream API doc ## StreamExecutionEnvironment Creation StreamExecutionEnvironment is the entry point and central concept for creating DataStream API programs0 码力 | 36 页 | 266.77 KB | 2 年前3
Introduction to Apache Flink and Apache Kafka - CS 591 K1: Data Stream Processing and Analytics Spring 2020Double) object MaxSensorReadings { def main(args: Array[String]) { val env = StreamExecutionEnvironment.getExecutionEnvironment val sensorData = env.addSource(new SensorSource) temp: Double) object MaxSensorReadings { def main(args: Array[String]) { val env = StreamExecutionEnvironment.getExecutionEnvironmentValue( val sensorData = env.addSource(new SensorSource() Double) object MaxSensorReadings { def main(args: Array[String]) { val env = StreamExecutionEnvironment.getExecutionEnvironmentValue(new SensorSource) val sensorData = env.addSource(new0 码力 | 26 页 | 3.33 MB | 2 年前3
State management - CS 591 K1: Data Stream Processing and Analytics Spring 2020state.checkpoints.dir: path/to/checkpoint/folder/ ## I n your Flink program: val env = StreamExecutionEnvironment.getExecutionEnvironment val checkpointPath: String = ???? // configure path for checkpoints state that belongs to the record it currently processes. ## Java example StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); env.setStreamTimeCharacteristic(TimeCharacteristic0 码力 | 24 页 | 914.13 KB | 2 年前3
Windows and triggers - CS 591 K1: Data Stream Processing and Analytics Spring 2020readings object MaxSensorReadings { def main(args: Array[String]) { val env = StreamExecutionEnvironment.getExecutionEnvironment(val sensorData = env.addSource(new SensorSource)) val the StreamExecutionEnvironment: object AverageSensorReadings { def main(args: Array[String]) { // set up the streaming execution environment val env = StreamExecutionEnvironment.ge0 码力 | 35 页 | 444.84 KB | 2 年前3
Notions of time and progress - CS 591 K1: Data Stream Processing and Analytics Spring 2020g. if the stream contains special records that encode watermark information. val env = StreamExecutionEnvironment.getExecutionEnvironment env.setStreamTimeCharacteristic(TimeCharacteristic.EventTime) // assign record timestamp r.timestamp } ## Using a watermark assigner val env = StreamExecutionEnvironment.getExecutionEnvironment // set the event time characteristic env.setStreamTimeCharac0 码力 | 22 页 | 2.22 MB | 2 年前3
Streaming in Apache Flinktime: • Event time • Ingestion time • Processing time (default) final StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); env.setStreamTimeCharacteristic(TimeCharacteristic0 码力 | 45 页 | 3.00 MB | 2 年前3
Exactly-once fault-tolerance in Apache Flink - CS 591 K1: Data Stream Processing and Analytics Spring 2020env = StreamExecutionEnvironment.getExecutionEnvironment // set checkpointing interval to 10 seconds env.enableCheckpointing(10000L) // get the CheckpointConfig from the StreamExecutionEnvironment val0 码力 | 81 页 | 13.18 MB | 2 年前3
Fault-tolerance demo & reconfiguration - CS 591 K1: Data Stream Processing and Analytics Spring 20208efaa36f86af3a412343a176be3c108e/p39_1.jpg) ## Setting the max parallelism val env = StreamExecutionEnvironment.getExecutionEnvironment // set the maximum parallelism for this application env.setMaxParallelism(512)0 码力 | 41 页 | 4.09 MB | 2 年前3
Stream processing fundamentals - CS 591 K1: Data Stream Processing and Analytics Spring 2020Double) object MaxSensorReadings { def main(args: Array[String]) { val env = StreamExecutionEnvironment.getExecutionEnvironment val sensorData = env.addSource(new SensorSource)0 码力 | 45 页 | 1.22 MB | 2 年前3
共 11 条
- 1
- 2
相关搜索词
PyFlinkDataStream APITable APIStreamExecutionEnvironmentTableEnvironmentYARNJobExecutionResultFlink MLApache FlinkApache KafkaTaskManagerPartitionstate managementstream processingFlinkkeyed stateoperator stateWindow operatorsTime windowsWindow assignersTriggersKeyed vs non-keyed windowsProcessing timeEvent timeWatermarksStream progressAcknowledgment事件时间流处理管道Flink状态Exactly-oncefault-toleranceCheckpointingState consistency容错重新配置状态分区负载均衡资源管理data streamstream modelstream applicationreal-time













