Asynchronous communication, i.e. producer only needs to receive ack from broker 9 Communication patterns (I) Load balancing or shared subscription • A logical producer/consumer can be implemented by The broker can choose to send messages to consumers in a round-robin fashion 10 Communication patterns (II) Fan-out Several logical consumers (possibly implemented by several parallel physical processes) and basic comparison operators. • Constraints can be logically combined to form complex event patterns. • company == ‘Uber’ and price < 100 • Predecessors of Complex Event Processing (CEP) systems

conditions and actions to be taken when conditions are met. • Conditions are commonly described as patterns that can match input stream events on type, content, timing constraints. • Actions define how University 2020 Summary Today you learned: • there are various types of languages for data streams • patterns, transformations, declarative • traditional blocking operators don’t work on streams • non-blocking

anomaly detection framework for datacenters. Your framework will: • Detect “suspicious” event patterns • Raise alerts for abnormal system metrics • Detect invariant violations • Identify outlier tasks

maximum every 100 events? • clicks per user session? • faster than the batch size? • alerts when patterns occur? 50 t t+1 t+3 t+4 t+5 t+6 t+7 t+2 How would you compute… ??? Vasiliki Kalavri | Boston