Stream Processing and Analytics Vasiliki (Vasia) Kalavri
 vkalavri@bu.edu Spring 2020 4/09: Flow control and load shedding ??? Vasiliki Kalavri | Boston University 2020 Keeping up with the producers rate? • drop messages • buffer messages in a queue: what if the queue grows larger than available memory? 2 ??? Vasiliki Kalavri | Boston University 2020 Keeping up with the producers • Producers can buffer messages in a queue: what if the queue grows larger than available memory? • block the producer (back-pressure, flow control) 2 ??? Vasiliki Kalavri | Boston University 2020 Load management approaches

Guest control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77 4.8 Memory overcommitment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77 4.8.1 Memory ballooning VirtualBox Watchdog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 191 9.21.1 Memory ballooning control . . . . . . . . . . . . . . . . . . . . . . . . . 191 9.21.2 Host isolation detection . . . . . . . 224 12.8.1 Cannot start VM, not enough contiguous memory . . . . . . . . . . . . 224 12.8.2 VM aborts with out of memory errors on Solaris 10 hosts . . . . . . . . 224 13 Security guide

Guest control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77 4.8 Memory overcommitment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77 4.8.1 Memory ballooning VirtualBox Watchdog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 191 9.21.1 Memory ballooning control . . . . . . . . . . . . . . . . . . . . . . . . . 191 9.21.2 Host isolation detection . . . . . . . 224 12.8.1 Cannot start VM, not enough contiguous memory . . . . . . . . . . . . 224 12.8.2 VM aborts with out of memory errors on Solaris 10 hosts . . . . . . . . 224 13 Security guide

Guest control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 4.8 Memory overcommitment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 4.8.1 Memory ballooning VirtualBox Watchdog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 186 9.21.1 Memory ballooning control . . . . . . . . . . . . . . . . . . . . . . . . . 186 9.21.2 Host isolation detection . . . . . . . 218 12.8.1 Cannot start VM, not enough contiguous memory . . . . . . . . . . . . 218 12.8.2 VM aborts with out of memory errors on Solaris 10 hosts . . . . . . . . 218 13 Security guide

Guest control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 4.8 Memory overcommitment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 4.8.1 Memory ballooning VirtualBox Watchdog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 174 9.22.1 Memory ballooning control . . . . . . . . . . . . . . . . . . . . . . . . . 174 9.22.2 Host isolation detection . . . . 205 12.8.1 Cannot start VM, not enough contiguous memory . . . . . . . . . . . . 205 7 Contents 12.8.2 VM aborts with out of memory errors on Solaris 10 hosts . . . . . . . . 205 13 Security

Guest control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 4.8 Memory overcommitment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 4.8.1 Memory ballooning VirtualBox Watchdog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 175 9.22.1 Memory ballooning control . . . . . . . . . . . . . . . . . . . . . . . . . 175 9.22.2 Host isolation detection . . . . 206 12.8.1 Cannot start VM, not enough contiguous memory . . . . . . . . . . . . 206 7 Contents 12.8.2 VM aborts with out of memory errors on Solaris 10 hosts . . . . . . . . 206 13 Security

7 Guest control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77 4.8 Memory overcommitment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77 4.8.1 Memory ballooning VirtualBox Watchdog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 191 9.21.1 Memory ballooning control . . . . . . . . . . . . . . . . . . . . . . . . . 191 9.21.2 Host isolation detection . . . . . . . . 225 12.8.1 Cannot start VM, not enough contiguous memory . . . . . . . . . . . . 225 12.8.2 VM aborts with out of memory errors on Solaris 10 hosts . . . . . . . . 225 13 Security guide

Guest control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79 4.9 Memory overcommitment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79 4.9.1 Memory ballooning VirtualBox Watchdog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 206 9.22.1 Memory ballooning control . . . . . . . . . . . . . . . . . . . . . . . . . 207 9.22.2 Host isolation detection . . . . . . . 243 12.9.1 Cannot start VM, not enough contiguous memory . . . . . . . . . . . . 243 12.9.2 VM aborts with out of memory errors on Solaris 10 hosts . . . . . . . . 243 13 Security guide

Guest control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 4.8 Memory overcommitment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 4.8.1 Memory ballooning VirtualBox Watchdog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 174 9.22.1 Memory ballooning control . . . . . . . . . . . . . . . . . . . . . . . . . 174 9.22.2 Host isolation detection . . . . 205 12.8.1 Cannot start VM, not enough contiguous memory . . . . . . . . . . . . 205 7 Contents 12.8.2 VM aborts with out of memory errors on Solaris 10 hosts . . . . . . . . 205 13 Security

Guest control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73 4.8 Memory overcommitment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73 4.8.1 Memory ballooning VirtualBox Watchdog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 173 9.22.1 Memory ballooning control . . . . . . . . . . . . . . . . . . . . . . . . . 173 9.22.2 Host isolation detection . . . . . . . 204 12.8.1 Cannot start VM, not enough contiguous memory . . . . . . . . . . . . 204 12.8.2 VM aborts with out of memory errors on Solaris 10 hosts . . . . . . . . 204 7 Contents 13 Security