from the Data Deluge? A case for file filtering in eBPF Giulia Frascaria October 28, 2020 1 The data deluge on modern storage 2 Compute node CPU Network Storage node Flash The data deluge on CPU Network Storage node Flash Data DoS in reverse! 11 Compute node CPU Network Storage node Flash Data So similar yet so different ● DoS is malicious ● Data transfer is business-critical ● We 12 So similar yet so different ● DoS is malicious ● Data transfer is business-critical ● We can blindly drop DoS 13 But could we reduce data transfer size? eBPF filter-reduce 14 Filter Reduce input

applications Data Storage • Easy to upgrade and downgrade • User data stored in home directory • Easy to migrate and replicate user data and configuration to another computer • User data saved in multiple are proprietary software which incur a license fee. Figure 1.6. Desktop Customisation Data Storage: User data is often located in multiple locations in Microsoft Windows, which can make backing up and place - the home directory. This makes the migration of data from an old computer to a new one easy, as well as keeping user specific backup data separate. 12 Chapter 1. Introducing Ubuntu Ubuntu Desktop

samples/second/core 16 bytes/sample compressed to 1.36 bit/sample Cheap ingestion & storage means more data for you Richard Hartmann & Frederic Branczyk @TwitchiH & @fredbrancz Intro to Prometheus Introduction Supports dozens of data sources Modern UI Allows for complex data manipulation and visualization Native Prometheus support New feature: Interactive exploration of Prometheus data Richard Hartmann &

problem-solving. ii. Telemetry – An automated communications process by which measurements and other data are collected at remote points and are subsequently transmitted to receiving equipment for monitoring development. Operations don’t just monitor what’s up or down. ii. Modern Monitoring architecture 1. Data Collection at business logic, application, & environments layer a. Events, logs, & metrics b. Common rotate, and delete 2. Event router responsible for storing our events and metrics a. Enables visualization, trending, alerting, & other good things b. Enable threshold-based alerting & health checks

sequential ● Tasks run on different nodes ● Task execution logic ○ Conditional ○ Retries ● Share data between tasks git build deploy 26 OpenShift GitOps Declarative GitOps for multi-cluster continuous versioned in Git ● Automatically syncs configuration from Git to clusters ● Drift detection, visualization and correction ● Granular control over sync order for complex rollouts ● Rollback and rollforward

evaluation, and various development tools such as secPaver, to simplify security configuration. Data center Cloud native Edge HPC Embedded/Industrial … CPU: x86, ARM, RISC-V DPU NPU Media Bus Server codes (PACs): The register value is authenticated before being used as a pointer to access the data or code, so as to defend against return-oriented programming (ROP) and jump-oriented programming incurred in managing the huge page memory. eXpress Data Path (XDP): An eBPF-based high performance, programmable network data path that processes data before network packets enter the network protocol

packets: It breaks the limitation of the TCP framework. This model adds an EDT timestamp to each data packet based on the scheduling policy, avoiding the delays caused by large queue buffers and bringing improvement in TCP performance. 9. MultiPath TCP: It improves performance and reliability in mobile and data scenarios. MultiPath TCP supports concurrent transmission of multiple substreams in load balancing sequential write performance of large solid-state drive (SSD) blocks and the performance of the double data rate (DDR) persistent memory. 12. io_uring: This is a new asynchronous I/O framework that supports

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 354 6 Visualization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . to set up Zabbix to monitor your environment, from setting up hosts to getting essential data to viewing data to configuring notifications and remote commands to be executed in case of problems. IT a fast reaction to server problems. Zabbix offers excellent reporting and data visualization features based on the stored data. This makes Zabbix ideal for capacity planning. Zabbix supports both polling

gigabytes Perform a system back up Before installing Ubuntu Server Edition you should make sure all data on the system is backed up. If this is not the first time an operating system has been installed storage configuration screen will install Ubuntu onto the selected disk, replacing any partitions or data already there. You can choose whether or not to set up LVM, and if you do, whether or not to encrypt Type 'exit' to return. You may run 'pb-sos' to gather diagnostic data Notice: In case one needs to gather system details and diagnostic data for IBM support, this can be done here by running ‘pb-sos’ (see

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 449 6 Visualization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . to set up Zabbix to monitor your environment, from setting up hosts to getting essential data to viewing data to configuring notifications and remote commands to be executed in case of problems. IT a fast reaction to server problems. Zabbix offers excellent reporting and data visualization features based on the stored data. This makes Zabbix ideal for capacity planning. Zabbix supports both polling