Reproducibility Matthias Boehm Graz University of Technology, Austria Institute of Interactive Systems and Data Science Computer Science and Biomedical Engineering BMK endowed chair for Data Management Data”  MR/Spark: BigBench, HiBench, SparkBench  Array Databases: GenBase  #3 Machine Learning Systems  SLAB, DAWNBench, MLPerf, MLBench, AutoML Bench, Meta Worlds, TPCx-AI Experiments and Result speedup-only results (need absolute numbers for grounding)  #2 Additional Baselines  Alternative systems w/ different runtime and compiler  Usually, not directly comparable but important for grounding

Guide Google’s R Style Guide R is a high-level programming language used primarily for statistical computing and graphics. The goal of the R Programming Style Guide is to make our R code easier to read object systems, S3 and S4, both of which are available in R. S3 methods are more interactive and flexible, whereas S4 methods are more formal and rigorous. (For an illustration of the two systems, see Thomas

Scientific Papers Matthias Boehm Graz University of Technology, Austria Institute of Interactive Systems and Data Science Computer Science and Biomedical Engineering BMK endowed chair for Data Management TU Graz, Austria  BMK endowed chair for data management  Data management for data science (ML systems internals, end-to-end data science lifecycle)  2012-2018 IBM Research – Almaden, USA  Declarative Apache SystemML  2011 PhD TU Dresden, Germany  Cost-based optimization of integration flows  Systems support for time series forecasting  In-memory indexing and query processing Data Management Group

destructor (in an exception to the first rule, this should not be pure). See Stroustrup, The C++ Programming Language, 3rd edition, section 12.4 for details. Tagging a class with the Interface suffix lets alignment. • printf() specifiers for some types are not cleanly portable between 32-bit and 64-bit systems. C99 defines some portable format specifiers. Unfor- tunately, MSVC 7.1 does not understand some it more obvious to readers, as with auto. Template metaprogramming Avoid complicated template programming. Template metaprogramming refers to a family of techniques that exploit the fact that the C++

source code in the Java™ Programming Language. A Java source file is described as being in Google Style if and only if it adheres to the rules herein. Like other programming style guides, the issues covered both correct, so the method names checkNonempty and checkNonEmpty are likewise both correct. 6 Programming Practices 6.1 @Override: always used A method is marked with the @Override annotation whenever

Reading and Writing Matthias Boehm Graz University of Technology, Austria Institute of Interactive Systems and Data Science Computer Science and Biomedical Engineering BMK endowed chair for Data Management Trustworthy Sources  Archival publications, awareness of peer-review  From right communities (e.g., ML systems vs ML algorithms)  Reputation of website, authors, etc  Recap: Give Credit  Cite broadly, give