Reproducibility Matthias Boehm, Graz University of Technology, WS 2021/22 Agenda  Experiments and Result Presentation  Reproducibility and RDM  Reminder: Paper Project Selection 4 706.015 Introduction Experiments & Reproducibility Matthias Boehm, Graz University of Technology, WS 2021/22 Experiments and Result Presentation In Computer Science (Data Management) [Ioana Manolescu, Stefan Manegold: Performance experiments give directions for further improvements  Problem-oriented methodology Experiments and Result Presentation 6 706.015 Introduction to Scientific Writing – 03 Experiments & Reproducibility Matthias

(and most individ- ual components submitted to it) is expected to continue for quite some time. As a result, more time will be spent reading most of our code than writing it. We explicitly choose to optimize globals of class type, we do not allow namespace-scope static variables to be initialized with the result of a function, unless that function (such as getenv(), or getpid()) does not itself depend on any any other globals. However, a static POD variable within function scope may be initialized with the result of a function, since its initialization order is well-defined and does not occur until control passes

permitted. Use loops instead when things get more compli- cated. Yes: result = [] for x in range(10): for y in range(5): 6 if x * y > 10: result.append((x, y)) for x in xrange(5): for y in xrange(5): if x in range(10)] eat(jelly_bean for jelly_bean in jelly_beans if jelly_bean.color == 'black') No: result = [(x, y) for x in range(10) for y in range(5) if x * y > 10] return ((x, y, z) for x in xrange(5) accidentally handling None as 0). You may compare a value which is known to be an integer (and is not the result of len()) against the integer 0. Yes: if not users: print 'no users' if foo == 0: self.handle_zero()

cascading series of reformattings. That one-line change now has a “blast radius.” This can at worst result in pointless busywork, but at best it still corrupts version history information, slows down reviewers apostrophes. For example, “Müller’s algorithm” might become “Muellers algorithm”. 2. Divide this result into words, splitting on spaces and any remaining punc- tuation (typically hyphens). • Recommended:

Repair for Algorithmic Fairness. SIGMOD 2019  #3.3 Marina Drosou, Evaggelia Pitoura: DisC diversity: result diversification based on dissimilarity and coverage. PVLDB 6(1) 2012  Graphs  #4.1 Renchi Yang