machine learning on embedded devices C++ is widely used in embedded systems: ◮ Was designed with efficiency in mind ◮ Provides low-level access to hardware resources ◮ Provides high-level abstractions 9 std::ifstream labels_ifs{labels_path}; 10 std::string label; 11 std::vector labels; 12 while (getline(labels_ifs, label)) { 13 labels.push_back(std::move(label)); 14 } 19 / 502. Build interpreter 1 // consumption with 4 threads: 93MB 31 / 50Comparision with Python Comparision made with TensorFlow Lite’s label image.py C++ Python Running duration (s) 1 7 Number of threads Inference duration (ms) C++ Python

18What are types used for in programming? • Types are used for: • Abstraction • Documentation • Efficiency • Expressivity • Detecting errors • Safety 19What are types used for in programming? • Types Documentation • Efficiency • Carefully chosen type can lead to more efficient code. 22What are types used for in programming? • Types are used for: • Abstraction • Documentation • Efficiency • Expressivity 23What are types used for in programming? • Types are used for: • Abstraction • Documentation • Efficiency • Expressivity • Detecting errors • Doing something (by accident) that does not “fit” the type

of Vienna, Austria: founded 1365, >90000 students • Entertainment Computing Research Group • Efficiency and performance of game engines, AI, networking, VR … • Teaching: 3D Graphics, AI, Physics for a Job System - CppCon 2021 35 / 39 Speed Up and Efficiency Speed Up 𝑆 𝑛 : = 𝑇1 𝑇𝑛 Example: 𝑇1 = 100𝜇𝑠, 𝑇4 = 50𝜇𝑠 then 𝑆 4 = 2 Efficiency 𝐸 𝑛 : = 𝑆 𝑛 𝑛 Example: 𝐸 4 = 0.5 or 50% Questions 1.Minimum job size (CPU time) for 85/90/95% efficiency? 2.What is more efficient: function pointers, std::function, or coroutines?Helmut Hlavacs – Combining Co-Routines and Functions into

grail of efficiency leads to abuse. Programmers waste enormous amounts of time thinking about, or worrying about, the speed of noncritical parts of their programs, and these attempts at efficiency actually grail of efficiency leads to abuse. Programmers waste enormous amounts of time thinking about, or worrying about, the speed of noncritical parts of their programs, and these attempts at efficiency actually proper contexthttps://www.youtube.com/watch?v=dToaepIXW4s“C++ programmers talk all the time about efficiency, but they generally don’t know how to measure.” - Bjarne Stroustrup CppCon 2023 Keynote (literally

grail of efficiency leads to abuse. Programmers waste enormous amounts of time thinking about, or worrying about, the speed of noncritical parts of their programs, and these attempts at efficiency actually grail of efficiency leads to abuse. Programmers waste enormous amounts of time thinking about, or worrying about, the speed of noncritical parts of their programs, and these attempts at efficiency actually proper contexthttps://www.youtube.com/watch?v=dToaepIXW4s“C++ programmers talk all the time about efficiency, but they generally don’t know how to measure.” - Bjarne Stroustrup CppCon 2023 Opening Keynote

What kind • What plan10 Simplicity Efficiency Safety These are not always in tension Judicious abstraction  directly express intent11 Simplicity Efficiency Safety These are not always in tension tension Judicious abstraction  directly express intent12 Simplicity Efficiency Safety Chained comparisons Simple DRY & say what you mean Safe Cpp2 allows mathematically sound (transitive) chains Judicious abstraction  directly express intent if min <= index < max { ... }13 Simplicity Efficiency Safety These are not always in tension Judicious abstraction  directly express intent outer:

Andreas Fertig Write unique code! Fast and small C++ When efficiency matters Presentation Material CppCon, Aurora CO, 2024-09-17© 2024 Andreas Fertig AndreasFertig.com All rights reserved All programs Programming, CppCon, September 20 ■ Fast and small C++ - When efficiency matters, Meeting C++, November 16 ■ Fast and small C++ - When efficiency matters, code::dive, November 25 ■ Effizientes C++ - Tips Tips und Tricks aus dem Alltag, ESE Kongress, December 04 Training Classes ■ Modern C++: When Efficiency Matters, CppCon, September 21 - 22 For my upcoming talks you can check https://andreasfertig.com/talks/

compilation systems are completely unnecessary. They are only a means to improve the time and space efficiency of programs. After all, the central problem JiT systems address is a solved one: translating compilation systems are completely unnecessary. They are only a means to improve the time and space efficiency of programs. After all, the central problem JiT systems address is a solved one: translating compilation systems are completely unnecessary. They are only a means to improve the time and space efficiency of programs. After all, the central problem JiT systems address is a solved one: translating