GPU Tile 1 Tile 0 Xe LinkProject Goals - Offer high-level, standard C++ distributed data structures - Support distributed algorithms - Achieve high performance for both multi-GPU, NUMA, and multi-node reduce(par_unseq, z, 0, std::plus()); }Outline - Background (Ranges, Parallelism, Distributed Data Structures) - Distributed Ranges (Concepts) - Implementation (Algorithms and views) - Complex sparse matrices) - Lessons learnedOutline - Background (Ranges, Parallelism, Distributed Data Structures) - Distributed Ranges (Concepts) - Implementation (Algorithms and views) - Complex

program for a supercomputer? Introduce PGAS Model, RDMA Building Remote Pointer Types Building Distributed Data Structures Extending to GPUsThis Talk Background: how do we write a program for a supercomputer supercomputer? Introduce PGAS Model, RDMA Building Remote Pointer Types Building Distributed Data Structures Extending to GPUsThis Talk Background: how do we write a program for a supercomputer? Introduce Introduce PGAS Model, RDMA Building Remote Pointer Types Building Distributed Data Structures Extending to GPUsThis Talk Background: how do we write a program for a supercomputer? Introduce PGAS Model

CROSS-PLATFORM PITFALLS AND HOW TO AVOID THEM Erika Sweet (she/her) Microsoft C++ TeamWelcome to CppCon 2020! Visit our table at the Expo Hall https://aka.ms/cppcon/expo • Meet the Microsoft C++ Abdicating responsibility to CMake Reimplementing functionality that CMake has built-in to abstract platform and compiler specificsUse built-in CMake command line tools…. execute_process(COMMAND ${CMAKE_COMMAND} rget PUBLIC cxx_std_11) …instead of manually setting flags via CMAKE_CXX_FLAGSKeep your paths platform independent…. target_include_directories(myTarget PUBLIC $

CppCon 2024 sixit:: 5 ✅ Same Executable Cross Platform Different Contexts ❌ ❌ 1 (Sort of) 2 3 General Sanity, Testability Distributed Simulations, Games, especially RTS Algorithm correctness using the identically compiled files and run on systems that adhere to the IEEE standards. Cross platform synchronized network simulations or replays will not possible [sic].” - Most upvoted answer on

career in video games and embedded software • Started using C++ in 1995 • First cross-platform project in 1994Cross-Platform Architecture Goals • Take advantage of all platforms • Focus on the compiler • Minimize classes, an illustrative example from a larger project • Project build issues • Inclusion of platform-specific header files • Concept hierarchies • Class and Function DesignOCP: The Open–Closed Principle Adding new revisions to a feature has no effect on previously-implemented revisions.What is a Platform? • A specific set of features • A feature is an abstract unit of functionality requiring implementations

type erasurekey challenges we’ve faced building distributed systems with good performance and correctnesskey challenges we’ve faced building distributed systems with good performance and correctnesschallenges “messages” to other actors is non-blocking (no waiting!) ● same programming model whether local or distributed“actors” in C++ many actor libraries are based on low-level message-passing “send/receive” struct will often need to be shared and/or moved between execution resources (i.e., cores) but for distributed/network services, the data is often only shared with other machines and bouncing the data unnecessarily

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 2.4 Cross platform, build system agnostic . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 2 matching their settings. 8 Chapter 2. Introduction conan Documentation, Release 1.3.3 2.4 Cross platform, build system agnostic Conan works and is being actively used on Windows, Linux (Ubuntu, Debian ArchLinux, Raspbian), OSX, FreeBSD, and SunOS, and, as it is portable, it might work in any other platform that can run python. In the documen- tation, examples for a specific OS might be found, such as

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 1.4 Cross platform, build system agnostic . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 1 matching their settings. 4 Chapter 1. Introduction Conan Documentation, Release 1.19.3 1.4 Cross platform, build system agnostic Conan works and is being actively used on Windows, Linux (Ubuntu, Debian ArchLinux, Raspbian), OSX, FreeBSD, and SunOS, and, as it is portable, it might work in any other platform that can run python. In the documen- tation, examples for a specific OS might be found, such as

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 1.4 Cross platform, build system agnostic . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 1 matching their settings. 4 Chapter 1. Introduction Conan Documentation, Release 1.20.5 1.4 Cross platform, build system agnostic Conan works and is being actively used on Windows, Linux (Ubuntu, Debian ArchLinux, Raspbian), OSX, FreeBSD, and SunOS, and, as it is portable, it might work in any other platform that can run python. In the documen- tation, examples for a specific OS might be found, such as

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 2.4 Cross platform, build system agnostic . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 2 matching their settings. 8 Chapter 2. Introduction conan Documentation, Release 1.4.5 2.4 Cross platform, build system agnostic Conan works and is being actively used on Windows, Linux (Ubuntu, Debian ArchLinux, Raspbian), OSX, FreeBSD, and SunOS, and, as it is portable, it might work in any other platform that can run python. In the documen- tation, examples for a specific OS might be found, such as