## +24 ## Designing C++ Code Generator Guardrails: A Collaboration Among Outreach and Development Teams and Users CB BAILEY & SHERRY SONTAG 20 24 September 15 - 20 Bloomberg Engineering ## Designing Designing C++ Code Generator Guardrails A collaboration between outreach and development teams & users CppCon 2024 September 16, 2024 Sherry Sontag, Technical Expert CB Bailey, Software Engineer complained that we had violated “the principle of least astonishment.” We were offering a modern set of guardrails for Bloomberg’s 20-year-old Code Generator. Others responded before we could. They said they

containers • Are you prepared to handle Istio? • A full mesh is utopian, know what you need only • Guardrails for Istio ## Stabilizing Istio ## I stio sidecar proxy specifications Pod App container All approach currently as it is protocol-agnostic and works before live traffic. ## Stabilizing Istio ## Guardrails for Istio ☐ The service mesh is common to all users ☐ Any change to it spreads across the whole be checked at linter-level (inventory) Please check my last year presentation: “Preparing the guardrails for Istio at scale” (Slides, Video) for more details ## Stabilizing Istio ## Takeaways • Kubernetes

Contents What is an agent? 4 When should you build an agent? 5 Agent design foundations 7 Guardrails 24 Conclusion 32 ## I ntroduction Large language models are becoming increasingly capable of appropriate tools depending on the workflow’s current state, always operating within clearly defined guardrails. # When should you build an agent? Building agents requires rethinking how your systems make decisions External functions or APIs the agent can use to take action 03 Instructions Explicit guidelines and guardrails defining how the agent behaves Here’s what this looks like in code when using OpenAI’s Agents

build consistently high-quality apps, faster, without having to get into the source code. Security, guardrails, and routing logic are all built in. As a result, AI app development has accelerated dramatically deployment benefits from an open, experimental mindset, backed by rigorous evaluations, and safety guardrails. The companies seeing success aren’t rushing to inject AI models into every workflow. They’re aligning

requests. The result is a standard cluster development platform that spans environments with security guardrails and a common set of cloud-native patterns, like secrets management, in place that any development secure namespace with all the tools they need for development and monitoring.| |Built-in security guardrails|With RBAC, SSO, and Git's version control, you can make core DevSecOps practices the norm without

operations team manages platform-wide configurations for policies, security and compliance, ensuring the guardrails are in place. The role of the ops team is therefore to focus on enabling the development teams

6a8be7/p70_1.jpg) A “North Star”: We have to know the end use cases we’re aiming for Design guardrails: We have to know we're not going off on a side track Relatively easy for constexpr and GPUs:

MySQL performance is starting to tank - it’s okay, you’re prepared for this! Although the query guardrails and connection pooling are cool features that Vitess can offer to a single unsharded keyspace, MySQL performance is starting to tank - it’s okay, you’re prepared for this! Although the query guardrails and connection pooling are cool features that Vitess can offer to a single unsharded keyspace,

inputs and produced narrow outputs, agents promise to operate with goals, autonomy and certain guardrails. They promise to interpret intent, manage memory, and coordinate across apps to get real work done

MySQL performance is starting to tank - it’s okay, you’re prepared for this! Although the query guardrails and connection pooling are cool features that Vitess can offer to a single unsharded keyspace,