Codify them & make them teaching storiesManaging in a Complex Domain • Open discussion - need interactive communication, try crowd-sourcing or positive deviance - allow people to discuss solutions that

Patrick Lightbody (New Relic)  Monitoring evolved from servers and networks to applications to what users do with applications Reflections on mountain moving, from the first year of USDS Mikey Dickerson

failure rate: how often software fails during production. Mean-time to recovery: how long it takes applications in the production stage to recover from failure. Key Principles to implementing a successful infrastructure must be measured and quantified, so that the total risks and impacts to software applications are understood.  Deploy immutable infrastructure, such as containers. The concept of immutable

recorded for auditing h. ENSURE SECURITY OF OUR SOFTWARE SUPPLY CHAIN i. Were often assembling applications from third-party components and integrating them with our business logic. We inherit the vulnerabilities objectives and integrate security telemetry into the same tools k. CREATING SECURITY TELEMETRY IN OUR APPLICATIONS i. Create relevant telemetry 1. Successful/unsuccessful logins 2. Password resets 3. Email

haven’t been introduced iv. Integration tests – ensure correct interaction with other production applications and services g. CATCH ERRORS AS EARLY IN OUR AUTOMATED TESTING AS POSSIBLE i. A test suite’s configuration of middleware 4. Copying packages to production servers 5. Restarting VMs, containers, applications, etc. 6. Generating configuration files 7. Run automated smoke tests 8. Running test procedures

a subset of the IS ICD scope and/or Capability Drop (CD) documents for smaller items such as applications (see Figure 13). Services and requirements oversight organizations have the flexibility to identify environment with enterprise platforms, IT programs will deliver capabilities via a series of applications or web services. IT systems must therefore be designed, developed, and maintained in concert The architecture can also promote the use of open source software and reuse of existing code or applications.29 Throughout the IT acquisition lifecycle, the enterprise architects serve as essential members

a subset of the IS ICD scope and/or Capability Drop (CD) documents for smaller items such as applications o Replace comprehensive Preliminary Design Reviews (PDRs) and Critical Design Reviews (CDRs)

impossible to use. There’s a million mandatory fields and most of the time, the drop down boxes for ‘applications affected’ don’t even have what I need. It’s why I’ve stopped even putting in change requests

life of the machine for which it is first written • Software is embedded in a cultural matrix of applications, users, laws, and machine vehiclesInvisibility • Software is invisible and unvisualizable

deployability? iii. Successful Brownfield transformations 1. CSG – COBOL mainframe and supporting applications a. They 2X release frequency b. Resulted in increased application reliability c. Reduced deployment