collaborate on solutions. This document refers primarily to program managers, developers, and users in a generic manner; however, programs must operate in a trusting and cooperative manner across the government on the development and evolution of an integrated IT system. The rapid pace of development and response to changes cannot accommodate a series of gate reviews and significant upfront documentation. Oversight

with website conversion rates up 50% b. A BRIEF HISTORY OF A/B TESTING i. Pioneered in direct response marketing ii. Early efforts required sending thousands of postcards/flyers and asking consumer

progress in support of tracking program cost and schedule status and metrics • The scenario is a generic SW program implementing an Agile development process • The scenario has defined a single product