Insights · Security & compliance

Build a compliance operating system with NIST CSF 2.0

A practical guide for engineering leaders. We’ll follow one fictional startup from a customer’s security questionnaire to a working set of controls, evidence and decisions.

By Greg Gzik, Principal and Founder16 min readIncludes a workbook you can tailor

A hospital network wants to store its imaging archive on Pied Piper. Before anyone signs, the hospital’s security team sends Richard Hendricks a questionnaire: how do you secure the software we’re about to depend on?

Richard needs an answer. His engineers need something more useful than “go implement a compliance framework.” They need to know what applies, what work is necessary, who owns it, and how to keep it working as the company changes.

That is the job of a compliance operating system: the people, practices and evidence that make your commitments part of everyday work.

On the Autom8 YouTube channel, we introduced a four-stage approach to building one: understand, establish, adapt and rethink. Here we put those stages to work against a real framework, the US National Institute of Standards and Technology’s Cybersecurity Framework, version 2.0.1 That’s a mouthful, so from here on we’ll call it NIST CSF, or just CSF. By the end, you’ll have a workbook tailored to your organization that holds the whole thing together.

AUTOM8 · THE FOUR STAGESSELECT A STAGE
A CYCLE,NOT A CHECKLIST01Understand02Establish03Adapt04Rethink
STAGE 01
Understand
What needs to be true for this business, and why?
YOU LEAVE WITH
A scoped register of outcomes and obligations, in plain language.
Jump to stage 01
STAGE 02
Establish
What repeatable work makes those expectations true?
YOU LEAVE WITH
Testable controls with owners, procedures and evidence.
Jump to stage 02
STAGE 03
Adapt
What changes when the business introduces a new architecture or product?
YOU LEAVE WITH
A change assessment with release conditions and funded improvements.
Jump to stage 03
STAGE 04
Rethink
Do the assumptions behind the safeguard still hold?
YOU LEAVE WITH
A decision record with evidence, limits and an accountable owner.
Jump to stage 04
Every new product, customer or technology sends you back to understanding.

Why NIST CSF?

NIST publishes CSF 2.0 for free, and it describes cybersecurity without prescribing a technology or a vendor. That makes it a good translator between what your customers expect and the work your engineers actually do.

KEEP THIS IN MIND THROUGHOUT

A CSF outcome is not automatically a legal or contractual requirement. Laws, contracts and assurance commitments decide what your business must do; those are your . CSF helps you organize the work around them and around your risks. If a customer needs a SOC 2 report, a CSF workbook won’t replace it.

You can read the whole framework as a PDF from NIST, or browse it with the tools on NIST’s Cybersecurity Framework site. We link back to the source every time we lean on it.

Meet Pied Piper

Our example company is borrowed, affectionately, from HBO’s Silicon Valley. In this story Pied Piper is a small B2B platform: customers upload files through an API, and Pied Piper compresses and stores them in a public cloud. Two engineering teams ship changes through a deployment pipeline. Everything about its security setup is invented for this article.

CEORichard HendricksGot the questionnaire. Wants a credible answer without stalling the roadmap.
COOJared DunnOwns the customer contracts, and remembers every promise in them.
PRODUCT ENGINEERINGDinesh ChugtaiLeads the application team and its repositories.
PLATFORM & SECURITYBertram GilfoyleRuns the platform, and security by default. Also looks after the old build server in the closet. He named it Anton.
ADVISORMonica HallHas watched a dozen portfolio companies go through this.

We’ll follow one slice of their work: software delivery and vulnerability management. That isn’t a complete security baseline. Identity, data protection, suppliers, detection, incident response and recovery all need their own look. A focused start makes the rest of the work visible.

GENERALObligationSomething your business must do because of a law, regulation, contract or promise to customers.
NIST TERMFunctionOne of six top-level groups of outcomes in CSF 2.0: Govern, Identify, Protect, Detect, Respond, Recover.
NIST TERMCategoryA group of related outcomes within a Function, such as Platform Security (PR.PS) within Protect.
NIST TERMOutcomeA specific result the framework describes, such as PR.PS-06. NIST’s formal name is Subcategory. Useful guidance; not automatically a requirement.
GENERALScopeThe boundary of what you’re assessing: a service, plus everything that can change it or reach its data.
NIST TERMCurrent and Target ProfileCurrent Profile: where you stand today against the outcomes you chose. Target Profile: where you intend to be.
GENERALControlA safeguard or repeatable activity that helps achieve an outcome by addressing a risk.
GENERALControl mappingLinking a control to the outcomes and obligations it supports, and recording what it leaves uncovered.
GENERALPolicyStates the expectation, and who can authorize exceptions to it.
GENERALProcedureExplains how a team carries out the expectation, step by step.
GENERALEvidenceRecords that show a control actually operated, for a stated scope and period.
AUDIT TERMPopulationEvery relevant item in scope for a period, such as all production changes last month.
AUDIT TERMSampleA subset examined from the population. Only meaningful once the population is known.
AUTOM8 · STAGE 01 OF 04

Understand the obligations

What needs to be true for this business, and why?

Before anyone picks a tool or adds a ticket to the roadmap, Richard pulls Jared, Dinesh and Gilfoyle into a room. They work through three questions:

  1. 01What assurance are customers actually asking for?The hospital wants its questionnaire answered now, and may ask for a SOC 2 report next year.
  2. 02What applies through law or regulation?Health data could bring privacy and sector rules into play. Jared books time with counsel.
  3. 03What has Pied Piper already promised in contracts?Jared pulls every signed agreement with a security clause in it.

The framework has an outcome for exactly this work. asks you to understand and manage the legal, regulatory and contractual requirements that apply to you. Notice what it leaves out: picking a framework doesn’t answer Richard’s three questions. Jared still has to find the commitments, and the people qualified to interpret them.

Learn how the framework thinks

It’s tempting to treat CSF as a checklist: find the rows, tick the boxes, move on. Resist that. The framework carries a way of thinking about security, and once your team shares it, every interpretation you make later gets easier to explain and defend. Three ideas do most of the work:

  • It describes results, not implementations. CSF says what should be true and leaves the how to you. That’s why Pied Piper can meet it with the tools it already has.
  • Its six run at the same time. They aren’t phases you finish one after another. Govern sets direction for the other five, continuously.
  • Its outcomes nest. Each Function holds , and each Category holds the specific outcomes you’ll work with. The outcome codes tell you exactly where each one sits.
NIST CSF 2.0 · THE SIX FUNCTIONSCSF 2.0 · SECTION 2
GovernSets strategy, expectations, roles, policy and oversight. It informs the other five, all the time.PIED PIPER’S SLICE
IdentifyUnderstand your assets, risks and where to improve.PIED PIPER’S SLICE
ProtectSafeguards that manage those risks.PIED PIPER’S SLICE
DetectFind and analyse possible attacks.
RespondAct on an incident once you’ve found one.
RecoverRestore what was affected.
Summarized from CSF 2.0.1 The pistachio tags show where the slice of work we follow in this article falls.
NIST CSF 2.0 · HOW TO READ AN OUTCOME CODE
PR.PS-06
PRFUNCTIONProtectWhich of the six Functions the outcome belongs to.
PSCATEGORYPlatform SecurityA of related outcomes: managing the hardware, software and services you run.
06OUTCOMEThe sixth outcomeSecure software development, built in and checked.

Every code works this way, so you can tell where an outcome sits without memorizing anything. NIST’s formal name for an outcome is a Subcategory.

Those six Functions belong to NIST. Our four stages sit alongside them, not inside them: the Functions describe what good security covers, and the stages describe how you work with a framework over time. Pied Piper’s slice lives mostly in Govern, Identify and Protect.

Draw the boundary

Next, the team decides what exactly they’re assessing. They start with the thing the hospital is buying and work outward. Scroll to follow along.

01 / 05

Start with what customers buy

Hospital staff upload imaging files through Pied Piper’s API. That API is the centre of the map.

02 / 05

Follow the customer’s data

Files land in object storage. Account details go to a managed Postgres database. A compression worker picks up jobs. Support tickets, sometimes with attachments, go to a third-party help desk. Wherever the data goes, the scope follows.

03 / 05

Add everything that can change it

Code reaches production from both teams’ repositories through the CI pipeline. The cloud console and single sign-on give admins direct access to the data. Then Gilfoyle mentions the old build server in the closet, which can still deploy straight to the worker.

04 / 05

Draw the line

The dashed line is Pied Piper’s . A narrow application boundary is no excuse to leave out a shared identity system or a deployment path that can change the service. That includes the build server.

05 / 05

Leave things out on purpose

The marketing site runs on a separate host with no route to production or customer data. The sales CRM holds prospects’ contact details, not customer files. Both stay outside this assessment, with the reason written down, so nobody mistakes “out of scope” for “forgotten.”

PIED PIPER · DATA FLOWSTEP 1 / 5
SCOPE · PIED PIPER APIHospital staffCUSTOMERSLoad balancerPied Piper APITHE SERVICEUPLOADSHelp deskSAAS SUPPLIERCompression workerPostgresMANAGED · ACCOUNTSObject storageCUSTOMER FILESACCOUNTSFILESJOBSTICKETS · ATTACHMENTSRepositoriesTWO TEAMSCI pipelineCloud consoleSSO · ADMINSDEPLOYADMINBuild serverON-PREMMANUAL DEPLOYMarketing siteSEPARATE HOSTSales CRMPROSPECTSOUT OF SCOPENO ROUTE TO PRODUCTIONOUT OF SCOPENO CUSTOMER FILES
SYSTEMEXTERNALDATA STORESCOPE / UNREVIEWED PATH
WHY IS THE BUILD SERVER IN SCOPE?

Dinesh pushes back. The build server only compiles our code. No hospital file ever touches it.

True, but it decides what code runs where the hospital’s files live. It holds credentials that can deploy to production, so anyone who can change a build job on it can ship code to the API without a review. Attackers know this. In the 2020 SolarWinds compromise, malicious code was added during the build and reached customers inside legitimately signed updates.7

Scope isn’t only the systems customer data flows through. It’s anything that can change the service or reach its data.

While they draw, Richard asks a second question: when we launch the next product, how much of this will we have to do again? The team keeps this boundary tight, but notes the pieces, like the pipeline and single sign-on, that could serve more than one product later.

Translate one outcome

With the boundary drawn, Dinesh picks one outcome and turns it into something his team can act on: , the framework’s outcome for secure software development. You can look up any outcome in NIST’s free CSF 2.0 Reference Tool2 or in Appendix A of the CSF 2.0 PDF.1 Step through Dinesh’s record with him.

STEP 1 / 7

Find it, and link to it

Dinesh searches for PR.PS-06 in NIST’s free online CSF 2.0 Reference Tool. Appendix A of the PDF has the same table. He records the code, its Function and Category, and a link, so anyone can check his source in one click.

Copy NIST’s words exactly

The wording goes into its own field, untouched. “NIST says this” and “we propose doing this” are different claims, and Dinesh wants them easy to tell apart.

Say what it means here

His first pass, in plain language. The team will pressure-test it in a moment.

Set the scope

He copies in the boundary the team just drew.

Describe today, honestly

No spin. A record that flatters you today is a record you can’t use tomorrow.

Leave the target open

Dinesh leaves this one blank on purpose. What “secure development” should mean for two small teams is a judgment call, and it deserves more than a sentence.

Write down what nobody knows yet

Every open question gets an owner. Gilfoyle takes this one.

SOURCE RECORD · O-03 · PR.PS-061 / 7 FIELDS
WHERE IT LIVESNIST CSF
Protect → Platform Security (PR.PS) → PR.PS-06 · CSF 2.0 Reference Tool · Appendix A, p. 20
NIST WORDINGEXACT · NIST
“Secure software development practices are integrated, and their performance is monitored throughout the software development life cycle.”
MEANING FOR USPIED PIPER
Think about security at every stage from design to maintenance, and check that those practices work.
SCOPEPIED PIPER
The API, its repositories, and the delivery and platform components that affect it, including the build server.
CURRENT STATECURRENT PROFILE
Normal application changes get peer review and automated tests. Nobody has checked infrastructure changes, the build server or emergency deploys.
TARGET STATETARGET PROFILE
TO BE AGREED · depends on how we read PR.PS-06
OPEN QUESTIONOWNER · GILFOYLE
Who owns the platform repositories, and which changes actually reached production?

Find the simplest faithful reading

That blank target state is the most important field on the record, and the step teams skip most often. Dinesh and Gilfoyle each draft what PR.PS-06 should mean in practice. Richard asks Monica to pressure-test both. She runs every draft through the same three tests.

PIED PIPER · PROPOSAL
  • We follow secure coding best practices.
  • Threat-model every pull request.
  • Block every merge on any scanner finding.
  • Monthly external penetration tests.
  • A 40-page secure development policy.
  • Threat-model changes that touch customer data or authentication.
  • Peer review and automated tests on every change, infrastructure included.
  • Every deploy goes through the pipeline, dependency scanning included.
  • A monthly check that every production change went through those steps.
Faithful to NIST’s wording?PARTLY
Names the topic, but skips the lifecycle and the monitoring.
Covers what Pied Piper promised?UNCLEAR
Nothing here the hospital could check.
Can the team run and check it?NO
There is nothing to check.
Faithful to NIST’s wording?YES
Covers the lifecycle, and then some.
Covers what Pied Piper promised?YES
Well beyond anything the hospital asked for.
Can the team run and check it?NO
Two small teams can’t sustain it. They’ll route around it, probably through the build server.
Faithful to NIST’s wording?YES
Design, build, test, release and monitoring each have a practice.
Covers what Pied Piper promised?YES
Gives the hospital something concrete and checkable.
Can the team run and check it?YES
Mostly what they do today, applied to every path.

Dinesh’s draft is too vague to test. Gilfoyle’s is faithful but so heavy that two small teams would start routing around it within a month. Monica’s version is mostly what they already do, applied to every path and checked regularly.

She adds a caveat: compare context before you copy anyone’s answer, hers included. Customer data, architecture, contracts and risk vary between companies. Where the team still disagrees, they take the question to someone qualified to settle it: security, legal, privacy or an assurance specialist.

AUTOM8

Aim for the simplest interpretation that stays faithful to the source and to your actual commitments. Simple enough that your team will run it every week; faithful enough to defend to a customer or an auditor.

From Current Profile to Target Profile

Monica’s version gives Dinesh what his record was missing: a target he can describe in practices, not adjectives. NIST has names for both ends. Your describes where you stand today against the outcomes you’ve chosen. Your describes where you intend to be. The work you and your team do to set up your compliance operating system is the bridge from one to the other. For PR.PS-06, Pied Piper’s bridge looks like this:

PIED PIPER · PR.PS-06 · HOW PRACTICES CHANGECURRENT PROFILETARGET PROFILE
DESIGNNobody reviews designs for security.Threat-model changes that touch customer data or authentication.
REVIEW AND TESTINGPeer review and tests on normal application changes.The same on every change, infrastructure included.
THE BUILD SERVERCan deploy straight to the worker.Builds only. Every deploy goes through the pipeline.
DEPENDENCIESUpdated when someone notices.Scanned in the pipeline on every build.
MONITORINGNobody checks whether the practices ran.A monthly check that every production change followed them.

Dinesh copies the right-hand column into his record’s target state, and each row becomes work with an owner. If you want NIST’s own format, it publishes guidance and a template for Organizational Profiles.3 The workbook at the end of this article adds the working records around it: controls, evidence, actions and decisions.

AUTOM8 · STAGE 02 OF 04

Establish the operating system

What repeatable work makes those expectations true?

Pied Piper now knows what needs to be true. Stage two is about making it true, every week, without anyone having to remember. That’s the job of a : a safeguard or repeatable activity that gets you to an outcome. Dinesh writes the first one in his own words.

C-01 · CONTROLLED SOFTWARE DELIVERYPIED PIPERChanges affecting the production service are assessed for risk, reviewed, tested, and deployed through an authorized path. Emergency changes use a defined exception route and subsequent review.

Those words are Pied Piper’s design choice, not a quote from NIST. Next Dinesh has to show which outcomes C-01 helps with, and be honest about how much. Linking the two is called . Pick an outcome below to see where C-01’s help runs out.

PIED PIPER · CONTROLC-01Controlled software delivery
C-01 HELPS WITH PR.PS-01Configuration practices for the application and platform changes that go through this process.
STILL UNCOVERED · WRITE IT DOWNPlatform configuration and baseline coverage still need assessing.
C-01 HELPS WITH PR.PS-06Review, testing, release and monitoring within this delivery scope.
STILL UNCOVERED · WRITE IT DOWNThreat modelling and design review. Reviewed pull requests don’t establish these.
C-01 HELPS WITH ID.RA-07Risk assessment and records for delivery changes and their exceptions.
STILL UNCOVERED · WRITE IT DOWNOther organizational changes and exception types.

Every link is partial, and that’s fine. One control can support several outcomes, and one outcome may need several controls. Writing down the limits is what makes the map useful: when a new framework arrives, these shared practices give you something to map against, but a similar-sounding label still isn’t proof of the same coverage.

Adobe shows how far this idea scales. To build its Common Controls Framework, it analysed the certifications its cloud business needed and rationalized more than 4,300 requirements, across more than 20 standards, into a few hundred controls of its own.5 It has since mapped those controls to NIST CSF too.6

REQUIREMENTS · 20+ STANDARDS4,300+
ADOBE COMMON CONTROLS~315
REAL EXAMPLE · ADOBEAdobe Common Controls Framework, as described by Adobe.5

Pied Piper won’t need hundreds of controls. The principle is the same at any size: write each control once, map it honestly, and reuse it.

Make the control operate

A control statement on its own does nothing. Four pieces make C-01 run. Follow one of Dinesh’s changes, a faster upload endpoint, as you scroll.

PIED PIPER · ONE CHANGE THROUGH C-011 / 4
CHANGEFaster upload endpoint · v4.12.0
01PolicyRICHARD
02ProcedureDINESH
03OwnerDINESH
04EvidencePIPELINE
01 · POLICY · RICHARDRichard writes one short page: production changes are controlled, and only named roles can approve an exception. A policy standardizes the expectation.
02 · PROCEDURE · DINESHThe procedure says how: a reviewer who isn’t the author, passing checks, and a deploy through the pipeline. Emergencies record the reason and approver, then get reviewed within a working day. Those rules are Pied Piper’s choice; NIST doesn’t prescribe them.
03 · OWNER · DINESHDinesh is accountable for C-01 working across the whole scope. Both teams run their parts, and Gilfoyle joins exception decisions. An owner keeps it working when nobody is watching.
04 · EVIDENCE · PIPELINEThe pipeline links the change, its review, test results, deploy approval and the deployed version. Emergency records are kept too. Evidence shows what actually happened.
Keep scrolling to move the change along.

The four pieces relate more than they stack. One policy can govern several controls, and one evidence source can serve several checks.

Add a second control

Gilfoyle takes the vulnerabilities. His control reads:

C-02 · VULNERABILITY IDENTIFICATION AND RESPONSEPIED PIPERVulnerabilities in the service’s inventoried software and dependencies are identified, validated, and prioritized by risk. Remediation or a time-limited authorized exception is tracked to an owner, and the resulting change is verified.

C-02 supports three of the framework’s outcomes, each in part:

  • finding, confirming and recording vulnerabilities
  • keeping software maintained
  • tracking exceptions when a fix has to wait

CSF won’t hand Gilfoyle a remediation deadline, so he has to propose response targets and who can approve an exception. A scanner alone won’t catch vulnerability reports from outside, either; that intake needs its own process. And a single fix now ties both controls together: C-02 finds and tracks the problem, and C-01 governs the change that solves it.

Collect evidence as the work happens

A month in, Richard wants to know whether C-01 is actually working. Gilfoyle goes looking.

PIED PIPER · ONE MONTH OF PRODUCTION CHANGESILLUSTRATIVE
48
Pipeline deployments last month.
Every one has a reviewer, passing tests and an approved deploy. It looks like a finished job.
Production changes in the cloud activity log.
The cloud provider logs every change to production, however it got there. Two never went through the pipeline.
Two hotfixes from the build server.
Late-night fixes, deployed straight to the worker. No review record and no test results, so there’s nothing to sample.
PIPELINE RECORDNOT IN THE PIPELINE
48 of 50 is not a 96% score. It’s two changes nobody could account for.

The lesson isn’t about how many records to check. Before you check any, make sure you know the full : every relevant change in scope for the period. A only tells you something once the population is complete. However tidy, 48 records can’t prove that an unknown path is covered.

So Pied Piper changes its routine:

  • Every month, reconcile pipeline records against the cloud activity log.
  • Investigate every difference, and keep what you find.
  • Automate collection where you can, then check that the automation still runs. A broken integration can quietly stop producing evidence you thought you had.

If an external audit comes later, the auditor decides what evidence and sampling that engagement needs. A clean routine makes that conversation much shorter.

Make gaps useful

The build server’s two hotfixes are a gap, and Richard is glad to know about them. A dashboard should help you act, so Pied Piper keeps four states apart:

Not assessedNobody has looked yet.
Gap identifiedKnown, owned, visible. Like those hotfixes.
OperatingWith evidence for the stated scope and period.
Operating, improvingWorking, with a further improvement planned.

A green cell isn’t proof, and a discovered gap is useful information. Aaron Verones has led engineering at several startups through their compliance work. When I interviewed him for our YouTube channel,8 he described finding missing historical communications at one of them. His team fixed the process and explained the gap. They couldn’t recreate work that had never happened.

At Pied Piper’s size, named people and a reliable manual routine are a sensible start. As you grow, GRC (governance, risk and compliance) software can connect mappings, owners, evidence and follow-ups for you. Someone still needs to understand how the pieces relate.

AUTOM8 · STAGE 03 OF 04

Adapt the controls

What changes when the business introduces a new architecture or product?

Gilfoyle moves the compression worker into containers. Pied Piper’s vulnerability procedure still describes patching virtual machines. Copy it across and you miss part of the job: building a patched image isn’t the same as replacing the vulnerable one in production.

The expectation in C-02 stays exactly the same. The procedure beneath it changes. Switch between workload types to compare:

C-02 · UNCHANGEDIdentify, validate and prioritize vulnerabilities; fix them or authorize a time-limited exception; verify the result.
  1. 01Find affected hostsFrom the maintained inventory.
  2. 02Apply the updateThrough C-01, or the emergency route.
  3. 03Verify the resulting stateThe host now runs the fixed version.
  1. 01Update the dependencyIn the image definition.
  2. 02Rebuild and validate the imageTests and scan pass on the new image.
  3. 03Publish the imagePublished is not the same as running.
  4. 04Deploy itThrough C-01, not from the build server.
  5. 05Verify the running versionConfirm what production actually runs. This is the step that proves the fix.
  1. 01Confirm the provider’s responsibilityWhat do they patch, and when?
  2. 02Record what you keepConfiguration, pinned versions, upgrade windows.
  3. 03Verify your partEvidence for the actions you retain.

“Managed” isn’t a complete answer to who does what, either. Gilfoyle writes down who handles each layer:

  • application dependencies and container images
  • worker-node updates and cluster versions
  • components the cloud provider operates

Before claiming the new worker is covered, he records its inventory, owner, procedure and evidence source. Generic control wording makes reuse possible, but it doesn’t prove a new service is covered, and it doesn’t stretch a SOC 2 report or a certification to include it.

The same reuse helps when the business takes on a new standard rather than a new architecture. Adobe maps each new standard to the controls it already runs and builds only what’s missing.6 When the hospital asks for a SOC 2 report next year, Pied Piper will start by mapping it to C-01 and C-02.

Separate the release condition from the roadmap

On an enterprise modernization project I describe on our YouTube channel, we faced eight months of estimated compliance work with three months to reach a releasable state. Some of it addressed real gaps. Some came from controls built around the architecture we were leaving behind. We grouped the work, brought in outside help, and reached a releasable state with real tradeoffs on the longer-term roadmap.

The lesson: separate meeting an obligation from meeting it at maximum maturity. Here’s how that plays out for the new worker:

MEETS THE OBLIGATION · BEFORE RELEASECheck every deployed image version by hand.Acceptable if it reliably gives the coverage and evidence Pied Piper needs.
IMPROVEMENT · ON THE ROADMAPAutomate the version reconciliation.Needs a real owner, committed capacity and a date.
STILL A GAPNo way to tell which version is running.A future plan doesn’t satisfy a requirement that’s unmet today.

Engineering and InfoSec need both: a straightforward path for new technology, and a credible place for security improvements on the roadmap. Without the second, engineering promises improvements that never get prioritized, and InfoSec has every reason to demand everything at the production gate. That burden discourages exactly the modernization the business needs. Give improvements owners, capacity and dates, then follow through.

Choose assurance partners who understand the systems they evaluate. Aaron’s advice from the same interview is to interview potential auditors for technical and business understanding. Their judgment stays independent, and the conversation gets better.

AUTOM8 · STAGE 04 OF 04

Rethink the process

Do the assumptions behind the safeguard still hold?

Pied Piper starts using AI to write code. Dinesh’s pull requests now arrive faster than anyone can review them, and he suggests replacing the reviewer with another agent. Before agreeing, Richard asks what the approval was supposed to establish in the first place.

Compliance people talk about the letter and the spirit of a requirement. The letter is the exact wording, such as “every change is reviewed by someone other than its author.” The spirit is the reason behind it: someone independent confirmed the change was correct, safe and intended. When an old method stops scaling, the spirit tells you what a replacement has to achieve.

So Richard breaks the reviewer’s job into its parts. A new tool may help with some without covering all of them. Try assigning each one:

PIED PIPER · WHAT IS THE APPROVAL FOR?
SCRUTINYCorrectnessDoes the change do what it claims?
SCRUTINYSecurityDoes it introduce a weakness?
SCRUTINYDesignDoes it fit the system we intend to have?
BUSINESS INTENTProduct intentIs this what the business asked for?
PRODUCTION AUTHORITYAuthorizationWho accepts the risk of shipping it?
THE PROPOSALAI assists with 2 of 4 review jobs. A named human keeps production authority.Production authority stays with a named person. Every “AI assists” needs evidence before it changes the gate.

The spirit helps you choose a workable method. It never cancels the letter: if a contract says a human reviews every change, a human still does, and the AI helps them do it well.

Evaluate before you change the gate

Instead of declaring the new process compliant, Richard asks Dinesh to write it up as a proposal:

ASSUMPTION
Human review supplies the scrutiny and authorization production changes need.
PROPOSAL
AI assists with analysis and testing. A named human keeps production authorization.
EVALUATION
Run the new checks alongside existing review for a bounded set of changes, including security-sensitive ones like customer-data access. Look for missed issues, disagreements, overrides and false confidence.
DECISION
Set acceptance criteria before judging results. Record what the checks establish, what they don’t, who is accountable, and what triggers a rollback.

Gilfoyle adds a question of his own: what can the agents reach? Customer data, credentials, review settings and deployment permissions all need checking. An agent that can change the checks used to approve its own work needs particular scrutiny. NIST’s Secure Software Development Framework4 offers more practices for secure development, but neither it nor CSF shows that a particular AI reviewer is effective. Where assurance is involved, bring the proposal and its evidence to your auditors early.

Use AI to do more of the security work

Rethinking should open doors too. Here’s Gilfoyle using an AI assistant on a real piece of compliance work: the container version of C-02’s procedure from the Adapt stage.

01 / 04

Ask, with the sources attached

Gilfoyle gives the assistant the C-02 control, two of the CSF outcomes it supports and Pied Piper’s cluster notes. He asks for a draft procedure that cites a source for every step.

02 / 04

Get a draft in minutes

Five steps come back, each with a citation. It reads well, which is exactly why the next step matters.

03 / 04

Check every claim against its source

Gilfoyle opens each cited source. Four steps hold up. The fourth invents a seven-day patch deadline, and PR.PS-02 sets no deadline at all. He replaces it with Pied Piper’s own target, marked to be agreed.

04 / 04

Run it, and keep the evidence

A convincing procedure isn’t the same as an operating one. Gilfoyle runs it on the next real finding, confirms the running image is the fixed one, and saves the record as evidence.

PIED PIPER · AI-ASSISTED DRAFTSTEP 1 / 4
GILFOYLE · PROMPTDraft a container vulnerability procedure for C-02. Use only the attached sources: C-02, PR.PS-02 and ID.RA-01 from CSF 2.0, and our cluster notes. Cite the source for every step.
ASSISTANT · DRAFT
01Rebuild the image when a fixed version of the dependency is available.[C-02]VERIFIED
PR.PS-02 sets no deadline. Gilfoyle replaces “7 days” with Pied Piper’s own response target, marked TO BE AGREED.
02Scan the rebuilt image before publishing it.[ID.RA-01]VERIFIED
PR.PS-02 sets no deadline. Gilfoyle replaces “7 days” with Pied Piper’s own response target, marked TO BE AGREED.
03Deploy through the pipeline, never from the build server.[C-01]VERIFIED
PR.PS-02 sets no deadline. Gilfoyle replaces “7 days” with Pied Piper’s own response target, marked TO BE AGREED.
04Patch worker nodes within 7 days of a critical finding.[PR.PS-02]NOT IN SOURCE
PR.PS-02 sets no deadline. Gilfoyle replaces “7 days” with Pied Piper’s own response target, marked TO BE AGREED.
05Confirm the running image digest matches the fixed image.[C-02]VERIFIED
PR.PS-02 sets no deadline. Gilfoyle replaces “7 days” with Pied Piper’s own response target, marked TO BE AGREED.
EVIDENCE · E-03Running image digest matches the fixed image. Saved to the evidence log.

The same pattern works elsewhere. AI can prepare dependency updates, suggest interpretations with links to the source, or build evidence collection. In every case people still verify the sources, tests, coverage and behaviour. Faster delivery helps when the company can still explain why a change is safe enough, and stand behind it.

Put the four stages to work

Start with one service, like Pied Piper did.

  1. 01UnderstandFind the sources and make their meaning explicit.
  2. 02EstablishConnect them to repeatable work and evidence.
  3. 03AdaptRevisit coverage when the architecture or business changes.
  4. 04RethinkChallenge the method when its assumptions change.

Then go back to understanding. New products, customers, threats and technologies keep changing the questions you need to answer.

THE WORKBOOK · .XLSX · EXCEL AND GOOGLE SHEETS

Build your own version

Everything Pied Piper built in this article, organized by stage. The Profile sheet lists all 106 outcomes in NIST CSF 2.0, grouped by Function and Category, so you can pick the ones that matter to you.

  • START HEREYour setupOrganization, scope, what’s deliberately out, and who owns what.
  • 1 UNDERSTANDProfile · ObligationsAll 106 CSF outcomes with NIST’s exact wording, plus the laws and contracts that bind you.
  • 2 ESTABLISHControls · EvidenceYour controls, their owners and procedures, and checks against the full population.
  • 3 ADAPTActionsGaps you must close now, kept apart from roadmap improvements.
  • 4 RETHINKDecisionsProposals to change how a control runs, and how you’ll evaluate them.
YOUR WORKBOOK

Ready to fill in. Your organization’s name goes on the cover.

PIED PIPER WORKED EXAMPLE

The same workbook, filled in with everything from this article. Keep it open beside yours.

No macros. In Google Sheets, use File · Import. Built in your browser; nothing you type leaves this page. Outcome wording is transcribed from CSF 2.0 Appendix A.

You have customers to protect, and something new to build. A good compliance operating system makes room for both.

Rubber Duck Session · No charge

Need a technical rubber duck? Bring me the messy version.

If the hard part is scope, control design, or the tradeoffs on your roadmap, think it through out loud with us before it becomes another release bottleneck. No polished brief. No obligation to turn it into a project.

References

Pied Piper and its people are borrowed from HBO’s Silicon Valley. The example and all figures about it are invented. Greg’s and Aaron’s cases are reported experience.

  1. [1]
    Framework · 2024The NIST Cybersecurity Framework (CSF) 2.0National Institute of Standards and Technology, February 26, 2024. NIST Cybersecurity White Paper 29. PDF
  2. [2]
    Reference toolCSF 2.0 Reference ToolNational Institute of Standards and Technology. Cybersecurity and Privacy Reference Tool (CPRT).
  3. [3]
    GuidanceCSF 2.0 Organizational ProfilesNational Institute of Standards and Technology.
  4. [4]
    Framework · 2022Secure Software Development Framework (SSDF) Version 1.1Souppaya, M., Scarfone, K., & Dodson, D. NIST SP 800-218.
  5. [5]
    Company frameworkThe Adobe Common Controls Framework (CCF)Adobe. Adobe Trust Center.
  6. [6]
    Company blog · 2020Common Controls Framework (CCF) by Adobe v4.0 now availableAdobe, November 19, 2020. Adobe Blog.
  7. [7]
    Government advisory · 2020Advanced persistent threat compromise of government agencies, critical infrastructure, and private sector organizationsCybersecurity and Infrastructure Security Agency, December 17, 2020. Alert AA20-352A.
  8. [8]