01 · Requirements surfaced too late.
What documentation a bill needed wasn't clear until it had already entered review, turning avoidable gaps into correction cycles. The information existed; it just arrived after submission. Theme B.
04 / Public service / UX research
A research study of a five-role bill-clearance workflow: mapping the lived process against the official one, auditing the paper workarounds that had grown up around it, and coding what came back into the four things that actually stopped a bill from moving.
Context
Employee bill clearance at the Controller General of Defence Accounts moves through preparation, review, correction, and approval - different people, different responsibilities, different information needs, one workflow. The department's opening request was a visual refresh of the internal system supporting it. This study is what was done instead of starting there.
It is presented here as a research case study only. The interface work that followed the submission is deliberately out of scope on this page: what is worth reading about this project is how the problem was located, not what the screens ended up looking like.
Research questions
The brief could have started with the existing pages. It started with the process instead, because five roles each had a different relationship to the same workflow and no screen audit surfaces that on its own. The questions were written to be answerable by observation rather than opinion.
RQ2 is the load-bearing one. A workaround is the cheapest available evidence of an unmet need, because someone has already paid to build it.
Method
Two methods, chosen so that each covered the other's blind spot. Process mapping could establish the sequence but not what people did when the sequence failed them; the workaround audit could show the failures but not where they sat in the flow.
| Method | Who took part | The question it carried |
|---|---|---|
| Process mapping, role by role | Auditors, Senior Auditors, AAOs, AOs and Sr AOs, in separate sessions per role | What is the real sequence of activities and decisions, as against the org chart's version? |
| Workaround audit | The same participants, at their own desks, with their own artefacts | Where has the digital process stopped being enough, and what grew up to cover it? |
A five-role workflow needed each role's own account of the sequence, not one department's summary of how the other four operate. Run as a single stakeholder workshop, the account would have converged on the official process - which was already documented, and was not the thing in question. Held separately, the accounts disagreed, and the disagreements were the findings.
Workarounds rarely surface when you ask someone to describe their job; they are experienced as "how the work gets done", not as compensation for a defect. They show up when you trace the sequence and ask what happens at the point where the system stops helping. Mapping the artefacts against the digital flow is what put each one at a specific handoff instead of on a general list of complaints.
Thematic analysis
Observations from the sessions were written up as discrete statements, each kept separate from my reading of it - what a participant did or said in one column, what I thought it meant in another. Codes were generated from those statements rather than from a prior framework, then clustered by shared underlying cause rather than by surface topic or by screen.
That last choice is the analytical step that mattered. Coded by screen, the output would have been a page-by-page audit and the department would have got its visual refresh. Coded by what prevented the bill from reaching its next stage, the same observations resolved into four recurring blockers - and those four sat under two themes.
| Theme | Blockers it accounts for | The shared cause underneath |
|---|---|---|
| A - The record described a document; the work needed an owner | "Pending" meant five different things · Every role saw the same flat view | The system modelled the bill's state but never whose turn it was, so ownership had to be reconstructed socially - by asking a colleague |
| B - Information arrived after the point where it could prevent work | Requirements surfaced too late · A returned bill lost its history | Everything needed to get a bill right the first time was available, but was presented downstream of the moment it would have been useful |
Findings
These are generalised descriptions. The work involves financial and employee records, so specific figures, bill references, and individual identities cannot be published.
01 · Requirements surfaced too late.
What documentation a bill needed wasn't clear until it had already entered review, turning avoidable gaps into correction cycles. The information existed; it just arrived after submission. Theme B.
02 · "Pending" meant five different things.
A bill marked pending could be waiting on review, on correction, on approval - or on nothing at all - with no way to tell which without asking someone. Theme A.
03 · Every role saw the same flat view.
Reviewers and approvers worked through the same undifferentiated screen a preparer used, with no structure suited to what their part of the job actually required. Theme A.
04 · A returned bill lost its history.
Corrections weren't connected back to what had been flagged, so a returned bill often meant re-learning the objection from scratch. Theme B.
Blocker 02 is the one I would lead with again. A single word standing in for at least four distinct states is not a labelling problem - it is a missing concept, and every social workaround in the audit existed to supply it.
Say-do gaps
Nobody in the study described the official process inaccurately. The gap was between that description and what the desks showed - and in a hierarchical setting, the desk is the more honest source. Each artefact below was doing a job the system had left undone.
| What the process said | What was actually there | What it revealed |
|---|---|---|
| The system tells you what a bill requires | A separate reference sheet kept to hand while preparing | Requirements were reachable but not present at the moment of preparation (Blocker 01) |
| A bill's status is visible to everyone on it | A phone call to find out what "pending" currently meant | Status was legible as a word and useless as a decision (Blocker 02) |
| The record travels with the bill | A physical file passed between desks alongside the digital one | The digital record held data; the paper one held context and history (Blockers 03, 04) |
Reading those three together is what made the diagnosis structural rather than cosmetic. The workarounds were not evidence that people disliked the interface. They were evidence that three specific pieces of information - what is required, whose turn it is, and what happened before - had no home in the system, and had been rehoused in paper and phone calls at a cost nobody was counting.
Submission
The findings were submitted as a recommendation set rather than as a screen critique, with each recommendation named against the blocker it answered so the department could accept or reject them individually.
The department's early expectation was a visual refresh; the pages looked dated and a cosmetic pass was the obvious next step. What moved the brief was not an argument about design quality, it was the workaround audit. Showing that a single "pending" label was standing in for at least four real states - and that people had built phone habits to compensate - was a traceable gap between what the system said and what the work required. Walking stakeholders through those artefacts directly, rather than summarising them in a deck, is what shifted the scope from a restyle to a structural change.
Not every recommendation survived intact. A proposed change to how corrections were tracked ran into legitimate audit and record-keeping requirements that an interface cannot design away; the accepted version had to carry that complexity rather than simplify around it. That was the correct outcome - the requirement was real, and I had underweighted how much of the existing density was doing legal work rather than accumulating by accident.
Limitations
Time-in-stage per handoff, correction-cycle frequency per bill, and the volume of status-check contact between roles - that third one being the direct measure of Blocker 02, and the cheapest of the three to collect. Agreeing those three measures before the change went in is the single thing I would do differently.
Reflection
Nothing in the submitted recommendation set came from a best-practice checklist. Each one traces to a blocker that only appeared once the process was mapped across five roles instead of one screen at a time, and the strongest evidence in the whole study was a physical file that somebody had decided to keep carrying. A bill-clearance system does more than collect data - it has to let five people trust the same record of a decision. Finding out where that trust was being rebuilt by hand was the work; the interface that followed was the easy part.