Quality / perspective

Wider coverage starts with knowing what is missing.

A conversation can be captured, transcribed and assessed, yet still leave a gap in the customer picture. A useful coverage measure follows the work all the way from the agreed population to a dependable finding.

ellio thinking 31 October 20266 minute read

Start with a denominator you can explain

Consider an illustrative month with 20,000 interactions in the agreed scope. The service receives records for 19,000, finds 18,000 usable and assesses 17,000. It has assessed 85 per cent of the original population. Reporting only the 17,000 assessed against the 18,000 usable would show roughly 94 per cent and leave the earlier gaps out of view.

Both measures can help manage the process, provided they are labelled. The customer operation needs to understand the complete view: what should have arrived, what arrived, what could be used and what was assessed. A claim about hearing every conversation requires much more than confirming that the assessment engine processed its input.

Agree what belongs in the population

Define the channels, work types, period and unit being counted. A call, chat session, email message and resolved case are different units. One customer need may span several. Distinguish the customer interaction from expert consultation within it, and agree how a later transfer is represented. Decide how abandoned contacts, reopened threads and interactions crossing reporting periods will be counted.

Agree legitimate exclusions before measuring performance, with the reason and owner recorded. Keep missing or unusable records visible within the relevant population instead of quietly removing them to improve the percentage. Where records arrive late, show how reporting is revised. Count duplicates once and retain enough information to reconcile the totals with the originating systems.

This is also a question of purpose and permission. Establish why each source is needed, who may access it and the agreed handling, retention and deletion arrangements. The ambition to understand a service does not by itself justify collecting every available piece of information.

Select the evidence for the question being asked. Measuring whether a promised follow-up occurred may require event records and dates. Assessing whether an explanation was understandable may require the conversation. A purpose that needs both should make that dependency explicit. This prevents a broad capture target from becoming a substitute for a usable assessment design, and makes it easier to explain why a missing source matters to the conclusion.

Follow coverage through five distinct stages

StageWhat it establishesA gap to make visible
In scopeThe agreed population of interactions for a defined purpose and period.An excluded channel or work type that limits the conclusion.
ReceivedA record arrived and can be matched to the source interaction.A missing file, delayed event or duplicate record.
UsableThe record contains enough reliable information for the intended assessment.Missing audio, poor transcription or incomplete context.
AssessedThe agreed analysis completed with an interpretable result.A failed process, unsupported case or unresolved uncertainty.
Acted onA finding reached an owner and the appropriate response was checked.An unreviewed alert or improvement with no accountable owner.

Respect the differences between channels

Voice assessment depends on the recording, speaker attribution and transcription. Noise, overlapping speech, names, numbers and negation can change meaning. A transcript that turns a correction into a confirmation could reverse the quality judgement. Test examples from the actual service and provide a route to the underlying evidence where permitted.

Text channels have their own difficulties. An email reply may quote an earlier message and repeat its content. A chat may include a bot, several advisers and a transfer into another channel. An attachment may hold the information that explains the request. Define what constitutes the conversation and which parts are available to the assessment.

ellio's digital agents consult human experts while retaining the customer interaction and hand over with context when required. A digital voice conversation can therefore contain several kinds of contribution. An expert query is not automatically another customer contact. Preserve the distinction in the evidence so coverage and quality reporting can show who informed the answer and who owned the decision.

Report coverage by channel and relevant work type as well as in total. A healthy overall number can conceal an unreliable source containing the very cases the business needs to understand. Fixing that source may be more valuable than increasing the processing volume elsewhere.

A readable transcript is only part of the evidence

The conversation describes what was said. The connected knowledge and intelligence explain why a particular action, moment or channel was chosen. Expert input may change that judgement, and operational evidence establishes whether the action occurred. Decide which facts the assessment needs; if one is missing, show the limit instead of treating the transcript as the complete decision.

For example, an adviser may say that a refund has been requested. The conversation alone cannot confirm that it was approved, issued or received. Assessing the explanation is a different task from assessing the completed outcome. Connect the relevant operational evidence where available and use an observation period suited to the work.

Assess the interpretation itself through reviewed examples. More complete capture can expose more interactions to the same mistaken rule. Keep the measurement of coverage separate from the evidence that a quality judgement is dependable. They are related requirements with different failure modes.

Make missing records an operational responsibility

Reconciliation should lead to a manageable set of exceptions: an unavailable source, an unmatched identifier, an incomplete recording, an unsupported language or a failed assessment. Each needs a responsible team and an agreed response. Some can be repaired and processed again; some must remain recorded limitations.

Return to the illustrative month. The missing 1,000 records, the 1,000 unusable records and the 1,000 unassessed usable records represent different problems. A source connection, recording quality and assessment processing may need different owners. Publishing one coverage percentage without that breakdown leaves the team unable to choose the right corrective action.

Track whether the gaps are concentrated in a particular customer need or period. Their effect may be more significant than their size suggests. Avoid presenting an incomplete view as representative until that question has been examined.

Give the findings somewhere useful to go

A wider view creates responsibility to decide what matters. Define which findings require immediate case review, which inform coaching and which belong with a process owner. Match the review demand to available specialist capacity, and monitor age and urgency in the queue.

Material findings need an appropriate response, including a reasoned decision that no further action is justified. Check completion and effect where a finding calls for a customer remedy or service change. The outcome then enriches the shared knowledge and supports reviewed improvements to guidance, recommendations and delivery. Coverage earns its value through that use of the evidence.

Prove the chain on a defined slice of the service

Choose one channel, one period and one assessment purpose. Reconcile the population through receipt, usability and assessment. Investigate a selection of missing and failed records, then trace useful findings to their owners. Present the result with the gaps and limitations intact.

This gives the business a practical basis for widening scope. The goal is a more dependable understanding of customer experience and a service able to act on it. The appropriate coverage commitment should follow the available sources, permissions, quality and operating capacity.

Your next step

How complete is the evidence behind your quality report?

Explore how ellio connects conversation coverage with dependable assessment and action.

Explore quality & improvement