The Numbers Behind Perth's Duplicate Image Problem: What the Data Reveals

Tens of thousands of digital image files held across Perth's local government, real estate and infrastructure databases are duplicates — identical or near-identical photographs consuming server storage, inflating record counts and, in some cases, causing genuine administrative errors. The issue has quietly grown alongside the city's rapid population and construction boom, and data managers at several Western Australian agencies are now treating it as an operational priority rather than a housekeeping footnote.

The timing matters. WA's state budget surplus has unlocked funding for accelerated digital transformation across government, and Metronet's ongoing rail corridor works — stretching from Morley to Ellenbrook and beyond — are generating thousands of site inspection photographs every month. When duplicate images slip through ingestion pipelines unchecked, asset condition records can be double-counted, tender documentation becomes unreliable, and storage costs compound faster than budget forecasters anticipate.

How Big Is the Duplication Problem?

Industry benchmarks from digital asset management research consistently place duplication rates in large unmanaged repositories between 20 and 40 per cent of total file counts. For a mid-sized WA government agency running an active infrastructure project, that translates to a meaningful slice of storage expenditure. Cloud storage costs for enterprise-grade government services in Australia typically run between $0.023 and $0.05 per gigabyte per month depending on the contract tier — figures that accumulate fast when a Metronet construction project can generate upward of 50,000 photographs across a single 12-month stage.

The real estate sector tells a parallel story. In suburbs like Baldivis in Perth's southern corridor and Alkimos on the northern coastal fringe — two of the fastest-growing residential areas in the state — property listing platforms routinely receive bulk photo uploads from developers selling off-the-plan stock. Duplicate render images and repeated floor-plan shots inflate individual listing records, skew automated valuation models that rely on image metadata, and occasionally cause listings to resurface in search results as though they are new stock when they are not.

The City of Stirling, one of Perth's largest local governments by population, administers development application records across suburbs including Scarborough, Innaloo and Mirrabooka. Planning and building documentation submitted digitally through the council's online portal has grown substantially since mandatory e-lodgement was progressively introduced. Where applicants submit multiple photo sets across amended applications, duplication of site photographs is a documented problem in the broader local government sector nationally, though individual councils vary in how aggressively they deduplicate before archiving.

Detection, Deletion and What Comes Next

Automated deduplication tools — software that computes perceptual hashes or checksums across image libraries to flag identical or visually near-identical files — have dropped significantly in price over the past three years. Open-source solutions capable of processing libraries of more than one million files now run on standard hardware. Enterprise platforms with audit trails suitable for government record-keeping compliance under the State Records Act 2000 (WA) are available from several Australian vendors, with licensing structures typically based on repository size rather than a flat annual fee.

The practical steps for organisations sitting on bloated image archives follow a fairly consistent sequence: inventory the full repository to establish a baseline file count; run a deduplication pass using hash-comparison tools; review flagged files against retention schedules; and archive or delete confirmed duplicates with a documented audit trail. For agencies subject to the Public Records Office of Western Australia's disposal authorities, deletion without authorisation carries compliance risk, so legal sign-off on disposal schedules should precede any bulk removal.

Perth-based digital records consultancies operating out of the CBD's St Georges Terrace precinct have reported growing inquiries from state government clients over the first half of 2026, a trend consistent with the Cook government's push to standardise data governance ahead of broader cloud migration projects. For private sector players in real estate and construction, the motivation is more straightforward: cleaner image libraries mean faster search, lower storage bills, and fewer embarrassing moments when a sold Alkimos house reappears on listing aggregators wearing someone else's photographs.