The Numbers Behind Perth's Duplicate Image Problem: How Councils and Agencies Are Counting the Cost of Digital Clutter

Perth-based councils and state agencies are sitting on tens of thousands of duplicate digital images across their asset management and property databases, a problem that IT auditors and records management specialists say is costing local government measurable time and money every financial year. The scale of the issue has sharpened focus on what happens when rapid digitisation outpaces proper data governance.

The timing matters. WA's state budget surplus — driven largely by iron ore royalties — has funded an accelerated push to digitise everything from Metronet corridor documentation to Stirling Naval Base infrastructure records. More images entering systems faster means more duplicates accumulating without structured review cycles to catch them. Industry data from the records management sector suggests duplicate files can account for between 20 and 40 per cent of unstructured digital storage in large public-sector organisations, though figures specific to WA government bodies are not publicly released.

What the Data Actually Shows

The City of Perth and the City of Stirling are among the larger metropolitan councils managing significant digital asset libraries that span everything from development application photos to park maintenance records. Councils in the inner suburbs, including those covering Northbridge, Subiaco and Scarborough, have in recent years migrated legacy image archives into centralised content management systems — a process that routinely surfaces duplicate problems that previously sat invisible across siloed hard drives and departmental folders.

A 2024 report from the State Records Office of Western Australia noted that unstructured data management remained a priority challenge for agencies transitioning to cloud-based systems. While the report did not publish agency-by-agency duplicate image counts, it identified image and document duplication as a recurring compliance gap. Storage costs for government cloud infrastructure in Australia averaged roughly $0.023 per gigabyte per month on standard commercial contracts as of late 2025, according to published AWS and Azure pricing schedules — a figure that sounds trivial until multiplied across libraries holding hundreds of thousands of image files.

Real estate is another pressure point. Perth's housing market has been running hot, with strong immigration-driven demand concentrated in corridors like the Forrestfield-Airport Link catchment and the growing suburb of Ellenbrook, now served by Metronet. Property listing platforms carry duplicate listing images when agents repost properties or when photographs are uploaded multiple times across different MLS-style feeds. REIWA, the Real Estate Institute of Western Australia, has previously acknowledged the need for cleaner data standards in listing submissions, though specific duplicate-rate figures have not been publicly released.

What Agencies and Councils Are Doing About It

Automated deduplication tools have become a standard line item in mid-sized IT procurement projects. The technology works by generating hash values — essentially unique fingerprints — for each image file and flagging identical or near-identical matches for human review or automatic deletion. Perth-based IT services firms operating out of the West Perth and Osborne Park commercial precincts have reported growing municipal tender activity in this category over the past 18 months, consistent with the broader digitisation push funded through state budget allocations.

The Department of Finance WA, which oversees whole-of-government ICT procurement, has a standing panel arrangement for data management services under the Common Use Arrangement framework. Agencies can draw on that panel without running individual tenders, a process that has accelerated adoption of deduplication tools across smaller statutory bodies that lack dedicated IT departments.

For organisations that have not yet run a structured audit, the practical first step is straightforward: commission a storage analysis using freely available tools — Microsoft's built-in duplicate finder or open-source alternatives — before the next budget cycle closes. Agencies on the Metronet corridor land assembly program, for instance, hold large volumes of site photography that accumulates duplicates at each project milestone. A single deduplication pass across a 500,000-image library can recover hundreds of gigabytes and reduce ongoing storage costs by a measurable margin from the first billing month. For Perth's councils heading into 2026-27 budget planning, that is a tangible saving — and a cleaner digital record for the infrastructure projects still years from completion.