Western Australian businesses and government agencies are collectively wasting tens of thousands of hours annually managing bloated digital asset libraries riddled with duplicate and low-resolution images — a problem that has quietly ballooned alongside the state's infrastructure and housing boom. As the WA Labor government pushes forward with Metronet construction documentation and AUKUS-related defence procurement records, the volume of digital imagery being generated, stored, and mismanaged has reached a scale that asset management specialists say is no longer trivial.
The trigger is straightforward: more projects mean more photos. The Metronet program alone spans multiple active construction corridors from Yanchep in the north to Byford in the south. Each site generates daily photographic records. Without automated duplicate detection, the same image — shot from the same angle, seconds apart — can be filed dozens of times across shared drives, costing storage and, more critically, costing the time of whoever has to sort it later.
What the Numbers Actually Show
Research published by the International Association of Information and Image Management found that organisations without active duplicate-image policies spend between 15 and 35 percent of their digital asset management budgets handling redundant files. Apply even the lower end of that range to a mid-size Western Australian government department running a digital archive on, say, Perth's St Georges Terrace precinct, and the waste compounds fast. Cloud storage pricing in Australia currently runs from roughly $0.023 per gigabyte per month with major providers — a figure that sounds negligible until a library swells into the terabytes, which active construction and defence project archives routinely do.
The City of Perth, which manages extensive photographic archives covering everything from Northbridge streetscape records to Kings Park event documentation, operates under a digital records management framework aligned with the State Records Act 2000. That legislation requires Western Australian public authorities to keep records in formats that remain accessible and manageable — language that implicitly demands deduplication discipline, even if no regulation spells it out by name.
At the commercial end of the market, creative agencies clustered around Fremantle's West End and along Leederville's Oxford Street report that duplicate images sitting inside client-supplied asset packs are one of the most consistent time sinks in project onboarding. A studio receiving a construction client's photo folder ahead of a tender document design job may find hundreds of near-identical site images requiring manual review before a single layout is started. At standard Perth graphic design hourly rates — which industry surveys have pegged at between $95 and $150 per hour for mid-market studios — even four hours of duplicate triage on a single project represents a $380 to $600 hidden cost absorbed somewhere in the chain.
Automated Tools and What Perth Organisations Are Doing About It
Perceptual hashing and AI-assisted deduplication tools have matured considerably since 2020. Software platforms now commercially available can compare image libraries of 100,000 files in under an hour, flagging near-duplicates — images that are visually identical but saved at different resolutions or with minor compression differences — rather than just exact byte-for-byte copies. This distinction matters enormously for project photography, where a JPG shot at full resolution and a web-compressed version of the same frame will not share identical file hashes but are functionally redundant.
The Curtin University library system at the Bentley campus, which maintains extensive digital collections including research imagery, has explored automated metadata-driven deduplication as part of broader digital preservation planning. Similarly, organisations contracted to document AUKUS-related work flowing through HMAS Stirling at Garden Island face strict chain-of-custody requirements for photographic records — requirements that make duplicate file proliferation not just inefficient but a potential compliance problem.
For private businesses and public agencies alike, the practical path forward is the same: audit before you expand. Running a deduplication pass over an existing archive before migrating it to a new storage environment — a common requirement during the office relocations now sweeping Perth CBD as post-COVID lease patterns settle — can cut storage volume by 20 to 40 percent, according to digital asset management industry benchmarks. That is not a trivial saving when storage contracts are being renegotiated and IT budgets are under scrutiny. The data has been sitting in the library all along. Someone just needs to clean it up.