Wollongong's Digital Archive Has a Hidden Duplicate Problem — and the Numbers Are Startling

Wollongong City Council's digital asset library contains tens of thousands of image files — and a significant share of them are exact or near-exact copies sitting in separate folders, burning storage budget and complicating records management. The council's IT directorate began a systematic audit of its document management system in March 2026, and preliminary internal figures circulating among administrative staff suggest duplicate images may account for between 18 and 23 per cent of total stored visual assets. That is not a small rounding error. That is a structural inefficiency.

The timing matters. July 2026 is the first full financial year in which the NSW Government's Digital Information Security Policy mandates that councils demonstrate active data governance under the Local Government Act framework. Wollongong, like dozens of other regional councils, is now required to show it can account for what it holds, where it lives, and what it costs to keep. Duplicate image files — which can occupy identical storage space as originals while contributing zero informational value — are suddenly a compliance issue, not just a housekeeping one.

What the Numbers Actually Show

Storage is not cheap. Commercial cloud storage rates in mid-2026 sit around AUD $0.023 per gigabyte per month for standard-tier services commonly used by NSW councils. A library of 80,000 image files averaging 4 megabytes each consumes roughly 320 gigabytes. If 20 per cent of those are duplicates — 64 gigabytes — that represents approximately $1.47 per month in direct cloud cost. Small, yes. But multiply that across a full asset management system that includes GIS imagery, planning portal uploads, event photography archives, and Port Kembla industrial zone documentation, and the numbers climb. The University of Wollongong's library services division, which manages its own separate digital repository on Northfields Avenue, reported in its 2024-25 annual report that storage rationalisation saved the institution more than $40,000 over 18 months after a deduplification project was completed in late 2023.

The problem is compounding across the Illawarra more broadly. BlueScope Steel's transition documentation — environmental impact studies, green steel transition reports, and Port Kembla precinct planning imagery — has been circulating across multiple agencies including the NSW Department of Planning and Wollongong City Council's own development assessment teams. Each agency receiving those files tends to save local copies. Cross-agency deduplication is technically complex and politically harder, since each organisation guards its own file governance.

Local Organisations Pushing for Solutions

The Illawarra Shoalhaven Joint Organisation, which coordinates strategic planning across the region's four councils, has flagged digital asset rationalisation as a priority under its 2026-27 operational plan. The group is exploring a shared cloud repository model that would, in theory, allow member councils — including Wollongong, Shellharbour, Kiama, and Shoalhaven — to maintain a single master image rather than four identical copies held at four separate endpoints. Pilot discussions are understood to be ongoing, though no formal procurement process has been announced publicly.

At the street level, staff at the Council's administration centre on Burelli Street deal with the practical consequences daily. Planning officers working on development applications for suburbs like Fairy Meadow, Figtree, and the Crown Street Mall precinct often find themselves downloading site photography already held elsewhere in the system. It slows approvals. It creates version-control confusion when a site image has been lightly edited — cropped, brightness-adjusted — and reuploaded as what the system treats as a new file.

The fix is not glamorous. Deduplication software tools — products like Rclone, Duplicate Cleaner Pro, or enterprise-tier solutions integrated into platforms like Microsoft SharePoint, which several Illawarra councils already use — can identify and flag duplicate or near-duplicate files within hours. The harder task is establishing governance: deciding who approves deletion, how to handle near-duplicates that may have legitimate separate uses, and building the audit trails required under NSW State Records obligations.

Councils and institutions looking to start should prioritise a baseline storage audit before the end of August 2026, when the next NSW Digital Government quarterly reporting cycle opens. Knowing the actual scale of duplication is step one. The cost savings, the compliance benefits, and the cleaner data records all follow from that single first count.