Skip to content
  • Home
  • Blog
  • Automated metadata harvesting of Auckland Council's open transport data

Automated metadata harvesting of Auckland Council's open transport data

Early in April (prior to our launch of data.govt.nz), I met with Stu Smith and Helen Donaldson from the Auckland Council open data Community of Practice to demo and discuss data.govt.nz's new features.

Their new Geographic Information System open data portal has recently featured in NZ Surveying+Spatial Magazine and the article mentions that "harvesting links between data repositories is important".

I recorded a walk-through of the data preview features on data.govt.nz, including geojson map layers, geospatial searching and the tabular data explorer.

We also did a live metadata harvest of Auckland Council's transport data in the process (may as well get some work done at the same time right?).

I'm interested in getting more local and regional government open datasets to data.govt.nz and taking advantage of some 'easy-wins'.

For example, the geospatial portal Auckland Council use includes an international open standard data catalog harvesting endpoint used globally by many other open data portals. This endpoint automatically provides data.govt.nz with the metadata it needs to fully automate the update process.

"Metadata that informs you of when the data has been updated is gold, so metadata harvesting is the key to making open data relevant and current!" ~ Stu Smith, Auckland Council GIS team.

Auckland Council simply release their data via their open data portal as usual, and data.govt.nz checks the endpoint periodically to see if there's anything new or updated. If there is a change, data.govt.nz gets updated 'automagically', saving time, effort and making the process of open data release more sustainable in the long term.

If you’re a local or regional government open data custodian, get in touch if you'd like to talk about open data and how data.govt.nz can help New Zealanders discover and use your data.


Keep up to date with all things open data

Opt into your choice of regular open data emails.

  • Weekly blog digest email
  • Monthly open data newsletters
  • Updates on open data case studies