Maori rock art just outside of Duntroon. This is the Takiroa site. The rock art is protected by fences, and some of it is missing, but you get a good idea of what it was about.
Elephant rocks is a cool little place you can explore in the Waitaki valley. You can follow the road from here all the way to Oamaru for a scenic detour.
Besides rock art there are some really cool limestone walls at the Takiroa art site.
Elephant rocks was used in the films for Narnia. It's a really cool place to explore. These boulders do inspire creativity.