I remember it was a bit tricky to find that information, but you have to use tripple colon for IPv6, and then basically have a dual stack, just like in nginx. Try something like this:
bind 0.0.0.0:80
bind :::80
First row is for IPv4, second one for IPv6.