I was looking to do the same and I found this today, https://github.com/webbukkit/dynmap/issues/1019
This trick seems to work. Set "deftemplatesuffix" to something invalid, eg. "nope", and configure worlds.txt to look something like this:
worlds:
- name: FTB-Beta-A
title: "World"...