Actually I just found out you can use the formrepeat as an expression for a repeat in the server action:
And now it is really quite easy to have a form with a form repeater AND all the good stuff from data formatting etc. Great stuff!