i hope your feeling better.
got reply from a pro, he says its not completely horrible. most ventilation systems hes tested (not mitsi) the fans can push air in against the heat pump fans ok. the question becomes how much ventilation flow does it drop when the heat pump is on.
imho that should be tuneable, hopefully they have the ventilation flow set when the heat pump is on, and you get more ventilation than needed when its off. if they havn't done that there is a risk of the house becoming negative pressure (ventilation pumping more air out than in) which we never want in nz conditions. (we always want a tad positive pressure, even with balanced systems).
if your new diagram is right it only has ventilation on two ducts (lounge?) and not the bed rooms (not good).
if there is no one way damper in the system then there is a good chance ventilation will back flow through the heat pump and short circuit to the ventilation out duct when the heat pump is not on.
also what needs to be considered is if the heat pump filters are in the heat pump unit, or in the return grills. you don't want ventilation air pushing back through a filter and pulling dust out of a filter. also filters are restrictions, especially when clogged up, and that effects how much air flow goes where.
what i would do first is go get some cheap temp/humidity gauges (or data logger if want to spend $$) and see what the temps/humidity is like and importantly how it changes over the week, how variable it is.