If you don't agree with the mediator's custody arrangement, then say so. What are your reasons?

If you don't go to court, they will apply for changes and since there is no one on your side, they may get the revised court order for custody. With full court powers behind them, you are screwed....

It is always best to reply...sitting on it and pretending it will go away won't help you too much.