As a rule of thumb, keeping wires short, that attach to any electronics, is a good idea.
The battery wires need not be long in this case. Typically these batteries do not have long leads anyway, so I would not go through the effort to trim them even shorter, without a good reason (ie you notice a significant difference).