They should expose the NN coefficients to the end user so that one can at least start from a known-better value. This problem would seem analogous to JIT warmup.