Study of neutron detector response and related systematic uncertainties in the NOvA oscillation analysis