Fix inference response access resulting in segfault

Fix inference response access resulting in segfault #426