If they manage to create a differentiable information retrieval system (i.e. a database that informs neural nets about facts) then the hallucination part might go away.