@kDelta @EUCommission Mistakes, bugs and errors can always happen, neural networks are not special in this regard.
Medical and aircraft industry have checks upon checks. Scientific papers need to pass peer review before being published. Can a mistake still be made and not be detected? Of course. NNs don't change much here.
You are free to go and tell the laureates of the 2024 Nobel Prize in Chemistry that they can't use AI because it's unreliable and to "enjoy your dodgy proteins".