How many of these "we sandboxed it and said not to do Y, but then it went and did it!" stories would you consider necessary to disprove that?
It may be good at following rules 99.99% of the time but if someone launches a million times more parallel agents than they would hire humans, it might still be much worse in practice...
"We've been told we must find an effective drug candidate here, and to follow this process for evaluating the quality of the candidate, but actually we could subtly change the analysis like this to make this candidate look favorable enough..."
(And then compare that to deterministic algorithms...)
We are not perfect as human beings, and we can’t expect AI, which is modeled after us to be perfect too. This fear of AI is irrational.
The argument here is that AI can run permutations faster than any human can. And, feeding it a company’s proprietary data about what worked, what did not, how it worked and so on can be invaluable at accelerating the discovery process of new drugs.
How many of these "we sandboxed it and said not to do Y, but then it went and did it!" stories would you consider necessary to disprove that?
It may be good at following rules 99.99% of the time but if someone launches a million times more parallel agents than they would hire humans, it might still be much worse in practice...
"We've been told we must find an effective drug candidate here, and to follow this process for evaluating the quality of the candidate, but actually we could subtly change the analysis like this to make this candidate look favorable enough..."
(And then compare that to deterministic algorithms...)