So the model developers rarely get feedback on what their models are doing, which is kind of undermining the whole AI paradigm... Gross. I didn't know that.
Inconsistent feedback (say, only reporting false positives and not true positives) also leads to bias, as well as a disproportional ratio of positive/negative feedback. But again, there's cost to train the model, which in this case the client has to bear (hint: they don't want to).
So the model developers rarely get feedback on what their models are doing, which is kind of undermining the whole AI paradigm... Gross. I didn't know that.
Inconsistent feedback (say, only reporting false positives and not true positives) also leads to bias, as well as a disproportional ratio of positive/negative feedback. But again, there's cost to train the model, which in this case the client has to bear (hint: they don't want to).