On Fri, 25 Jul 2025 17:39:12 +0100 Mark Brown wrote:
On Fri, Jul 25, 2025 at 08:00:23AM -0700, Jakub Kicinski wrote:
Does anyone have ideas about crediting test authors or tests for bugs discovered? We increasingly see situations where someone adds a test then our subsystem CI uncovers a (1 in a 100 runs) bug using that test.
Using reported-by doesn't feel right. But credit should go to the person who wrote the test. Is anyone else having this dilemma?
Usually I'd do a reported-by for whoever actually looked at the test system, triaged the issue and reported it. Trying to credit test authorship separately to the testsuite gets cumbersome over time, tests get updated over time for a range of reasons (toolchain updates, adding more coverage, improvements in the testsuite's frameworks...) so it's often not just a single person. Hopefully the testsuite is keeping track of things well enough so mentioning the test will point people in the right direction.
Ack, it does get murky overtime. Also with pre-commit testing there usually wouldn't even be a bug in the tree to credit fixing.
I guess we just had a lucky(?) string of very clear cut cases where a good selftest led the maintainer noticing a crash in the CI, and fixing something.