Journal quality can buffer this by getting better reviewers (MDPI shouldn’t be seen as having peer review at all, but peer review at the best journals–because professors want to say on their merit raise annual evals that they are doing the most service to the field by reviewing at the best journals–is usually good enough at weeding out bad papers), but it gets offset by the institutional prestige of authors when peer-review isn’t double-blind. I’ve seen some garbage published in top journals by folks that are the caliber of Harvard professors (thinking of one in particular) because reviewers use institutional prestige as a heuristic.
When I’m teaching new grad students, I tell them exactly what you said, with the exception that they can use field-recognized journal quality (not shitty metrics like impact factor) as a relative heuristic until they can evaluate methods for themselves.
Journal quality can buffer this by getting better reviewers (MDPI shouldn’t be seen as having peer review at all, but peer review at the best journals–because professors want to say on their merit raise annual evals that they are doing the most service to the field by reviewing at the best journals–is usually good enough at weeding out bad papers), but it gets offset by the institutional prestige of authors when peer-review isn’t double-blind. I’ve seen some garbage published in top journals by folks that are the caliber of Harvard professors (thinking of one in particular) because reviewers use institutional prestige as a heuristic.
When I’m teaching new grad students, I tell them exactly what you said, with the exception that they can use field-recognized journal quality (not shitty metrics like impact factor) as a relative heuristic until they can evaluate methods for themselves.