Braking slowly wears away metal, and on rim brakes that metal is part of the wheel. Lay a straight edge across each rim's braking surface: if the track is obviously concave, curved inward, the rim is worn out and the wheel needs replacing.
On disc brakes, measure each rotor where the pads touch…