Fungi were consider plants (if macroscopic) or protists (otherwise) until the late eighties, so as a rule only young people know that mushrooms aren't vegetables. And anyway, the Darwinian classification scheme is not really relevant for the purposes of determining diet, unless your reason for not eating meat is because it's from the same Kingdom in the scientific nomenclature as yourself, which seems... unlikely to be a very common reason.