I can echo most of what was said above, and add that I had an
almost EpiPen reaction last night to the walnut oil in the paints my husband was using
in the next room. The proteins from the oil (however minute), were being stirred up in the air, which I breathed in and caused symptoms: itchy/puffy eyes, headache, stomach ache, and other seasonal-type, allergy symptoms. (I wasn't aware that he was painting at that time.)
Yeah, yeah, multi-symptoms reactions = Epi, and I really should have used it, looking back, despite symptoms being mild overall. Husband is now re-homing all his paints and art supplies that contain walnut oil. (He previously only used them when I wasn't home, until yesterday.)
So there's proof enough that incredibly minuscule proteins can be stirred up into the air and cause reactions. The art studio room has now been quarantined and I'm not allowed in until my husband can scrub everything clean, because traces are now everywhere.
So, yes, the situation you described could be extremely dangerous to a persons with low threshold peanut allergies. Even with peanuts in their shells, peanut residue is everywhere, and anything in that drawer, around that drawer, or possibly in that room could now be contaminated. It's not worth the risk. However, with someone with a much higher threshold, that may not be a problem at all. Always be conservative; assume the lowest threshold possible when creating a safe environment for someone with allergies.