I was thinking the same. I’ve always had a “sensitivity” (?) to kiwi, mango, papaya, avocado, and melons (plus bananas and tree nuts when I was younger, but that seems to have disappeared). Never had an issue with latex.

I’ve been told that it is technically an allergy, but like you it’s not the kind (or at least magnitude) that will kill me - it just gives me an itchy, burning mouth and throat. I’ve never tried taking an antihistamine to alleviate the symptoms, though - I just avoid them. Don’t especially care for most of those anyway. Besides, it’s a very weak reaction so even if I do end up eating them it’s just kind of annoying.