Just be careful about what you intend for, I would say, regarding sex.
What do you mean?
I will explain in more detail my hypothesis, and take in it what helps you. It is just my opinion, so you have to use your own discernment about it, and discuss it with a health professional if you want to.
From what you say, I think that you have 2 very specific neuronal circuits in your brain: one that has been developed over years of porn addiction, and the other that is the "natural" circuit of normal sexual thought that is active when you see an attractive woman in real life or have sexual thoughts on your own.
The first circuit, which I would call the "porn circuit", when activated, leads to POIS symptoms. The other circuit, the "natural sex circuit", seems to be far less prone to cause POIS symptoms. What triggers one circuit or the other is the intent you hold in your mind, because, you say that touching your penis with no particular intent, like for applying cream, will not cause POIS symptoms, but if your intent is to search for porn material, you immediately get POIS symptoms when touching your penis. Our intent is what "steers" the train of the mind, and operates the switches that decide in which circuits our thoughts energy will be oriented. Needless to say, our intent is a powerful ability, and has to be used very consciously.
So, when I say that you need to be very careful of what you intend to do regarding sex, I mean that you need to avoid any intent to use porn material so that you do not trigger POIS symptoms. You have to "starve to death" the sex porn circuit, by never using it again, and never steering your mind energy toward it. In neurology, you learn that the more you trigger an used a particular neuronal circuit/habit, the more it becomes stronger and the easiest it is to trigger it. This is good if you develop a neuronal circuit to be better at a specific sport activity you are in training for, but it is not beneficial for you in the case of porn usage. Neurology also teaches us to that the less you stimulate a neuronal circuit, the weaker it gets over time.
In addition, you are better to reinforce the "natural sex circuit", and having normal, tied-to-reality, sexual thoughts, and normal sexual fantasies, and feeling attraction for real women that you see and meet in real life, because as you say, these do not trigger POIS symptoms for you. My hope is, that, if you rely on real-life fantasies while masturbating, like having normal, plain sex with an actual woman in real life that you feel attracted to ( no porn scenario), you may have less to no POIS symptoms. It may need some time, and a very discipline reprogramming of your brain, and imply a clear intent on your part to completely let go of porn and be genuinely interested in normal, actual sex. The main differences I see between normal sex and porn are that porn pushes on the level of stimulation intensity and objectifies the sexual partner, and normal sex puts more emphasis on the relational, emotional part of sexuality, with a normal level of sensual stimulation, but a true emotional bonding with the other person.
I hope my explanation makes sense to you ! Let me know what you think of my hypothesis.