Help in Jealous

I get really jealous if my hubby talks to another woman. His ex wife especially. But I know they have to for the kids. And I also know that he would never leave me for anyone else.
I hate feeling like this. Feels like I’m controlling him.
Recently started swinging hoping that would help. We had a couple which was ok. After that we started talking to a lovely girl who wanted to play with us both. Anyway we was all chatting in a three way convo. And I didn’t like what he was saying to her and vice versa. Silly because he has let me sleep with other men with him being there. I really want to get rid of this jealousy otherwise it will destroy my marriage 😢😢