There probably isn't an exact right or wrong answer, but being consistent is always better. There are cases when you want to emphasize a certain action more than others, in which case inconsistency may be what you want.
In this case, the
remove action is more heavily weighted, so unless you want to encourage users to do that, I'd suggest making the icons the same style.
If the icons do different things, then they should look different, and look different at a glance (especially if one is Remove).
I like yours, with one filled in and the other open. They look similar enough to live on the same page, but distinct enough to tell them apart easily.