One option would be to use something like a progress indicator, to denote that something is going to happen if the user holds it. For example, for the first 100-200ms, there could be no visualisation and after that you could display a radial progress indicator that fills up for 800-900ms around your cursor to denote that we're drag mode is going to start soon.
To make it even more obvious you could display a tooltip or a subtle non-distracting toast notification "keep pressing to start dragging".
This option is often used in video games (for example, opening chests and doors in Fortnite):
Another option is implementing some visual cue or animation for that. For example, making the element subtly progressively larger while being pressed to denote that something is about to happen. This way is used, for example, while starting drag on the springboard in iOS (here they make it seem as if icon sticks to the background and pressing it almost pulls it off of background to drag it):
]