What a great question. As a general rule, it's good to flip positioning of iconography for RTL languages. So your bottom option, with the chevron on the left, is correct.
If you're curious, I'm basing this answer on lessons learned running as lead designer on multiple projects with the NYC DOE and NYC mayor's office, where all projects have to support 11 languages, including 2 RTL languages. The systems involve manual translation, so my work was being advised by fluent speakers.
You can see a lot of this "flipping" at play with the NYC DOE online public school application system (https://www.myschools.nyc/). The real meat of it is behind a login, but you can get a loose idea of things with https://www.myschools.nyc/en/account/create-account/ vs https://www.myschools.nyc/ar/account/create-account/. Check out the header and primary CTA