Reaper's Anticipative FX Processing setting can cause a mismatch between the DAW and plugin playhead positions due to the render-ahead it introduces.
You can make the difference smaller by reducing the render-ahead time, or remove the offset altogether by disabling the setting in Preferences > Buffering > Anticipative FX processing.