I’ve been using colemak mod dh without remapping and would recommend that approach. I found it encourages me to use other more efficient motions when possible, and my brain has gotten pretty used to the new locations the times that I need to use hjkl.
No disrespect for the despecialized and other awesome work out there but 4k77, 4k80, and 4k83 are 100% the way to go.