We discovered and "fixed" this issue during quality testing, but I just confirmed that single quotes are still broken.
We fixed a list of characters including carets and double quotes and didn't re-test the single quote specifically 😬
I have opened an issue to track the missing fix askvortsov1/rich-icu-message-formatter#2
We'll discuss internally how we want to release the patch. We might group it with other things for a first 1.2 patch release.