We discovered and "fixed" this issue during quality testing, but I just confirmed that single quotes are still broken.
We fixed a list of characters including carets and double quotes and didn't re-test the single quote specifically 😬
I have opened an issue to track the missing fix askvortsov1/rich-icu-message-formatter2
We'll discuss internally how we want to release the patch. We might group it with other things for a first 1.2 patch release.
PS: impact on SEO should be limited because the bug only affects the javascript version of the page. The nojs version of the page and social sharing previews shouldn't be affected.