Unicode slug handling

rob006

I'm curious why anyone would want this. For me https://forum.example.com/d/123-zolty-zolw looks way better and is more readable than https://forum.example.com/d/123-%C5%BC%C3%B3%C5%82ty%20%C5%BC%C3%B3%C5%82w. There is a reason why slugs are limited to latin characters.

Hari

rob006 at least as an option? Let users chose which one they want in the settings. Maybe you don't want it but we do 🙂

We want slugs to be like this https://discuss.flarum.org/d/30832-हिंदी-हमारा-देश-भाषाए-है

rob006

Hari We want slugs to be like this https://discuss.flarum.org/d/30832-हिंदी-हमारा-देश-भाषाए-है

But you won't get it. Special characters should be encoded and this is what browser will do. If you copy such URL from browser, you will get https://discuss.flarum.org/d/30832-%E0%A4%B9%E0%A4%BF%E0%A4%82%E0%A4%A6%E0%A5%80-%E0%A4%B9%E0%A4%AE%E0%A4%BE%E0%A4%B0%E0%A4%BE-%E0%A4%A6%E0%A5%87%E0%A4%B6-%E0%A4%AD%E0%A4%BE%E0%A4%B7%E0%A4%BE%E0%A4%8F-%E0%A4%B9%E0%A5%88, and Flarum can not change this behavior. So shared URLs will look like gibberish.

danielunited

I think this needs to be an extension, not part of Core. Unicode URLs tend to be problematic since many clients convert them to Latin characters, and it hurts SEO.

Hari

rob006 I am glad google understands the gibberish and brings the users that native language experience.

Though technically URL is https://en.wiktionary.org/wiki/%E0%A4%B9%E0%A4%BF%E0%A4%82%E0%A4%A6%E0%A5%80 but when we copy between browsers we mostly get https://en.wiktionary.org/wiki/हिंदी

Give it as an extra option we will chose whichever we like 🙂

rob006

Hari Can you share URLs to these pages? I tested https://ndtv.in/ and all I get are URLs with standard alphanumeric (latin-only) slugs.

Hari

rob006 https://ndtv.in/topic/हिंदी-खबर

Copy and paste the URL, do not copy to notepad and try to bring that text here 😂

https://www.google.com/search?q=inurl%3Aहिंदी&sourceid=opera&ie=UTF-8&oe=UTF-8

tankerkiller125

Hari Just copy pasting that first link direct from the browser to the browser in Edge (Chrome) URL bar back to here results in https://ndtv.in/topic/%E0%A4%B9%E0%A4%BF%E0%A4%82%E0%A4%A6%E0%A5%80-%E0%A4%96%E0%A4%AC%E0%A4%B0

I'm fairly certain for that all browsers it's standard to re-encode the text. HOWEVER, it may be because I'm in an English speaking country and all my preferences are set to English. I do not know how they behave when the defaults are set to other languages.

Hari

So the whole point is slug looks gibberish and you guys don't want to support this feature? At least as an option or an a extension 🙃

askvortsov

Hari it's already possible for everything except tags as an extension. I think the discussion is whether to include it as an option in core.

Hari

askvortsov if tags can't join the party that is okay. What we see is if the feature is in core it will be automatically taken care by the team. I know in a way it's a burden to the theme. If extension is a easy solution in terms of dev friendly .. let us go with extension. Both flarumates and Dev's will be happy.

I don't think why this can not be in core, because flarum can support utf8 out of the box and if needed admin can set it to unicode in the settings panel (like we change settings for usernames ID/full name)

Again go with whichever is easier to Dev's and future proof.

luceos

This proposal is going to be closed:

This PR adds utf8 slugs for tags: flarum/framework3588
This merged PR added utf8 slugs for discussions: flarum/framework3606

I think this solves the need for further slug handling. If not, feel free to flag the discussion.

PS all of this is coming in v1.5 😉