Importing HTML into s9e/textFormatter

linc

I'm importing posts from a WYSIWYG editor and having some problems getting TextFormatter to respect some of the markup. This is generally using the parse() command on a custom Bundle and storing the output as Flarum content.

Specifically:

Sometimes img tags don't have a closing / and they get parsed as text.
Same with br tags lacking a closing /.
Minor illegal markup like a span around a div also results in the div being parsed as text.
Any   appears as text even with HTMLentities enabled.

Is there any way to get textFormatter to parse more liberally so I can finish a 1-time conversion of content? I've been playing with building a bundle, but the existing options don't seem to include a way to make it more permissive.

I'm at the point where I need to start doing regex on HTML (e.g. to manually add a closing / to self-closing tags) which is a real feel-bad hack that's never going to work even remotely reliably.

Going to preemptively drop a mention to @JoshyPHP in case they are around. 😁

JoshyPHP

If you post some concrete examples of the markup that doesn't get parsed as expected, I can look into it.

JoshyPHP

If you post some concrete examples of the markup that doesn't get parsed as expected, I can look into it.

If you have invalid HTML, it's probably best to fix it with a specialized tool beforehand. I think HTMLPurifier used to do that, not sure whether it works with modern PHP. Otherwise, PHP's own ext/dom can do some fixing when loading the markup into a DOMDocument.

By default, HTML content rules are enforced but you can specify your own manually. It's probably laborious and I wouldn't recommend it at that scale.

The HTMLEntities plugin exists to accept HTML entities as input, it will output Unicode characters.

$configurator = new s9e\TextFormatter\Configurator;

$configurator->HTMLElements->allowElement('img');
$configurator->HTMLElements->allowAttribute('img', 'src');
$configurator->HTMLElements->allowElement('br');
$configurator->HTMLElements->allowElement('span');
$configurator->HTMLElements->allowElement('div');
$configurator->HTMLEntities;

$configurator->tags['html:span']->rules->allowChild('html:div');

extract($configurator->finalize());

$text = '<img src=img.png><br><span><div>..&nbsp;..';
$xml  = $parser->parse($text);
$html = $renderer->render($xml);

die("$xml\n\n$html");

<r xmlns:html="urn:s9e:TextFormatter:html"><html:img src="img.png">&lt;img src=img.png&gt;</html:img><html:br>&lt;br&gt;</html:br><html:span><s>&lt;span&gt;</s><html:div><s>&lt;div&gt;</s>..<HE char=" ">&amp;nbsp;</HE>..</html:div></html:span></r>

<img src="img.png"><br><span><div>.. ..</div></span>