PhpBB migrate script - Updated for beta 5

Oldemar

I have a problem with Flarum. First time I have "Success" on phpBB_to_Flarum.php on all Steps.

Problem:
Almost all users have their avatar on phpBB. Can I see the automatically Flarum's avatar also? Or must "Upload a new avatar" one by one on Flarum?

There are polls on some topics on phpBB. But there is nothing on Flarum, only Extensions on Flarum. Can I have the poll's before on fof/polls or similar?

There are users that have private message on phpBB. But I can not see the private message on Flarum. Can I transfer from phpBB's private to Flarum's fof/byobu or similar?

There is lower and upper case on users on phpBB, ex. "John". But I can not see the upper case on Flarum, only lower case, ex. "john".

Some forums/topics are restricted on admin/mod on phpBB. Users are not see it. Can I have restricted forums/topics on Flarum?

I have posts on phpBB, i.e. 820 posts:
/public/u/john Posts (0) Oops! Something went wrong. Please reload the page and try again. DEBUG X
But I can not read anything on the topics, just busy on the mouse.

I have posted a new one on Flarum, so Posts is correct.
/public/u/john Posts (821) Oops! Something went wrong. Please reload the page and try again. DEBUG X
But I can not read anything on the topics, just busy on the mouse.

There is hundred of discussions on phpBB. Ex.
public/u/john/discussions Discussions (0)
It looks like there are no discussions here, but I can see many discussions already there.

There is a hundreds of mentions on phpBB. But I can not see the Flarum, it looks like there are no posts here. Ex.
/public/u/john/mentions

flarum/config.php 'debug' => true,

Current PHP version 7.4
allow_url_fopen on
display_errors on
error_reporting on
file_uploads on
include_path .:/opt/alt/php74/usr/share/pear
log_errors on
mail.force_extra_parameters
max_execution_time 1500
max_input_time 1500
max_input_vars 2000
memory_limit 1G
open_basedir
post_max_size 1G
session.save_path /opt/alt/php74/var/lib/php/session
short_open_tag on
upload_max_filesize 1G

Can you help me?

vulcano

Hi there, I'm trying to do the conversion but even with the script by @sivivan (This one) , which I modified to add the table prefix for phpbb_ (for some reason forum_ was hardcoded) I have plenty of errors.
A common output was

Wrong SQL: INSERT INTO discussion_tag (discussion_id, tag_id) VALUES( '5145', '6') Error: Cannot add or update a child row: a foreign key constraint fails (`flarum`.`posts`, CONSTRAINT `posts_discussion_id_foreign` FOREIGN KEY (`discussion_id`) REFERENCES `discussions` (`id`) ON DELETE CASCADE)

And while I can see all the tags and the discussions in the first page, I have a Resource not found error when trying to open one. All in all, I'd say, it's still messy. I'm trying to use it with the beta8, which is the version it was written for, so I don't know why I'm getting all this errors. I may have to read all of the sql structure of flarum and phpbb, but I'd really rather not do that.

@Oldemar how is it going to you? Did you manage?

Oldemar

@vulcano No, I'm stuck - same as you.

Btw, no need for old version, Dec 2, 2018,
but better have new version, May 21, 2019, but you said it both of them.

Maybe start newest with phpbb_to_flarum beta 0.8 again, and delete it with old version?

luceos

Oldemar if I don't forget I'll try to pull some of my code for bokt into an extension next week. Feel free to ping me on discord as a reminder 🙈

vulcano

luceos Hi, does this have something to do with the phpbb migration?

luceos

vulcano I've actually written Eloquent models inside Flarum that use the phpbb database and copy data over to Flarum. This includes:

User
Topic
Post
Forum

There are some differences though as I need to keep it in sync. As such I've stripped Flarum of using markdown, created a mentions fork that works with bbcode and have some other oddities (SMILIES_PATH anyone?). This still requires some work on my end, not much though because I already had everything working with a one-way migration.

Fantomen

luceos Fantastic. Refreshing thread 24/7 looking forward to the migration script/extension 🙂

I´ve had moderate success with the old script; one classic error for an old forum (2005) is that some users have their email-address for two different users causing migration to hang.

vulcano

luceos I'm not sure what Eloquent is as I'm not (yet) much inside of how flarum works, but if that works it's awesome!

@Fantomen while toying around with the migration I solved it by running a query before the migration and in case of duplicate email address I'd just append a "1" at the end of one of the two addresses... it was around 70 users with double email in my case, so I could just solve them manually once the user contacts me with the issue

luceos

@Fantomen is testing my early version of the migration extension, progress can be followed at https://github.com/Bokt/flarum-phpbb-migrate. Once it's properly tested and offers a fallback for log in I will tag add it to packagist/composer and tag a version.

vulcano

luceos Let me know if you need further help testing it, I'd be glad to

Buster

I have updates on my migration in case that someone hits problems similar to the ones I encountered: I did some testing on using Apache instead of Lighttpd and most of them seemed to go away, so sadly Lighttpd is not supported ☹️

vulcano

Buster Yeah I'd be curious, how is it going? @luceos is working on an extension to migrate, so I'm waiting for that to be done before migrating

Buster

vulcano I haven't made the migrated forum go live yet, but now it seems to be working fine

vulcano

Buster mind sharing the script(s)?

luceos

My apologies for the silence, work and life took over. The code is still public and I will do my best to complete an initial version the coming months.

Fantomen

luceos No worries - we are just happy that you are looking in to it 🙂

vulcano

luceos Thank you! Take care of your life first, meanwhile we are very happy you are still working a bit on it! Can't wait for this to happen!

clarkwinkelmann

This script uses SET FOREIGN_KEY_CHECKS=0 which can cause a plethora of issues.

One of those issues are the user ID foreign keys containing invalid data.

For future reference, those broken foreign keys can be set to null with the following commands:

Use at your own risks. Don't run commands on production server without test.

UPDATE posts p
LEFT JOIN users u ON u.id = p.user_id
SET user_id = null
WHERE u.id IS NULL

UPDATE posts p
LEFT JOIN users u ON u.id = p.edited_user_id
SET edited_user_id = null
WHERE u.id IS NULL

UPDATE posts p
LEFT JOIN users u ON u.id = p.hidden_user_id
SET hidden_user_id = null
WHERE u.id IS NULL

UPDATE discussions d
LEFT JOIN users u ON u.id = d.user_id
SET user_id = null
WHERE u.id IS NULL

vulcano

Is there any news regarding this migration tool?

Prcek

Fantomen Did you make the migration? If so, could you share the modified script?

Yes. Now I run Flarum in production for more than year (260k+ posts / 8500k+ users). Still on beta-11 for extension compatibility (Byōbu) reason. I used the default phpBB migration script with a lot of ex-post in-table SQL modifications.

Update 6/2021: Now running Flarum 1.0.2

« Previous Page