Nitro Porter, the inter-software migration toolkit

ymaohyd

ymaohyd An update on the 'stalling' problem... it wasn't stalling after all it was me just not being patient enough to wait a few hours.

Am delighted the port from Vanilla worked and thank you so much @linc for creating Nitro Porter - you are a saviour!

Here is the full porter.log for anyone who may find it handy for gauging progress on their migration:

[2023-05-09T20:26:38.983973+02:00] porter.INFO: Permissions are not migrated. Verify all permissions afterward. [] [] [2023-05-09T20:26:38.985694+02:00] porter.INFO: Source: Vanilla 2+ (source) [] [] [2023-05-09T20:26:38.985772+02:00] porter.INFO: Target: Flarum (test) [] [] [2023-05-09T20:26:38.985818+02:00] porter.INFO: Flag: Use Discussion Body: Enabled [] [] [2023-05-09T20:26:39.578169+02:00] porter.INFO: export: Category — 5 rows, 00.44s (5.7mb) [] [] [2023-05-09T20:27:13.077952+02:00] porter.INFO: inserting 'Comment': 100,000 done... [] [] [2023-05-09T20:27:14.742256+02:00] porter.INFO: export: Comment — 104925 rows, 35.12s (8.8mb) [] [] [2023-05-09T20:27:15.932796+02:00] porter.INFO: export: Conversation — 92 rows, 00.57s (6.2mb) [] [] [2023-05-09T20:27:17.246147+02:00] porter.INFO: export: ConversationMessage — 367 rows, 01.25s (6.6mb) [] [] [2023-05-09T20:27:20.745255+02:00] porter.INFO: export: Discussion — 5804 rows, 03.46s (9.2mb) [] [] [2023-05-09T20:27:22.911482+02:00] porter.INFO: export: Media — 1346 rows, 02.04s (7.3mb) [] [] [2023-05-09T20:27:23.543846+02:00] porter.INFO: export: Role — 6 rows, 00.27s (6.2mb) [] [] [2023-05-09T20:27:23.952708+02:00] porter.INFO: export: Tag — 0 rows, 00.31s (0b) [] [] [2023-05-09T20:27:24.644496+02:00] porter.INFO: export: TagDiscussion — 0 rows, 00.65s (0b) [] [] [2023-05-09T20:27:26.194744+02:00] porter.INFO: export: User — 890 rows, 01.50s (9.7mb) [] [] [2023-05-09T20:27:33.271284+02:00] porter.INFO: export: UserComment — 50329 rows, 07.02s (6.7mb) [] [] [2023-05-09T20:27:33.716320+02:00] porter.INFO: export: UserConversation — 189 rows, 00.31s (6.4mb) [] [] [2023-05-09T20:27:46.466284+02:00] porter.INFO: inserting 'UserDiscussion': 100,000 done... [] [] [2023-05-09T20:27:59.991105+02:00] porter.INFO: inserting 'UserDiscussion': 200,000 done... [] [] [2023-05-09T20:28:03.367277+02:00] porter.INFO: export: UserDiscussion — 232937 rows, 29.33s (6.9mb) [] [] [2023-05-09T20:28:04.158052+02:00] porter.INFO: export: UserMeta — 44 rows, 00.62s (6.2mb) [] [] [2023-05-09T20:28:04.783672+02:00] porter.INFO: export: UserRole — 602 rows, 00.55s (6.5mb) [] [] [2023-05-09T20:28:05.600325+02:00] porter.INFO: export: Badge — 47 rows, 00.60s (6.3mb) [] [] [2023-05-09T20:28:06.893876+02:00] porter.INFO: export: UserBadge — 3053 rows, 01.29s (6.8mb) [] [] [2023-05-09T20:28:07.318931+02:00] porter.INFO: export: Rank — 7 rows, 00.35s (6.2mb) [] [] [2023-05-09T20:28:08.227444+02:00] porter.INFO: export: ReactionType — 6 rows, 00.66s (6.2mb) [] [] [2023-05-09T20:28:16.825351+02:00] porter.INFO: export: UserTag — 51907 rows, 08.60s (6.8mb) [] [] [2023-05-09T20:28:18.503046+02:00] porter.INFO: import: users — 890 rows, 01.39s (7.4mb) [] [] [2023-05-09T20:28:19.272338+02:00] porter.INFO: import: groups — 6 rows, 00.46s (6.4mb) [] [] [2023-05-09T20:28:20.435970+02:00] porter.INFO: import: group_user — 602 rows, 01.16s (6.7mb) [] [] [2023-05-09T20:28:21.227644+02:00] porter.INFO: import: tags — 4 rows, 00.79s (6.4mb) [] [] [2023-05-09T20:28:21.229690+02:00] porter.INFO: Mentions map memory usage at 6.9mb [] [] [2023-05-09T20:28:33.065885+02:00] porter.INFO: import: discussions — 5804 rows, 11.71s (7.7mb) [] [] [2023-05-09T20:28:36.922882+02:00] porter.INFO: import: discussion_tag — 5804 rows, 03.86s (7mb) [] [] [2023-05-09T20:28:55.873702+02:00] porter.INFO: inserting 'discussion_user': 100,000 done... [] [] [2023-05-09T20:29:29.846282+02:00] porter.INFO: inserting 'discussion_user': 200,000 done... [] [] [2023-05-09T20:29:40.963553+02:00] porter.INFO: import: discussion_user — 232937 rows, 1:04.04 (7mb) [] [] [2023-05-09T20:36:52.072469+02:00] porter.INFO: inserting 'posts': 100,000 done... [] [] [2023-05-09T20:39:24.207320+02:00] porter.INFO: import: posts — 110729 rows, 9:39.94 (45.4mb) [] [] [2023-05-09T20:39:26.219688+02:00] porter.INFO: import: badges — 47 rows, 02.01s (11.2mb) [] [] [2023-05-09T20:39:29.705156+02:00] porter.INFO: import: badge_user — 3053 rows, 03.49s (11.7mb) [] [] [2023-05-09T20:39:29.705870+02:00] porter.INFO: Skipping import: Polls (Source lacks support) [] [] [2023-05-09T20:39:31.334059+02:00] porter.INFO: import: reactions — 6 rows, 01.63s (9mb) [] [] [2023-05-09T20:40:32.582306+02:00] porter.INFO: import: post_reactions — 51899 rows, 28.43s (9.5mb) [] [] [2023-05-09T20:40:32.688476+02:00] porter.INFO: Discussions offset for PMs is 6312 [] [] [2023-05-09T20:40:36.427711+02:00] porter.INFO: import: discussions — 92 rows, 03.70s (9mb) [] [] [2023-05-09T20:40:37.204954+02:00] porter.INFO: Posts offset for PMs is 111784 [] [] [2023-05-09T20:41:08.806377+02:00] porter.INFO: import: posts — 367 rows, 31.60s (11.3mb) [] [] [2023-05-09T20:41:12.189718+02:00] porter.INFO: import: recipients — 189 rows, 03.38s (11mb) [] [] [2023-05-09T20:41:18.167991+02:00] porter.INFO: import: fof_upload_files — 1346 rows, 05.83s (12.1mb) [] [] [2023-05-09T20:41:18.171672+02:00] porter.INFO: Postscript found and running... [] [] [2023-05-09T20:42:31.989002+02:00] porter.INFO: build: mentions_user — 4933 rows, 1:13.82 (9mb) [] [] [2023-05-09T21:32:42.400155+02:00] porter.INFO: build: post numbers — 111096 rows, 50:10.41 (11.5mb) [] [] [2023-05-09T21:34:25.485377+02:00] porter.INFO: Failed to find 29 quoted posts (perhaps deleted). [] [] [2023-05-09T21:34:25.485534+02:00] porter.INFO: build: mentions_post — 11107 rows, 1:43.08 (9.2mb) [] [] [2023-05-10T02:50:43.242962+02:00] porter.INFO: build: following last read — 232937 rows, 316:17.76 (108.6mb) [] [] [2023-05-10T02:50:43.721331+02:00] porter.INFO: Promoted to Admin: System (system@vanillacommunity.example) [] [] [2023-05-10T02:50:43.721438+02:00] porter.INFO: ELAPSED — 384:04.74 (20:26:38 - 02:50:43) [] []

linc

MoshBit Yes, it will start from the beginning each time. Trying to resume a failed migration would add quite a bit of complexity.

Increasing your timeout like @ymaohyd did above may help.

linc

ymaohyd Are you sure all of those changes were required? My understanding was that simply the Timeout 1800 in the Apache conf would suffice. I have that note in the guide.

ymaohyd

linc I'm not 100% sure to be honest.

When I ran into the timeout problems and started researching solutions, there were a range of suggested fixes, so I tried to cover all bases to be on the safe side.

It was probably overkill, but as it worked I was happy 😊

Winckle

Hi all 👋,

I'm trying to migrate my phpbb3 forum to flarum using nitro-porter and I'm getting the following error from php:
2023/06/05 16:39:50 [error] 2502733#2502733: *85045716 FastCGI sent in stderr: "PHP message: PHP Fatal error: Uncaught PDOException: SQLSTATE[22007]: Invalid datetime format: 1366 Incorrect integer value: 'Europe/London' for columnflarum.PORT_User.HourOffsetat row 1 in /home/www-data/php8/nitro/nitro-porter/vendor/illuminate/database/Connection.php:501 Stack trace: #0 /home/www-data/php8/nitro/nitro-porter/vendor/illuminate/database/Connection.php(501): PDOStatement->execute() #1 /home/www-data/php8/nitro/nitro-porter/vendor/illuminate/database/Connection.php(705): Illuminate\Database\Connection->Illuminate\Database\{closure}() #2 /home/www-data/php8/nitro/nitro-porter/vendor/illuminate/database/Connection.php(672): Illuminate\Database\Connection->runQueryCallback() #3 /home/www-data/php8/nitro/nitro-porter/vendor/illuminate/database/Connection.php(490): Illuminate\Database\Connection->run() #4 /home/www-data/php8/nitro/nitro-porter/vendor/illuminate/database/Connection.php(454): Illuminate\Database\Connection->statement() #5 /home/www-data/php8/nitro/nitro-porter/ve" while reading response header from upstream
It's got me pretty stumped. I don't think the config is incorrect.
There's nothing too useful in porter.log:
[2023-06-05T15:54:04.096007+00:00] porter.INFO: Permissions are not migrated. Verify all permissions afterward. [] [] [2023-06-05T15:54:04.096352+00:00] porter.INFO: Source: phpBB 3 (phpbb) [] [] [2023-06-05T15:54:04.096426+00:00] porter.INFO: Target: Flarum (flarum) [] [] [2023-06-05T15:54:04.096492+00:00] porter.INFO: Flag: Use Discussion Body: Enabled [] []
Any help or advice would be appreciated.

Winckle

Ok, I looked at it further, and it's trying to write a timezone object to the hour offset value, which structure.php says must be an int. I am not familiar enough with your code to simply force it to be 0 offset or similar. Is my forum unusual for having these values as timezones rather than offset integers?

Walid

Winckle Hi, have you found a solution to your problem, because I'm having the same one?

[Tue Jun 13 13:19:10.052430 2023] [proxy_fcgi:error] [pid 191323] [client XXXXXXXX] AH01071: Got error 'PHP message: PHP Fatal error: Uncaught PDOException: SQLSTATE[HY000]: General error: 1366 Incorrect integer value: 'UTC' for column 'HourOffset' at row 1 in /var/www/mysite/public/migration/vendor/illuminate/database/Connection.php:501\nStack trace:\n#0 /var/www/mysite/public/migration/vendor/illuminate/database/Connection.php(501): PDOStatement->execute()\n#1 /var/www/mysite/public/migration/vendor/illuminate/database/Connection.php(705): Illuminate\\Database\\Connection->Illuminate\\Database\\{closure}()\n#2 /var/www/mysite/public/migration/vendor/illuminate/database/Connection.php(672): Illuminate\\Database\\Connection->runQueryCallback()\n#3 /var/www/mysite/public/migration/vendor/illuminate/database/Connection.php(502): Illuminate\\Database\\Connection->run()\n#4 /var/www/mysite/public/migration/vendor/illuminate/database/Connection.php(454): Illuminate\\Database\\Connection->statement()\n#5 /var/www/mysite/new/publ...', referer: http://mysite.com/migration/index.php

I've uploaded the nitro-porter files to a "migration" folder on my server (got the zip from the latest release on github v3.3) than created and edited the config.php file like indicated and run the index.php page on the browser, selected the right options and when I launched the script, I instantly got a error 500 and when I checked the porter.log it just says:
[...] porter.INFO: Permissions are not migrated. Verify all permissions afterward. [] [] [...] porter.INFO: Source: phpBB 3 (source_PHPBB) [] [] [...] porter.INFO: Target: Flarum (source_PHPBB) [] [] [...] porter.INFO: Flag: Use Discussion Body: Enabled [] []

yes i'm using the same database. When I check the database, there's just a new PORTER_user table created with nothing in it. So then I check the apache error log for my site and I found what I published at the top of this post.

how can I fix this?

erbosha

Hello. Can anyone help for a nominal amount, please.

I want to switch from xenforo
topics 104,127
posts 104,806
users 3,161
to flarum

I am using fastpanel (FastCGI, php81) with the latest flarum branch and can't configure php limits
I get 504 Gateway Time Out (cloudflare) and HTTP ERROR 500 errors

i'm from disgraceful russia and can only pay in cryptocurrency

wbntff

is migration to flarum possible from XMBforum ?
Its a 20 years old forum with no activity since past 15 years but i want to keep a backup of it for reading purpose only.
XMB is dead and could not migrate it to SMF

linc

wbntff I've never heard of this one. Can you get it into any other software? PHPBB is the one that sometimes folks have made a migration tool for, especially if it's that old.

Alternatively, I can add support for it in Porter if you wanna send me the database dump. Since it's so old, I would stick to the very basics: Users, Categories, Discussion & Comments.

wbntff

linc I have tried existing converters with SMF and phpBB but all have errors as they were written for old versions.
yes.. basic stuff like users, categories, discussions and posts would be enough.
Just need it for reading purpose as archive. May revive it if members are interested.
Last time we used it was in 2009.
I have emailed you link to download database dump

wbntff

linc
Hi,
did you happen to look at that SQL file.
I could run it with XMB 1.19.12 but it generates errors as its written for older versions of php and in future may not work at all.
Recently i tried converting it again to SMF 2.0.0 with older converter.
It does convert members and topics but stops midway at 5600 posts, where as total posts are 26000+
There was nothing much i could do to proceed further as nobody at SMF supports this converter anymore.

phpBB converts from SMF (that too 1.1), not from XMB

Gerriet

Hi there ;D
I have a little forum, that 13 years old. I would make a migration with the extensions from michaelbelgium. But I write here in this post issues,
https://discuss.flarum.org/d/33158-migration-from-mybb-to-flarum
Maybe, you can help me ?
Edit: I have found your Tool, so I would test with this. maybe runs better ;D

Circa

@linc We have a pretty large forum on Invision 4 and heavily utilize the Downloads module. I plan to pay a bounty for an extension to be made once we decide to move forward with this decision, but I'm curious if you'd be able to also work with us on getting those moved over too? We are trying to plan ahead of Invisions price increase and other questionable decisions, but aren't finding any alternatives without commissioning some help like this.

linc

Circa I think that's a reasonable extension to the Porter. Whenever possible, I like to support data even if it's from a plugin/extension if the extension is publicly available & widely used and the data is valuable.

I cannot promise I would be personally available to do this enhancement on a timeline you'd find useful, however.

Gerriet

Hi linc ;D
I sent you an email or better I filled out the form and sent it a week ago. Haste get the mail ? I have only a small forum, which is based on Mybb 1.8.36. Would be great if you could help me with the conversion.

Greetings from germany ;D

Circa

Gerriet did you try this first? I used it on a small mybb forum last year and it worked perfectly.

https://discuss.flarum.org/d/5506-mybb-to-flarum/125

Gerriet

Well, I know the extension and have already tried it, unfortunately error messages came again and again, so I would like to try the tool from Linc and see if the same problems occur ;D

Edit:
So, I tried the Nitro-Porter tool, but I'm not sure if I did everything right. When I started the whole thing in the browser, there was a white page. I didn't find any log files either. Therefore, I can not say what went wrong.

Gerriet

Hello 😃
Ok, I have run a test with the nitro-porter tool ;D When I start the progress, comes a white side in the browser ist the right ?

Oh and I have found the log file ;D

Gerriet

HI there ;D
Little question:
Does the tool need rights from my admin account in mybb ?

« Previous Page Next Page »