Migration for a very large SMF forum

SHC

BartVB Thanks, but that is not for us. We are stuck on version 1.18. There are a lot of mods that it failed to update internally. So I guess I had to do a manual migration and write my own script for that.

SHC

Hi guys,

Now that Beta 8 has been released, I'm assuming that there won't be many breaking changes in the database schemas. With that assumption, we're going to attempt the migration again, this time with the new instance.

As far as I understand from the release post, the main changes in the database are from this PR alone: https://github.com/flarum/core/pull/1344/

Are there any other resources that I should look into before starting? As I also see, the main change is only in the attribute names in the schemas and not any structure of the tables changed, so I should be fine with modifying my previous migration script.

And by the way, I think I can post my progress in this topic, and if I needed some help, I will be opening specific new discussions with a reference to this one.

Thanks for your amazing work devs, loving Flarum since I saw it when beta 7 was released.

BuzzY

We have already migrated database from mybb with 30k users, 25k topics and 1,3 mln posts to beta7 we will do it again to beta 8 now. Everything is OK but it took some time for us.

SHC

BuzzY That's pretty cool dude! Mind if I take a peak at your script? My script is currently targeting beta7 too, but is taking extremely long time (almost half day) to do the migration. Maybe I can look at it to make some optimizations to my own one.

Brightside56

BuzzY You need to migrate to beta 7, then update to beta 8

BuzzY

SHC we use migration tool from this forum - little modified by our development team.

SHC

Started testing my existing migration script, and it seems I hit a blocker. It's saying that the users_groups table is not existing anymore. I'll figure it out though, this post is just to share the progress and keep myself a bit motivated.

Imgur

Nevertheless, here's our test forum in action, after I have successfully migrated the categories and boards as tags.

Imgur

See ya soon with more progress.

MichaelBelgium

SHC It's saying that the users_groups table is not existing anymore.

The table has been renamed to group_user

Victor12

SHC Congrats! Happy to see a big one migrating to Flarum. 🙌

Brightside56

SHC it would better if you migrate to beta 7, then upgrade to beta 8. SMF2->Flarum migrator is for beta 7

SHC

Brightside56 It doesn't work for us unfortunately. Ours is based on SMF 1 and also had several core files modified for our extensions. So it'll be better for me to write the migration tool to target the latest Flarum version.

Brightside56

SHC , then you can migrate to SMF2 first, then use this migrator. But yes, I think it's quite easy to rewrite this migrator for SMF1

SHC

Brightside56 The thing is, ours cannot be updated to SMF 2 because the backend code is heavily modified. For all the features, when the extensions that we want were not available, the previous maintainers of the forum completely changed the source files directly. Because of this, no migration with existing tools is possible.

And even though they do exist, I think it was better for us to rewrite it anyway. We can make it more optimized so that migration can happen many times faster. Complete dump file in our case was 400 megs in size, compressed.

By the way, new progress is that the users were now ported.

Imgur

Dataset was reduced to make development faster. By the way, which extension do you recommend to see all the individual users in the admin dashboard?

jordanjay29

SHC Flagrow User Directory or Reflar User Management, but neither is updated for Beta 8 yet.

luceos

jordanjay29 Flagrow User Directory

ETA within 7 days

Ralkage

jordanjay29 we are planning to remove various features in favor of a truer user management extension. By that I am hinting that various missing features such as creating new users within the Admin CP through User Management will be added and the removal of the strikes system into its own extension as a bonus as well 😉

jordanjay29

ITT: News about extension updates that are lacking from their own extension discussions. 😉

« Previous Page