The clock is ticking
-
Good to know

-
Yeah I know, we need to keep people more in the loop on this, especially you guys.
Micah is going to use one of his older backups to run more tests on a test build of NodeBB he has on his personal server. Once he has a reliable path figured out, he will pull a copy of the current forum server, and the sensible thing at that point would be to put this one in Maintenance Mode so no new posts can be added.
We will then wipe the current NodeBB posts, members etc.
Then he will do the import to NodeBB, and deal with any immediate issues that come up.
Then there is all of the other config stuff, like setting up the email server, mapping URLs and other related smurf that is bound to come up.
Then there will be some initial testing that needs to be done and so on.
Once everything is set up, we will transfer the DNS (domain) from this SMF build to the new NodeBB build and re-open it to members, who will no doubt have a smurfload of complaints that I will spend weeks trying to sort out- at least the ones I can. There will also be the "I just don't like it" and the "It's not the same" and we will lose members. I will feel every loss, but there's not much I can do about that.
Simple Machines has been good to us for a very long time. I am going to miss it, and I feel bad abandoning it, but that's why I get for being a sentimental old bitch.
And now, Micah will be along momentarily to point out all of the things I mentioned that are wrong, in the wrong order or just outright imaginary, and that's why he is the only person I trust to do this work.
Def
-
my local setup is not happy. I have 2 attempted migration setups and I think I need to nuke and start fresh, they never fully worked as expected to begin with.

and while Grant managed to add me to hetzner server access, I don't actually have the logins to do anything on them yet, or my goldfish memory did not register when he told me.
-
:ahhh :ahhh :ahhh
I hope all goes well even with the above mentioned hiccups

So we should just be logging in again with same credentials when it is migrated, correct?
Mainly asking becasue I am sure I will get a message or 2 about this :ahhh -
If I didn't mention before, passwords will not transfer, we have 2 options, generate and send new ones (could take a long time for all accounts) or let users use password recovery to renew passwords;
password recovery will need to be used to login on nodebb, which is why emails should be updated before the migration.
that being said, one step forward, 3 backwards.
This is a huge pain in the ass to migrate.
-
Password recovery sounds like a better option. As long as people are aware, that shouldn't be a big deal, I hope :ahhh
-
about 30min in, 10k users imported, 25% of 290k PMs imported.
I could be wrong, but feels faster than previous attempts, but I did hit more blocking steps at start.
I haven't learned.
-
currently at 16% of 2.4 million posts imported.
426k images imported... only 2 missing. looks like the most of the first thousand are corrupted since long ago (having the files decrypted allows me to browse the folder for a change)
Images were surprisingly easier to recover than expected, now I just need to upload the 50gb to the new host...
-
-
as we see it takes at least 24h to do a migration (and I'm only half through the local side) we either need to lock this setup until the other is completed, or leave this open, and anything after the backup I just did will be lost.
I seem to recall there being some way to have a forum wide notification, but I am eyeball deep in the migration code...
one step forward, 5 more substeps added.
1.25mil of 2 month old import completed. 40gb of backup downloaded.
sadly I cannot do a sync latest import with this method...
-
so 2 month old backup import locally was success... finished around midnight.
I then nuked it in favour of new 11/11 backup... which failed at first step

I was too tired to fight with it anymore, but whatever. hopefully it works today.
-
literally every step forward is 10 steps backwards today...
mysql imported, but not able to get the nodebb import to even start.
I need some air.
-
Thank you for your hard work Micah

-
Hope it goes better from here on :-[ 
-
Micah, I have a hammer. I've already offered it to Grant

-
after hours of fighting with the import module and various versions of the miscellaneous related packages required to run it, I think I have an external tool that is migrating as we speak from the mysql export to mongodb to be ready to import on elestio.
But because nothing is ever easy, elestio uses redis db by default, which apparently will not cope with the 2.4 million posts we have as it dumps it all to memory instead of disk. however, there is a way to use both, so waiting on the db part to finish the migration, which is purring along in the background.
I am a tiny bit terrified about the 50gb of photos to upload. I need to work out how I can setup something on my NAS pc to do it in the background.
it won't be the end of the world if the pictures take a few days to catch up...
any posts here from 11/11 onwards are gone.
-
Migrating topics...
Migrating posts (messages)...
Processing messages 0 to 1000 of 2483381...
Processing messages 1000 to 2000 of 2483381...
Processing messages 2000 to 3000 of 2483381...
Processing messages 3000 to 4000 of 2483381...
Processing messages 4000 to 5000 of 2483381...
Processing messages 5000 to 6000 of 2483381...
Processing messages 6000 to 7000 of 2483381...
Processing messages 7000 to 8000 of 2483381...
Processing messages 8000 to 9000 of 2483381...
Processing messages 9000 to 10000 of 2483381...
Processing messages 10000 to 11000 of 2483381...
Processing messages 11000 to 12000 of 2483381...
Processing messages 12000 to 13000 of 2483381...
Processing messages 13000 to 14000 of 2483381...
Processing messages 14000 to 15000 of 2483381...
Processing messages 15000 to 16000 of 2483381...
Processing messages 16000 to 17000 of 2483381...
Processing messages 17000 to 18000 of 2483381...
Processing messages 18000 to 19000 of 2483381...
Processing messages 19000 to 20000 of 2483381...
Processing messages 20000 to 21000 of 2483381...
Processing messages 21000 to 22000 of 2483381...
Processing messages 22000 to 23000 of 2483381...
Processing messages 23000 to 24000 of 2483381...
Processing messages 24000 to 25000 of 2483381...
Processing messages 25000 to 26000 of 2483381...
Processing messages 26000 to 27000 of 2483381...
-
Oh my :ahhh :ahhh :ahhh
-
Does seem like progress though
thank you Micah 
-
It's at 300k now... this new method is going to take several days.
Luckily I don't need to have my pc on, just let my nas do the work in the background
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login
:ahhh