Skip to content
  • Categories
  • Recent
  • Popular
  • World
Skins
  • Light
  • Dark

Collapse

NodeBB

The clock is ticking

Scheduled Pinned Locked Moved Admin Forum
67 Posts 1 Posters 291 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • Grant LamontagneG
    Grant LamontagneG
    Grant Lamontagne
    administrators
    wrote last edited by
    #31

    Yeah I know, we need to keep people more in the loop on this, especially you guys.

    Micah is going to use one of his older backups to run more tests on a test build of NodeBB he has on his personal server. Once he has a reliable path figured out, he will pull a copy of the current forum server, and the sensible thing at that point would be to put this one in Maintenance Mode so no new posts can be added.

    We will then wipe the current NodeBB posts, members etc.

    Then he will do the import to NodeBB, and deal with any immediate issues that come up.

    Then there is all of the other config stuff, like setting up the email server, mapping URLs and other related smurf that is bound to come up.

    Then there will be some initial testing that needs to be done and so on.

    Once everything is set up, we will transfer the DNS (domain) from this SMF build to the new NodeBB build and re-open it to members, who will no doubt have a smurfload of complaints that I will spend weeks trying to sort out- at least the ones I can. There will also be the "I just don't like it" and the "It's not the same" and we will lose members. I will feel every loss, but there's not much I can do about that.

    Simple Machines has been good to us for a very long time. I am going to miss it, and I feel bad abandoning it, but that's why I get for being a sentimental old bitch.

    And now, Micah will be along momentarily to point out all of the things I mentioned that are wrong, in the wrong order or just outright imaginary, and that's why he is the only person I trust to do this work.

    Def


    1 Reply Last reply
    0
    • WhoeyW
      WhoeyW
      Whoey
      administrators
      wrote last edited by
      #32

      my local setup is not happy. I have 2 attempted migration setups and I think I need to nuke and start fresh, they never fully worked as expected to begin with. :facepalm:

      and while Grant managed to add me to hetzner server access, I don't actually have the logins to do anything on them yet, or my goldfish memory did not register when he told me.

      The difficult we do immediately, the impossible takes a little longer.

      1 Reply Last reply
      0
      • Poncho65P
        Poncho65P
        Poncho65
        Global Moderators
        wrote last edited by
        #33

        :ahhh :ahhh :ahhh

        I hope all goes well even with the above mentioned hiccups :salute:

        So we should just be logging in again with same credentials when it is migrated, correct? 😄 Mainly asking becasue I am sure I will get a message or 2 about this :ahhh

        1 Reply Last reply
        0
        • WhoeyW
          WhoeyW
          Whoey
          administrators
          wrote last edited by
          #34

          If I didn't mention before, passwords will not transfer, we have 2 options, generate and send new ones (could take a long time for all accounts) or let users use password recovery to renew passwords;

          password recovery will need to be used to login on nodebb, which is why emails should be updated before the migration.

          that being said, one step forward, 3 backwards.

          This is a huge pain in the ass to migrate.

          The difficult we do immediately, the impossible takes a little longer.

          1 Reply Last reply
          0
          • SteveCS
            SteveCS
            SteveC
            Global Moderators
            wrote last edited by
            #35

            Password recovery sounds like a better option. As long as people are aware, that shouldn't be a big deal, I hope :ahhh

            1 Reply Last reply
            0
            • WhoeyW
              WhoeyW
              Whoey
              administrators
              wrote last edited by
              #36

              about 30min in, 10k users imported, 25% of 290k PMs imported.

              I could be wrong, but feels faster than previous attempts, but I did hit more blocking steps at start.

              I haven't learned.

              The difficult we do immediately, the impossible takes a little longer.

              1 Reply Last reply
              0
              • WhoeyW
                WhoeyW
                Whoey
                administrators
                wrote last edited by
                #37

                currently at 16% of 2.4 million posts imported.

                426k images imported... only 2 missing. looks like the most of the first thousand are corrupted since long ago (having the files decrypted allows me to browse the folder for a change)

                Images were surprisingly easier to recover than expected, now I just need to upload the 50gb to the new host...

                The difficult we do immediately, the impossible takes a little longer.

                1 Reply Last reply
                0
                • Poncho65P
                  Poncho65P
                  Poncho65
                  Global Moderators
                  wrote last edited by
                  #38

                  :ahhh :ahhh :ahhh

                  @SteveC said:
                  Password recovery sounds like a better option. As long as people are aware, that shouldn't be a big deal, I hope :ahhh

                  :iagree: hopefully most are able to get them reset easily :facepalm: :oops: :ahhh

                  1 Reply Last reply
                  0
                  • WhoeyW
                    WhoeyW
                    Whoey
                    administrators
                    wrote last edited by
                    #39

                    as we see it takes at least 24h to do a migration (and I'm only half through the local side) we either need to lock this setup until the other is completed, or leave this open, and anything after the backup I just did will be lost.

                    I seem to recall there being some way to have a forum wide notification, but I am eyeball deep in the migration code...

                    one step forward, 5 more substeps added.

                    1.25mil of 2 month old import completed. 40gb of backup downloaded.

                    sadly I cannot do a sync latest import with this method...

                    The difficult we do immediately, the impossible takes a little longer.

                    1 Reply Last reply
                    0
                    • WhoeyW
                      WhoeyW
                      Whoey
                      administrators
                      wrote last edited by
                      #40

                      so 2 month old backup import locally was success... finished around midnight.

                      I then nuked it in favour of new 11/11 backup... which failed at first step :facepalm:

                      I was too tired to fight with it anymore, but whatever. hopefully it works today.

                      The difficult we do immediately, the impossible takes a little longer.

                      1 Reply Last reply
                      0
                      • WhoeyW
                        WhoeyW
                        Whoey
                        administrators
                        wrote last edited by
                        #41

                        literally every step forward is 10 steps backwards today...

                        mysql imported, but not able to get the nodebb import to even start.

                        I need some air.

                        The difficult we do immediately, the impossible takes a little longer.

                        1 Reply Last reply
                        0
                        • SteveCS
                          SteveCS
                          SteveC
                          Global Moderators
                          wrote last edited by
                          #42

                          Thank you for your hard work Micah :salute:

                          1 Reply Last reply
                          0
                          • Poncho65P
                            Poncho65P
                            Poncho65
                            Global Moderators
                            wrote last edited by
                            #43

                            :iagree: Hope it goes better from here on :-[ :salute:

                            1 Reply Last reply
                            0
                            • kirk13K
                              kirk13K
                              kirk13
                              Admin Team
                              wrote last edited by
                              #44

                              Micah, I have a hammer. I've already offered it to Grant :whistle:

                              1 Reply Last reply
                              0
                              • WhoeyW
                                WhoeyW
                                Whoey
                                administrators
                                wrote last edited by
                                #45

                                after hours of fighting with the import module and various versions of the miscellaneous related packages required to run it, I think I have an external tool that is migrating as we speak from the mysql export to mongodb to be ready to import on elestio.

                                But because nothing is ever easy, elestio uses redis db by default, which apparently will not cope with the 2.4 million posts we have as it dumps it all to memory instead of disk. however, there is a way to use both, so waiting on the db part to finish the migration, which is purring along in the background.

                                I am a tiny bit terrified about the 50gb of photos to upload. I need to work out how I can setup something on my NAS pc to do it in the background.

                                it won't be the end of the world if the pictures take a few days to catch up...

                                any posts here from 11/11 onwards are gone.

                                The difficult we do immediately, the impossible takes a little longer.

                                1 Reply Last reply
                                0
                                • WhoeyW
                                  WhoeyW
                                  Whoey
                                  administrators
                                  wrote last edited by
                                  #46

                                  Migrating topics...

                                  Migrating posts (messages)...

                                  Processing messages 0 to 1000 of 2483381...

                                  Processing messages 1000 to 2000 of 2483381...

                                  Processing messages 2000 to 3000 of 2483381...

                                  Processing messages 3000 to 4000 of 2483381...

                                  Processing messages 4000 to 5000 of 2483381...

                                  Processing messages 5000 to 6000 of 2483381...

                                  Processing messages 6000 to 7000 of 2483381...

                                  Processing messages 7000 to 8000 of 2483381...

                                  Processing messages 8000 to 9000 of 2483381...

                                  Processing messages 9000 to 10000 of 2483381...

                                  Processing messages 10000 to 11000 of 2483381...

                                  Processing messages 11000 to 12000 of 2483381...

                                  Processing messages 12000 to 13000 of 2483381...

                                  Processing messages 13000 to 14000 of 2483381...

                                  Processing messages 14000 to 15000 of 2483381...

                                  Processing messages 15000 to 16000 of 2483381...

                                  Processing messages 16000 to 17000 of 2483381...

                                  Processing messages 17000 to 18000 of 2483381...

                                  Processing messages 18000 to 19000 of 2483381...

                                  Processing messages 19000 to 20000 of 2483381...

                                  Processing messages 20000 to 21000 of 2483381...

                                  Processing messages 21000 to 22000 of 2483381...

                                  Processing messages 22000 to 23000 of 2483381...

                                  Processing messages 23000 to 24000 of 2483381...

                                  Processing messages 24000 to 25000 of 2483381...

                                  Processing messages 25000 to 26000 of 2483381...

                                  Processing messages 26000 to 27000 of 2483381...

                                  The difficult we do immediately, the impossible takes a little longer.

                                  1 Reply Last reply
                                  0
                                  • Poncho65P
                                    Poncho65P
                                    Poncho65
                                    Global Moderators
                                    wrote last edited by
                                    #47

                                    Oh my :ahhh :ahhh :ahhh

                                    1 Reply Last reply
                                    0
                                    • Poncho65P
                                      Poncho65P
                                      Poncho65
                                      Global Moderators
                                      wrote last edited by
                                      #48

                                      Does seem like progress though :salute: thank you Micah :cheers:

                                      1 Reply Last reply
                                      0
                                      • WhoeyW
                                        WhoeyW
                                        Whoey
                                        administrators
                                        wrote last edited by
                                        #49

                                        It's at 300k now... this new method is going to take several days.

                                        Luckily I don't need to have my pc on, just let my nas do the work in the background

                                        The difficult we do immediately, the impossible takes a little longer.

                                        1 Reply Last reply
                                        0
                                        • WhoeyW
                                          WhoeyW
                                          Whoey
                                          administrators
                                          wrote last edited by
                                          #50

                                          349k.

                                          Honestly... this is going to be several days

                                          The difficult we do immediately, the impossible takes a little longer.

                                          1 Reply Last reply
                                          0

                                          Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                                          Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                                          With your input, this post could be even better 💗

                                          Register Login

                                          • Login

                                          • Don't have an account? Register

                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Popular
                                          • World