Skip to content
  • Categories
  • Recent
  • Popular
  • World
Skins
  • Light
  • Dark

Collapse

NodeBB

The clock is ticking

Scheduled Pinned Locked Moved Admin Forum
67 Posts 1 Posters 291 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • Poncho65P
    Poncho65P
    Poncho65
    Global Moderators
    wrote last edited by
    #33

    :ahhh :ahhh :ahhh

    I hope all goes well even with the above mentioned hiccups :salute:

    So we should just be logging in again with same credentials when it is migrated, correct? 😄 Mainly asking becasue I am sure I will get a message or 2 about this :ahhh

    1 Reply Last reply
    0
    • WhoeyW
      WhoeyW
      Whoey
      administrators
      wrote last edited by
      #34

      If I didn't mention before, passwords will not transfer, we have 2 options, generate and send new ones (could take a long time for all accounts) or let users use password recovery to renew passwords;

      password recovery will need to be used to login on nodebb, which is why emails should be updated before the migration.

      that being said, one step forward, 3 backwards.

      This is a huge pain in the ass to migrate.

      The difficult we do immediately, the impossible takes a little longer.

      1 Reply Last reply
      0
      • SteveCS
        SteveCS
        SteveC
        Global Moderators
        wrote last edited by
        #35

        Password recovery sounds like a better option. As long as people are aware, that shouldn't be a big deal, I hope :ahhh

        1 Reply Last reply
        0
        • WhoeyW
          WhoeyW
          Whoey
          administrators
          wrote last edited by
          #36

          about 30min in, 10k users imported, 25% of 290k PMs imported.

          I could be wrong, but feels faster than previous attempts, but I did hit more blocking steps at start.

          I haven't learned.

          The difficult we do immediately, the impossible takes a little longer.

          1 Reply Last reply
          0
          • WhoeyW
            WhoeyW
            Whoey
            administrators
            wrote last edited by
            #37

            currently at 16% of 2.4 million posts imported.

            426k images imported... only 2 missing. looks like the most of the first thousand are corrupted since long ago (having the files decrypted allows me to browse the folder for a change)

            Images were surprisingly easier to recover than expected, now I just need to upload the 50gb to the new host...

            The difficult we do immediately, the impossible takes a little longer.

            1 Reply Last reply
            0
            • Poncho65P
              Poncho65P
              Poncho65
              Global Moderators
              wrote last edited by
              #38

              :ahhh :ahhh :ahhh

              @SteveC said:
              Password recovery sounds like a better option. As long as people are aware, that shouldn't be a big deal, I hope :ahhh

              :iagree: hopefully most are able to get them reset easily :facepalm: :oops: :ahhh

              1 Reply Last reply
              0
              • WhoeyW
                WhoeyW
                Whoey
                administrators
                wrote last edited by
                #39

                as we see it takes at least 24h to do a migration (and I'm only half through the local side) we either need to lock this setup until the other is completed, or leave this open, and anything after the backup I just did will be lost.

                I seem to recall there being some way to have a forum wide notification, but I am eyeball deep in the migration code...

                one step forward, 5 more substeps added.

                1.25mil of 2 month old import completed. 40gb of backup downloaded.

                sadly I cannot do a sync latest import with this method...

                The difficult we do immediately, the impossible takes a little longer.

                1 Reply Last reply
                0
                • WhoeyW
                  WhoeyW
                  Whoey
                  administrators
                  wrote last edited by
                  #40

                  so 2 month old backup import locally was success... finished around midnight.

                  I then nuked it in favour of new 11/11 backup... which failed at first step :facepalm:

                  I was too tired to fight with it anymore, but whatever. hopefully it works today.

                  The difficult we do immediately, the impossible takes a little longer.

                  1 Reply Last reply
                  0
                  • WhoeyW
                    WhoeyW
                    Whoey
                    administrators
                    wrote last edited by
                    #41

                    literally every step forward is 10 steps backwards today...

                    mysql imported, but not able to get the nodebb import to even start.

                    I need some air.

                    The difficult we do immediately, the impossible takes a little longer.

                    1 Reply Last reply
                    0
                    • SteveCS
                      SteveCS
                      SteveC
                      Global Moderators
                      wrote last edited by
                      #42

                      Thank you for your hard work Micah :salute:

                      1 Reply Last reply
                      0
                      • Poncho65P
                        Poncho65P
                        Poncho65
                        Global Moderators
                        wrote last edited by
                        #43

                        :iagree: Hope it goes better from here on :-[ :salute:

                        1 Reply Last reply
                        0
                        • kirk13K
                          kirk13K
                          kirk13
                          Admin Team
                          wrote last edited by
                          #44

                          Micah, I have a hammer. I've already offered it to Grant :whistle:

                          1 Reply Last reply
                          0
                          • WhoeyW
                            WhoeyW
                            Whoey
                            administrators
                            wrote last edited by
                            #45

                            after hours of fighting with the import module and various versions of the miscellaneous related packages required to run it, I think I have an external tool that is migrating as we speak from the mysql export to mongodb to be ready to import on elestio.

                            But because nothing is ever easy, elestio uses redis db by default, which apparently will not cope with the 2.4 million posts we have as it dumps it all to memory instead of disk. however, there is a way to use both, so waiting on the db part to finish the migration, which is purring along in the background.

                            I am a tiny bit terrified about the 50gb of photos to upload. I need to work out how I can setup something on my NAS pc to do it in the background.

                            it won't be the end of the world if the pictures take a few days to catch up...

                            any posts here from 11/11 onwards are gone.

                            The difficult we do immediately, the impossible takes a little longer.

                            1 Reply Last reply
                            0
                            • WhoeyW
                              WhoeyW
                              Whoey
                              administrators
                              wrote last edited by
                              #46

                              Migrating topics...

                              Migrating posts (messages)...

                              Processing messages 0 to 1000 of 2483381...

                              Processing messages 1000 to 2000 of 2483381...

                              Processing messages 2000 to 3000 of 2483381...

                              Processing messages 3000 to 4000 of 2483381...

                              Processing messages 4000 to 5000 of 2483381...

                              Processing messages 5000 to 6000 of 2483381...

                              Processing messages 6000 to 7000 of 2483381...

                              Processing messages 7000 to 8000 of 2483381...

                              Processing messages 8000 to 9000 of 2483381...

                              Processing messages 9000 to 10000 of 2483381...

                              Processing messages 10000 to 11000 of 2483381...

                              Processing messages 11000 to 12000 of 2483381...

                              Processing messages 12000 to 13000 of 2483381...

                              Processing messages 13000 to 14000 of 2483381...

                              Processing messages 14000 to 15000 of 2483381...

                              Processing messages 15000 to 16000 of 2483381...

                              Processing messages 16000 to 17000 of 2483381...

                              Processing messages 17000 to 18000 of 2483381...

                              Processing messages 18000 to 19000 of 2483381...

                              Processing messages 19000 to 20000 of 2483381...

                              Processing messages 20000 to 21000 of 2483381...

                              Processing messages 21000 to 22000 of 2483381...

                              Processing messages 22000 to 23000 of 2483381...

                              Processing messages 23000 to 24000 of 2483381...

                              Processing messages 24000 to 25000 of 2483381...

                              Processing messages 25000 to 26000 of 2483381...

                              Processing messages 26000 to 27000 of 2483381...

                              The difficult we do immediately, the impossible takes a little longer.

                              1 Reply Last reply
                              0
                              • Poncho65P
                                Poncho65P
                                Poncho65
                                Global Moderators
                                wrote last edited by
                                #47

                                Oh my :ahhh :ahhh :ahhh

                                1 Reply Last reply
                                0
                                • Poncho65P
                                  Poncho65P
                                  Poncho65
                                  Global Moderators
                                  wrote last edited by
                                  #48

                                  Does seem like progress though :salute: thank you Micah :cheers:

                                  1 Reply Last reply
                                  0
                                  • WhoeyW
                                    WhoeyW
                                    Whoey
                                    administrators
                                    wrote last edited by
                                    #49

                                    It's at 300k now... this new method is going to take several days.

                                    Luckily I don't need to have my pc on, just let my nas do the work in the background

                                    The difficult we do immediately, the impossible takes a little longer.

                                    1 Reply Last reply
                                    0
                                    • WhoeyW
                                      WhoeyW
                                      Whoey
                                      administrators
                                      wrote last edited by
                                      #50

                                      349k.

                                      Honestly... this is going to be several days

                                      The difficult we do immediately, the impossible takes a little longer.

                                      1 Reply Last reply
                                      0
                                      • SteveCS
                                        SteveCS
                                        SteveC
                                        Global Moderators
                                        wrote last edited by
                                        #51

                                        Are we going to lose several days of posts when we switch ?

                                        1 Reply Last reply
                                        0
                                        • WhoeyW
                                          WhoeyW
                                          Whoey
                                          administrators
                                          wrote last edited by
                                          #52

                                          Anything newer than 11th November

                                          The difficult we do immediately, the impossible takes a little longer.

                                          1 Reply Last reply
                                          0

                                          Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                                          Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                                          With your input, this post could be even better 💗

                                          Register Login

                                          • Login

                                          • Don't have an account? Register

                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Popular
                                          • World