Skip to content
  • Categories
  • Recent
  • Popular
  • World
Skins
  • Light
  • Dark

Collapse

NodeBB

The clock is ticking

Scheduled Pinned Locked Moved Admin Forum
67 Posts 1 Posters 291 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • WhoeyW
    WhoeyW
    Whoey
    administrators
    wrote last edited by
    #37

    currently at 16% of 2.4 million posts imported.

    426k images imported... only 2 missing. looks like the most of the first thousand are corrupted since long ago (having the files decrypted allows me to browse the folder for a change)

    Images were surprisingly easier to recover than expected, now I just need to upload the 50gb to the new host...

    The difficult we do immediately, the impossible takes a little longer.

    1 Reply Last reply
    0
    • Poncho65P
      Poncho65P
      Poncho65
      Global Moderators
      wrote last edited by
      #38

      :ahhh :ahhh :ahhh

      @SteveC said:
      Password recovery sounds like a better option. As long as people are aware, that shouldn't be a big deal, I hope :ahhh

      :iagree: hopefully most are able to get them reset easily :facepalm: :oops: :ahhh

      1 Reply Last reply
      0
      • WhoeyW
        WhoeyW
        Whoey
        administrators
        wrote last edited by
        #39

        as we see it takes at least 24h to do a migration (and I'm only half through the local side) we either need to lock this setup until the other is completed, or leave this open, and anything after the backup I just did will be lost.

        I seem to recall there being some way to have a forum wide notification, but I am eyeball deep in the migration code...

        one step forward, 5 more substeps added.

        1.25mil of 2 month old import completed. 40gb of backup downloaded.

        sadly I cannot do a sync latest import with this method...

        The difficult we do immediately, the impossible takes a little longer.

        1 Reply Last reply
        0
        • WhoeyW
          WhoeyW
          Whoey
          administrators
          wrote last edited by
          #40

          so 2 month old backup import locally was success... finished around midnight.

          I then nuked it in favour of new 11/11 backup... which failed at first step :facepalm:

          I was too tired to fight with it anymore, but whatever. hopefully it works today.

          The difficult we do immediately, the impossible takes a little longer.

          1 Reply Last reply
          0
          • WhoeyW
            WhoeyW
            Whoey
            administrators
            wrote last edited by
            #41

            literally every step forward is 10 steps backwards today...

            mysql imported, but not able to get the nodebb import to even start.

            I need some air.

            The difficult we do immediately, the impossible takes a little longer.

            1 Reply Last reply
            0
            • SteveCS
              SteveCS
              SteveC
              Global Moderators
              wrote last edited by
              #42

              Thank you for your hard work Micah :salute:

              1 Reply Last reply
              0
              • Poncho65P
                Poncho65P
                Poncho65
                Global Moderators
                wrote last edited by
                #43

                :iagree: Hope it goes better from here on :-[ :salute:

                1 Reply Last reply
                0
                • kirk13K
                  kirk13K
                  kirk13
                  Admin Team
                  wrote last edited by
                  #44

                  Micah, I have a hammer. I've already offered it to Grant :whistle:

                  1 Reply Last reply
                  0
                  • WhoeyW
                    WhoeyW
                    Whoey
                    administrators
                    wrote last edited by
                    #45

                    after hours of fighting with the import module and various versions of the miscellaneous related packages required to run it, I think I have an external tool that is migrating as we speak from the mysql export to mongodb to be ready to import on elestio.

                    But because nothing is ever easy, elestio uses redis db by default, which apparently will not cope with the 2.4 million posts we have as it dumps it all to memory instead of disk. however, there is a way to use both, so waiting on the db part to finish the migration, which is purring along in the background.

                    I am a tiny bit terrified about the 50gb of photos to upload. I need to work out how I can setup something on my NAS pc to do it in the background.

                    it won't be the end of the world if the pictures take a few days to catch up...

                    any posts here from 11/11 onwards are gone.

                    The difficult we do immediately, the impossible takes a little longer.

                    1 Reply Last reply
                    0
                    • WhoeyW
                      WhoeyW
                      Whoey
                      administrators
                      wrote last edited by
                      #46

                      Migrating topics...

                      Migrating posts (messages)...

                      Processing messages 0 to 1000 of 2483381...

                      Processing messages 1000 to 2000 of 2483381...

                      Processing messages 2000 to 3000 of 2483381...

                      Processing messages 3000 to 4000 of 2483381...

                      Processing messages 4000 to 5000 of 2483381...

                      Processing messages 5000 to 6000 of 2483381...

                      Processing messages 6000 to 7000 of 2483381...

                      Processing messages 7000 to 8000 of 2483381...

                      Processing messages 8000 to 9000 of 2483381...

                      Processing messages 9000 to 10000 of 2483381...

                      Processing messages 10000 to 11000 of 2483381...

                      Processing messages 11000 to 12000 of 2483381...

                      Processing messages 12000 to 13000 of 2483381...

                      Processing messages 13000 to 14000 of 2483381...

                      Processing messages 14000 to 15000 of 2483381...

                      Processing messages 15000 to 16000 of 2483381...

                      Processing messages 16000 to 17000 of 2483381...

                      Processing messages 17000 to 18000 of 2483381...

                      Processing messages 18000 to 19000 of 2483381...

                      Processing messages 19000 to 20000 of 2483381...

                      Processing messages 20000 to 21000 of 2483381...

                      Processing messages 21000 to 22000 of 2483381...

                      Processing messages 22000 to 23000 of 2483381...

                      Processing messages 23000 to 24000 of 2483381...

                      Processing messages 24000 to 25000 of 2483381...

                      Processing messages 25000 to 26000 of 2483381...

                      Processing messages 26000 to 27000 of 2483381...

                      The difficult we do immediately, the impossible takes a little longer.

                      1 Reply Last reply
                      0
                      • Poncho65P
                        Poncho65P
                        Poncho65
                        Global Moderators
                        wrote last edited by
                        #47

                        Oh my :ahhh :ahhh :ahhh

                        1 Reply Last reply
                        0
                        • Poncho65P
                          Poncho65P
                          Poncho65
                          Global Moderators
                          wrote last edited by
                          #48

                          Does seem like progress though :salute: thank you Micah :cheers:

                          1 Reply Last reply
                          0
                          • WhoeyW
                            WhoeyW
                            Whoey
                            administrators
                            wrote last edited by
                            #49

                            It's at 300k now... this new method is going to take several days.

                            Luckily I don't need to have my pc on, just let my nas do the work in the background

                            The difficult we do immediately, the impossible takes a little longer.

                            1 Reply Last reply
                            0
                            • WhoeyW
                              WhoeyW
                              Whoey
                              administrators
                              wrote last edited by
                              #50

                              349k.

                              Honestly... this is going to be several days

                              The difficult we do immediately, the impossible takes a little longer.

                              1 Reply Last reply
                              0
                              • SteveCS
                                SteveCS
                                SteveC
                                Global Moderators
                                wrote last edited by
                                #51

                                Are we going to lose several days of posts when we switch ?

                                1 Reply Last reply
                                0
                                • WhoeyW
                                  WhoeyW
                                  Whoey
                                  administrators
                                  wrote last edited by
                                  #52

                                  Anything newer than 11th November

                                  The difficult we do immediately, the impossible takes a little longer.

                                  1 Reply Last reply
                                  0
                                  • SteveCS
                                    SteveCS
                                    SteveC
                                    Global Moderators
                                    wrote last edited by
                                    #53

                                    Perhaps we should notify members of this ? There are challenges going on and pictures and posts will be lost. I imagine peeps will not be happy.

                                    1 Reply Last reply
                                    0
                                    • Poncho65P
                                      Poncho65P
                                      Poncho65
                                      Global Moderators
                                      wrote last edited by
                                      #54

                                      Definetly not happy people with Challenges :ahhh That is 2 days so far of lost posts 😮 Hopefully when the dust settles most will be happy with the new software and things can get back to normal fairly quickly :salute: even with new software versions and themes people are never happy so we were expecting that anyways though :whistle: 😄

                                      1 Reply Last reply
                                      0
                                      • SteveCS
                                        SteveCS
                                        SteveC
                                        Global Moderators
                                        wrote last edited by
                                        #55

                                        @Poncho65 said:
                                        Definetly not happy people with Challenges :ahhh That is 2 days so far of lost posts 😮 Hopefully when the dust settles most will be happy with the new software and things can get back to normal fairly quickly :salute: even with new software versions and themes people are never happy so we were expecting that anyways though :whistle: 😄

                                        All the more reason to keep people informed about this. Why add something else for them to be upset about.

                                        1 Reply Last reply
                                        0
                                        • Poncho65P
                                          Poncho65P
                                          Poncho65
                                          Global Moderators
                                          wrote last edited by
                                          #56

                                          Oh definitely :iagree: completely. They will be some who dont ever read about it no matter how many places and posts we make and will complain 😄 but if it is out there then a lot of them will read it and understand :salute:

                                          1 Reply Last reply
                                          0

                                          Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                                          Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                                          With your input, this post could be even better 💗

                                          Register Login

                                          • Login

                                          • Don't have an account? Register

                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Popular
                                          • World