Details

    • Admin & Maintenance Task
    • Status: Done
    • Medium
    • Resolution: Cannot Reproduce
    • 2.1.0
    • None
    • None
    • None
    • Yes

    Description

      Team,

      I’m doing selective restore - restoring a single collection (6GB) from a FULL backup (2.5TB).
      its keep running for 11+ hrs (still progressing).

      Is this an expected behaviour. Please help me to fix this.

      command: pbm restore 2023-05-09T14:56:30Z --ns=ctr.trademarks.gecn 2>&1

      [mongod@ip-10-80-11-253 ~]$ pbm status

      Cluster:

      shard1ReplSet:

      • shard1ReplSet/10.80.11.253:27038 [P]: pbm-agent v2.1.0 OK
        configReplSet:
      • configReplSet/10.80.11.253:27039 [P]: pbm-agent v2.1.0 OK
        shard3ReplSet:
      • shard3ReplSet/10.80.10.159:27038 [P]: pbm-agent v2.1.0 OK
        shard2ReplSet:
      • shard2ReplSet/10.80.10.186:27038 [P]: pbm-agent v2.1.0 OK

      PITR incremental backup:

      Status [OFF]

      Currently running:

      Snapshot restore “2023-05-09T14:56:30Z”, started at 2023-05-16T04:30:23Z. Status: oplog restore. [op id: 646306df173cdb6959b600ac]

      Backups:

      S3 us-east-1 s3://xxxxxxxxxx/pbm/backup/
      Snapshots:
      2023-05-12T07:58:25Z 92.68KB <logical, selective> [restore_to_time: 2023-05-12T07:58:33Z]
      2023-05-12T07:49:04Z 6.53GB <logical, selective> [restore_to_time: 2023-05-12T07:54:17Z]
      2023-05-12T06:56:45Z 75.56KB <logical, selective> [restore_to_time: 2023-05-12T06:56:52Z]
      2023-05-11T14:17:04Z 752.69GB <logical, selective> [restore_to_time: 2023-05-11T17:33:36Z]
      2023-05-09T14:56:30Z 2.68TB [restore_to_time: 2023-05-10T01:41:15Z]


      [mongod@ip-10-80-11-253 ~]$ pbm logs
      2023-05-16T04:30:23Z I [shard1ReplSet/10.80.11.253:27038] got epoch {1684211244 3}
      2023-05-16T04:30:23Z I [shard1ReplSet/10.80.11.253:27038] [restore/2023-05-16T04:30:23.527718212Z] backup: 2023-05-09T14:56:30Z
      2023-05-16T04:30:23Z I [shard1ReplSet/10.80.11.253:27038] [restore/2023-05-16T04:30:23.527718212Z] restore started
      2023-05-16T04:30:24Z I [configReplSet/10.80.11.253:27039] [restore/2023-05-16T04:30:23.527718212Z] moving to state running
      2023-05-16T04:30:24Z I [shard2ReplSet/10.80.10.186:27038] [restore/2023-05-16T04:30:23.527718212Z] moving to state running
      2023-05-16T04:30:24Z I [shard1ReplSet/10.80.11.253:27038] [restore/2023-05-16T04:30:23.527718212Z] moving to state running
      2023-05-16T04:30:27Z I [configReplSet/10.80.11.253:27039] [restore/2023-05-16T04:30:23.527718212Z] moving to state dumpDone
      2023-05-16T04:32:47Z I [shard3ReplSet/10.80.10.159:27038] [restore/2023-05-16T04:30:23.527718212Z] moving to state dumpDone
      2023-05-16T04:32:52Z I [shard2ReplSet/10.80.10.186:27038] [restore/2023-05-16T04:30:23.527718212Z] moving to state dumpDone
      2023-05-16T04:32:55Z I [shard3ReplSet/10.80.10.159:27038] [restore/2023-05-16T04:30:23.527718212Z] starting oplog replay
      2023-05-16T04:32:56Z I [shard1ReplSet/10.80.11.253:27038] [restore/2023-05-16T04:30:23.527718212Z] moving to state dumpDone
      2023-05-16T04:32:57Z I [shard2ReplSet/10.80.10.186:27038] [restore/2023-05-16T04:30:23.527718212Z] starting oplog replay
      2023-05-16T04:32:57Z I [shard1ReplSet/10.80.11.253:27038] [restore/2023-05-16T04:30:23.527718212Z] starting oplog replay
      2023-05-16T04:32:58Z I [configReplSet/10.80.11.253:27039] [restore/2023-05-16T04:30:23.527718212Z] starting oplog replay
      2023-05-16T04:33:53Z I [shard3ReplSet/10.80.10.159:27038] [restore/2023-05-16T04:30:23.527718212Z] oplog replay finished on {1683682875 266}
      2023-05-16T04:33:53Z I [shard3ReplSet/10.80.10.159:27038] [restore/2023-05-16T04:30:23.527718212Z] restore finished successfully
      2023-05-16T04:35:58Z I [shard2ReplSet/10.80.10.186:27038] [restore/2023-05-16T04:30:23.527718212Z] oplog replay finished on {1683682875 261}
      2023-05-16T04:35:58Z I [shard2ReplSet/10.80.10.186:27038] [restore/2023-05-16T04:30:23.527718212Z] restore finished successfully
      2023-05-16T04:40:36Z I [shard1ReplSet/10.80.11.253:27038] [restore/2023-05-16T04:30:23.527718212Z] oplog replay finished on {1683682875 267}
      2023-05-16T04:40:36Z I [shard1ReplSet/10.80.11.253:27038] [restore/2023-05-16T04:30:23.527718212Z] restore finished successfully

      Attachments

        1. Config_log.txt
          177 kB
        2. Mongod_logs_2023-08-04.txt
          83 kB
        3. Mongod logs.txt
          22 kB
        4. OPlog.txt
          561 kB
        5. oplog-logging.diff
          3 kB
        6. pbm_log.zip
          4.32 MB
        7. pbm logs.txt
          2.26 MB
        8. screenshot-1.png
          screenshot-1.png
          70 kB

        Activity

          People

            dmytro.zghoba Dmytro Zghoba
            aranjith0 Ranjith
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Smart Checklist