Details

    • Type: Bug
    • Status: Done
    • Priority: High
    • Resolution: Cannot Reproduce
    • Affects Version/s: 1.4.1
    • Fix Version/s: None
    • Component/s: QAN Agent
    • Labels:
      None

      Description

      Trying to add a node to Mongo QAN, both client and pmm server is running 1.4.1:

      root@datanode-i-07156739bd1bee4d2:~# pmm-admin add mongodb:queries mongo-core-data-07156739bd1bee4d2 --uri mongodb://127.0.0.1:27017
      Error adding MongoDB queries: Put http://user:pass@172.16.5.184/qan-api/agents/e882f5e0da9b47367c0ae7bbe848694e/cmd: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
      

      I tried again:

      root@datanode-i-07156739bd1bee4d2:~# pmm-admin add mongodb:queries mongo-core-data-07156739bd1bee4d2 --uri mongodb://127.0.0.1:27017
      We have found system services disconnected from PMM server.
      Usually, this happens when data container is wiped before all monitoring services are removed or client is uninstalled.
      
      Orphaned local services: pmm-mongodb-queries-0
      
      To continue, run 'pmm-admin repair' to remove orphaned services.
      

      Then I ran pmm-admin repair and tried again:

      root@datanode-i-07156739bd1bee4d2:~# pmm-admin add mongodb:queries mongo-core-data-07156739bd1bee4d2 --uri mongodb://127.0.0.1:27017
      Error adding MongoDB queries: timeout 10s waiting on agent to connect to API.
      

      Other outputs:

      root@datanode-i-07156739bd1bee4d2:~# pmm-admin list
      pmm-admin 1.4.1
      
      PMM Server | 172.16.5.184 (password-protected)
      Client Name | datanode-i-07156739bd1bee4d2
      Client Address | 172.16.5.217
      Service Manager | linux-systemd
      
      ---------------- ---------------------------------- ----------- -------- ---------------- -------------------
      SERVICE TYPE NAME LOCAL PORT RUNNING DATA SOURCE OPTIONS
      ---------------- ---------------------------------- ----------- -------- ---------------- -------------------
      linux:metrics mongo-core-data-07156739bd1bee4d2 42000 YES -
      mongodb:metrics mongo-core-data-07156739bd1bee4d2 42003 YES 127.0.0.1:27017 cluster=xxxxxx_rs_1
      
      
      root@datanode-i-07156739bd1bee4d2:~# pmm-admin check-network
      PMM Network Status
      
      Server Address | 172.16.5.184
      Client Address | 172.16.5.217
      
      * System Time
      NTP Server (0.pool.ntp.org) | 2017-12-01 15:53:27 +0000 UTC
      PMM Server | 2017-12-01 15:53:27 +0000 GMT
      PMM Client | 2017-12-01 15:53:27 +0000 UTC
      PMM Server Time Drift | OK
      PMM Client Time Drift | OK
      PMM Client to PMM Server Time Drift | OK
      
      * Connection: Client --> Server
      -------------------- -------
      SERVER SERVICE STATUS
      -------------------- -------
      Consul API OK
      Prometheus API OK
      Query Analytics API OK
      
      Connection duration | 5.218496ms
      Request duration | 812.474┬Ás
      Full round trip | 6.03097ms
      
      
      * Connection: Client <-- Server
      ---------------- ---------------------------------- ------------------- ------- ---------- ---------
      SERVICE TYPE NAME REMOTE ENDPOINT STATUS HTTPS/TLS PASSWORD
      ---------------- ---------------------------------- ------------------- ------- ---------- ---------
      linux:metrics mongo-core-data-07156739bd1bee4d2 172.16.5.217:42000 OK YES YES
      mongodb:metrics mongo-core-data-07156739bd1bee4d2 172.16.5.217:42003 OK YES YES
      

        Smart Checklist

          Attachments

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                revin Jervin Real (Inactive)
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: