Uploaded image for project: 'Percona Monitoring and Management'
  1. Percona Monitoring and Management
  2. PMM-8581

Grafana is not started after PMM upgrade in Docker

Details

    • Bug
    • Status: Done
    • Critical
    • Resolution: Fixed
    • 2.21.0
    • 2.21.0
    • None
    • Yes
    • Yes
    • C/S Core

    Description

      User impact: PMM doesn't work

      STR:

      1. Install PMM 2.20.0
      2. Upgrade via docker: docker rm&stop pmm-server and then docker run dev-latest
      3. Check pmm-server logs

      Actual result:

       2021-08-10 16:49:31,342 INFO exited: grafana (exit status 1; not expected)
      2021-08-10 16:49:31,594 INFO gave up: grafana entered FATAL state, too many start retries too quickly
      2021-08-10 16:49:31,820 INFO exited: dashboard-upgrade (exit status 255; not expected)
      2021-08-10 16:49:32,043 INFO spawned: 'dashboard-upgrade' with pid 2446
      2021-08-10 16:49:32,050 INFO success: dashboard-upgrade entered RUNNING state, process has stayed up for > than 0 seconds (startsecs)
      2021-08-10 16:49:39,774 INFO spawned: 'grafana' with pid 2471
      2021-08-10 16:49:39,855 INFO exited: grafana (exit status 1; not expected)
      

      grafana.log:

       t=2021-08-10T16:55:05+0000 lvl=info msg="Starting Grafana" logger=server version=7.5.6 commit=v7.5.7-2.21.0 branch=master compiled=2021-08-09T15:25:49+0000
      t=2021-08-10T16:55:05+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini
      t=2021-08-10T16:55:05+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini
      t=2021-08-10T16:55:05+0000 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.data=/srv/grafana"
      t=2021-08-10T16:55:05+0000 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.logs=/srv/logs"
      t=2021-08-10T16:55:05+0000 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.plugins=/var/lib/grafana/plugins"
      t=2021-08-10T16:55:05+0000 lvl=info msg="Config overridden from command line" logger=settings arg="default.server.root_url=%(protocol)s://%(domain)s:%(http_port)s/graph"
      t=2021-08-10T16:55:05+0000 lvl=info msg="Config overridden from command line" logger=settings arg="default.log.mode=console"
      t=2021-08-10T16:55:05+0000 lvl=info msg="Config overridden from command line" logger=settings arg="default.log.console.format=console"
      t=2021-08-10T16:55:05+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana
      t=2021-08-10T16:55:05+0000 lvl=info msg="Path Data" logger=settings path=/srv/grafana
      t=2021-08-10T16:55:05+0000 lvl=info msg="Path Logs" logger=settings path=/srv/logs
      t=2021-08-10T16:55:05+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins
      t=2021-08-10T16:55:05+0000 lvl=info msg="Path Provisioning" logger=settings path=/usr/share/grafana/conf/provisioning
      t=2021-08-10T16:55:05+0000 lvl=info msg="App mode production" logger=settings
      t=2021-08-10T16:55:05+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3
      t=2021-08-10T16:55:05+0000 lvl=info msg="Starting DB migrations" logger=migrator
      service init failed: failed to check table existence: unable to open database file: permission denied
       [[email protected] opt]# ls -la /srv/grafana
      total 9972
      drwxrwxr-x  3 nginx nginx     4096 Aug 11 09:46 .
      drwxr-xr-x 12 root  root      4096 Aug 11 09:41 ..
      -rw-r-----  1 nginx nginx 10194944 Aug 11 09:46 grafana.db
      -rw-r--r--  1 root  root         7 Jul 27 11:04 PERCONA_DASHBOARDS_VERSION
      drwx------  2 nginx nginx     4096 Jul 27 11:04 png

      Attachments

        Activity

          People

            nikita.beletskii Nikita Beletskii (Inactive)
            nailya.kutlubaeva Nailya Kutlubaeva
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Smart Checklist