Uploaded image for project: 'Percona Monitoring and Management'
  1. Percona Monitoring and Management
  2. PMM-3693

pmm server fails to start pmm-managed after upgrade to 1.17.1

    Details

    • Type: Bug
    • Status: Done
    • Priority: Medium
    • Resolution: Duplicate
    • Affects Version/s: 1.17.1
    • Fix Version/s: None
    • Component/s: None
    • Labels:

      Description

      Using the PMM ami from AWS marketplace, after upgrading to 1.17.1 using the web interface, pmm-managed is refusing to start properly:

      journalctl -u pmm-managed.service -e --no-pager|less -f
      Mar 18 14:57:53 infra-pmm-server1-aw2 pmm-managed[43095]: time="2019-03-18T14:57:53Z" level=panic msg="RDS service problem: Init already exists: /etc/systemd/system/pmm-rds_exporter-9042.service\nfailed to install pmm-rds_exporter-9042\ngithub.com/percona/pmm-managed/services/supervisor.(*Supervisor).Start\n\t/home/builder/rpm/BUILD/pmm-managed-2f45c8d5541e65f407fe7d1a6ddcd5ce5422f133/src/github.com/percona/pmm-managed/services/supervisor/supervisor.go:60\ngithub.com/percona/pmm-managed/services/rds.(*Service).Restore\n\t/home/builder/rpm/BUILD/pmm-managed-2f45c8d5541e65f407fe7d1a6ddcd5ce5422f133/src/github.com/percona/pmm-managed/services/rds/rds.go:906\nmain.makeRDSService.func2\n\t/home/builder/rpm/BUILD/pmm-managed-2f45c8d5541e65f407fe7d1a6ddcd5ce5422f133/src/github.com/percona/pmm-managed/cmd/pmm-managed/main.go:193\ngithub.com/percona/pmm-managed/vendor/gopkg.in/reform%2ev1.(*DB).InTransaction\n\t/home/builder/rpm/BUILD/pmm-managed-2f45c8d5541e65f407fe7d1a6ddcd5ce5422f133/src/github.com/percona/pmm-managed/vendor/gopkg.in/reform.v1/db.go:73\nmain.makeRDSService\n\t/home/builder/rpm/BUILD/pmm-managed-2f45c8d5541e65f407fe7d1a6ddcd5ce5422f133/src/github.com/percona/pmm-managed/cmd/pmm-managed/main.go:192\nmain.main\n\t/home/builder/rpm/BUILD/pmm-managed-2f45c8d5541e65f407fe7d1a6ddcd5ce5422f133/src/github.com/percona/pmm-managed/cmd/pmm-managed/main.go:555\nruntime.main\n\t/usr/lib/golang/src/runtime/proc.go:198\nruntime.goexit\n\t/usr/lib/golang/src/runtime/asm_amd64.s:2361" component=main
      Mar 18 14:57:53 infra-pmm-server1-aw2 pmm-managed[43095]: time="2019-03-18T14:57:53Z" level=info msg=Done. component=main
      Mar 18 14:57:53 infra-pmm-server1-aw2 pmm-managed[43095]: panic: (*logrus.Entry) (0xcf6fa0,0xc420184d20)
      Mar 18 14:57:53 infra-pmm-server1-aw2 pmm-managed[43095]: goroutine 1 [running]:
      Mar 18 14:57:53 infra-pmm-server1-aw2 pmm-managed[43095]: github.com/percona/pmm-managed/vendor/github.com/sirupsen/logrus.Entry.log(0xc4201846e0, 0xc4202dd4a0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
      Mar 18 14:57:53 infra-pmm-server1-aw2 pmm-managed[43095]: /home/builder/rpm/BUILD/pmm-managed-2f45c8d5541e65f407fe7d1a6ddcd5ce5422f133/src/github.com/percona/pmm-managed/vendor/github.com/sirupsen/logrus/entry.go:126 +0x2d2
      Mar 18 14:57:53 infra-pmm-server1-aw2 pmm-managed[43095]: github.com/percona/pmm-managed/vendor/github.com/sirupsen/logrus.(*Entry).Panic(0xc4201858b0, 0xc42050dd30, 0x1, 0x1)
      Mar 18 14:57:53 infra-pmm-server1-aw2 pmm-managed[43095]: /home/builder/rpm/BUILD/pmm-managed-2f45c8d5541e65f407fe7d1a6ddcd5ce5422f133/src/github.com/percona/pmm-managed/vendor/github.com/sirupsen/logrus/entry.go:194 +0xaa
      Mar 18 14:57:53 infra-pmm-server1-aw2 pmm-managed[43095]: github.com/percona/pmm-managed/vendor/github.com/sirupsen/logrus.(*Entry).Panicf(0xc4201858b0, 0xd22ddd, 0x18, 0xc42050dec8, 0x1, 0x1)
      Mar 18 14:57:53 infra-pmm-server1-aw2 pmm-managed[43095]: /home/builder/rpm/BUILD/pmm-managed-2f45c8d5541e65f407fe7d1a6ddcd5ce5422f133/src/github.com/percona/pmm-managed/vendor/github.com/sirupsen/logrus/entry.go:242 +0xed
      Mar 18 14:57:53 infra-pmm-server1-aw2 pmm-managed[43095]: main.main()
      Mar 18 14:57:53 infra-pmm-server1-aw2 pmm-managed[43095]: /home/builder/rpm/BUILD/pmm-managed-2f45c8d5541e65f407fe7d1a6ddcd5ce5422f133/src/github.com/percona/pmm-managed/cmd/pmm-managed/main.go:557 +0x993
      Mar 18 14:57:53 infra-pmm-server1-aw2 systemd[1]: pmm-managed.service: main process exited, code=exited, status=2/INVALIDARGUMENT
      Mar 18 14:57:53 infra-pmm-server1-aw2 systemd[1]: Unit pmm-managed.service entered failed state.
      Mar 18 14:57:53 infra-pmm-server1-aw2 systemd[1]: pmm-managed.service failed.
      

        Smart Checklist

          Attachments

            Issue Links

              Activity

                People

                • Assignee:
                  lalit.choudhary Lalit Choudhary
                  Reporter:
                  Groenewold Ivan
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  3 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved: