Uploaded image for project: 'openATTIC'
  1. openATTIC
  2. OP-2075 oa-systemd may not respond via DBUS
  3. OP-2291

If `rbd list` hangs, `oaconfig install` fails.

    XMLWordPrintable

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 3.1.0
    • Fix Version/s: 2.0.21, 3.1.1
    • Component/s: Backend: Ceph
    • Labels:
    • Sprint:
      Sprint 24

      Description

      rbd list hangs:

      oa-e2e-sle-2:~ # rbd list
      ^C
      

      Therefore, oaconfig install fails

      oa-e2e-sle-2:/srv/openattic/backend # ./manage.py post_install
      Reading file /etc/sysconfig/openattic
      Found lo
      Found eth0
      The authentication token for 'openattic' does already exist.
      Updating Nagios configs: adding detected Ceph clusters
      Traceback (most recent call last):
        File "./manage.py", line 26, in <module>
          execute_from_command_line(sys.argv)
        File "/usr/lib/python2.7/site-packages/django/core/management/__init__.py", line 399, in execute_from_command_line
          utility.execute()
        File "/usr/lib/python2.7/site-packages/django/core/management/__init__.py", line 392, in execute
          self.fetch_command(subcommand).run_from_argv(self.argv)
        File "/usr/lib/python2.7/site-packages/django/core/management/base.py", line 242, in run_from_argv
          self.execute(*args, **options.__dict__)
        File "/usr/lib/python2.7/site-packages/django/core/management/base.py", line 285, in execute
          output = self.handle(*args, **options)
        File "/srv/openattic/backend/sysutils/management/commands/post_install.py", line 49, in handle
          sysutils.models.post_install.send(sender=sysutils.models)
        File "/usr/lib/python2.7/site-packages/django/dispatch/dispatcher.py", line 185, in send
          response = receiver(signal=self, sender=sender, **named)
        File "/srv/openattic/backend/ceph/management/__init__.py", line 35, in update
          ceph.write_rbd_nagios_configs()
        File "/usr/lib/python2.7/site-packages/dbus/proxies.py", line 145, in __call__
          **keywords)
        File "/usr/lib/python2.7/site-packages/dbus/connection.py", line 651, in call_blocking
          message, timeout)
      dbus.exceptions.DBusException: org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken.
      

      Because, according to gdb, we're currently waiting for `multiprocessing`:

      (gdb) where 
      #0  0x00007fcc4789a480 in __poll_nocancel () from /lib64/libc.so.6
      #1  0x00007fcc2eff75eb in ?? () from /usr/lib64/python2.7/lib-dynload/_multiprocessing.so 
      #2  0x00007fcc47e65df9 in PyEval_EvalFrameEx () from /usr/lib64/libpython2.7.so.1.0 
      #3  0x00007fcc47e707e4 in PyEval_EvalCodeEx () from /usr/lib64/libpython2.7.so.1.0
      #4  0x00007fcc47e6ae69 in PyEval_EvalFrameEx () from /usr/lib64/libpython2.7.so.1.0 
      #5  0x00007fcc47e707e4 in PyEval_EvalCodeEx () from /usr/lib64/libpython2.7.so.1.0
      #6  0x00007fcc47e6ae69 in PyEval_EvalFrameEx () from /usr/lib64/libpython2.7.so.1.0 
      #7  0x00007fcc47e707e4 in PyEval_EvalCodeEx () from /usr/lib64/libpython2.7.so.1.0
      #8  0x00007fcc47e6b3d1 in PyEval_EvalFrameEx () from /usr/lib64/libpython2.7.so.1.0 
      #9  0x00007fcc47e0b097 in ?? () from /usr/lib64/libpython2.7.so.1.0 
      #10 0x00007fcc47dfe3ab in PyIter_Next () from /usr/lib64/libpython2.7.so.1.0 
      #11 0x00007fcc4684f955 in ?? () from /usr/lib64/python2.7/lib-dynload/itertools.so
      #12 0x00007fcc47e664dc in PyEval_EvalFrameEx () from /usr/lib64/libpython2.7.so.1.0 
      #13 0x00007fcc47e0b097 in ?? () from /usr/lib64/libpython2.7.so.1.0 
      #14 0x00007fcc47e664dc in PyEval_EvalFrameEx () from /usr/lib64/libpython2.7.so.1.0 
      #15 0x00007fcc47e707e4 in PyEval_EvalCodeEx () from /usr/lib64/libpython2.7.so.1.0
      #16 0x00007fcc47e6b3d1 in PyEval_EvalFrameEx () from /usr/lib64/libpython2.7.so.1.0 
      #17 0x00007fcc47e6abe4 in PyEval_EvalFrameEx () from /usr/lib64/libpython2.7.so.1.0 
      #18 0x00007fcc47e707e4 in PyEval_EvalCodeEx () from /usr/lib64/libpython2.7.so.1.0
      #19 0x00007fcc47e6b3d1 in PyEval_EvalFrameEx () from /usr/lib64/libpython2.7.so.1.0 
      #20 0x00007fcc47e707e4 in PyEval_EvalCodeEx () from /usr/lib64/libpython2.7.so.1.0
      #21 0x00007fcc47e137ff in ?? () from /usr/lib64/libpython2.7.so.1.0 
      #22 0x00007fcc47dfcc86 in PyObject_Call () from /usr/lib64/libpython2.7.so.1.0
      #23 0x00007fcc47dfd62d in PyObject_CallFunctionObjArgs () from /usr/lib64/libpython2.7.so.1.0 
      #24 0x00007fcc47e2f099 in _PyObject_GenericGetAttrWithDict () from /usr/lib64/libpython2.7.so.1.0 
      #25 0x00007fcc47e66332 in PyEval_EvalFrameEx () from /usr/lib64/libpython2.7.so.1.0 
      #26 0x00007fcc47e6abe4 in PyEval_EvalFrameEx () from /usr/lib64/libpython2.7.so.1.0 
      #27 0x00007fcc47e707e4 in PyEval_EvalCodeEx () from /usr/lib64/libpython2.7.so.1.0
      #28 0x00007fcc47e137ff in ?? () from /usr/lib64/libpython2.7.so.1.0 
      #29 0x00007fcc47dfcc86 in PyObject_Call () from /usr/lib64/libpython2.7.so.1.0
      #30 0x00007fcc47dfd62d in PyObject_CallFunctionObjArgs () from /usr/lib64/libpython2.7.so.1.0 
      #31 0x00007fcc47e2f099 in _PyObject_GenericGetAttrWithDict () from /usr/lib64/libpython2.7.so.1.0 
      #32 0x00007fcc47e66332 in PyEval_EvalFrameEx () from /usr/lib64/libpython2.7.so.1.0 
      #33 0x00007fcc47e707e4 in PyEval_EvalCodeEx () from /usr/lib64/libpython2.7.so.1.0
      #34 0x00007fcc47e137ff in ?? () from /usr/lib64/libpython2.7.so.1.0 
      #35 0x00007fcc47dfcc86 in PyObject_Call () from /usr/lib64/libpython2.7.so.1.0
      #36 0x00007fcc47e038ee in ?? () from /usr/lib64/libpython2.7.so.1.0 
      #37 0x00007fcc47dfcc86 in PyObject_Call () from /usr/lib64/libpython2.7.so.1.0
      #38 0x00007fcc47e4a1d8 in ?? () from /usr/lib64/libpython2.7.so.1.0 
      #39 0x00007fcc47e664dc in PyEval_EvalFrameEx () from /usr/lib64/libpython2.7.so.1.0 
      #40 0x00007fcc47e707e4 in PyEval_EvalCodeEx () from /usr/lib64/libpython2.7.so.1.0
      #41 0x00007fcc47e13a0e in ?? () from /usr/lib64/libpython2.7.so.1.0 
      #42 0x00007fcc47dfcc86 in PyObject_Call () from /usr/lib64/libpython2.7.so.1.0
      #43 0x00007fcc47e6896a in PyEval_EvalFrameEx () from /usr/lib64/libpython2.7.so.1.0 
      #44 0x00007fcc47e707e4 in PyEval_EvalCodeEx () from /usr/lib64/libpython2.7.so.1.0
      #45 0x00007fcc47e13a0e in ?? () from /usr/lib64/libpython2.7.so.1.0 
      #46 0x00007fcc47dfcc86 in PyObject_Call () from /usr/lib64/libpython2.7.so.1.0
      #47 0x00007fcc47e038ee in ?? () from /usr/lib64/libpython2.7.so.1.0 
      #48 0x00007fcc47dfcc86 in PyObject_Call () from /usr/lib64/libpython2.7.so.1.0
      ...
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                lgrimmer Grimmer, Lenz
                Reporter:
                swagner Sebastian Wagner
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0 minutes
                  0m
                  Logged:
                  Time Spent - 2 hours
                  2h