Uploaded image for project: 'openATTIC'
  1. openATTIC
  2. OP-3017

Gatling tests: 'osd pool create' terminated because of timeout (30 sec)

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.6.2
    • Fix Version/s: 3.6.2
    • Component/s: QA/Testing
    • Labels:

      Description

      Info: Happened on a new deployed DeepSea cluster (master branch)

      Ceph version: ceph version 12.2.2-361-g5030136da9 (5030136da9267f4f4d9700e343ad4ee911f89d8c) luminous (stable)

      ERROR [0.000s]: setUpClass (rbd.test_rbd_create.RbdCreateDataPoolTestCase)
      ----------------------------------------------------------------------
      Traceback (most recent call last):
        File "/home/jenkins/workspace/workspace/oa-test-gui-pr-sle-1/openattic/gatling/rbd/scenarios.py", line 31, in setUpClass
          cls.replicated_pool_1 = cls.create_test_pool('gatling_pool_replicated_1', 'replicated')
        File "/home/jenkins/workspace/workspace/oa-test-gui-pr-sle-1/openattic/gatling/rbd/scenarios.py", line 64, in create_test_pool
          res = cls.send_ceph_request('POST', cls.fsid, 'pools', data=pool_data)
        File "/home/jenkins/workspace/workspace/oa-test-gui-pr-sle-1/openattic/gatling/testcase.py", line 376, in send_ceph_request
          res = cls._do_request(method, url, headers, data=data)
        File "/home/jenkins/workspace/workspace/oa-test-gui-pr-sle-1/openattic/gatling/testcase.py", line 344, in _do_request
          request=e.request)
      requests.exceptions.HTTPError: 500 Server Error: INTERNAL SERVER ERROR for url: http://<oa-host>/openattic/api/ceph/a326aceb-2e98-35c0-9fac-000f3c4a1cc7/pools content: {"detail": "Command 'osd pool create' terminated because of timeout (30 sec)."}

      /var/log/openattic/openattic.log:

      2017-12-22 13:37:15,246 3491 mod_wsgi INFO ceph_radosgw.rgw_client#_load_settings - Using DeepSea RGW settings to connect to RGW REST API
      2017-12-22 13:37:15,246 3491 mod_wsgi INFO ceph_radosgw.rgw_client#_load_settings - Creating new connection for user: admin
      2017-12-22 13:37:45,686 3491 mod_wsgi ERROR ceph.librados#undo_transaction - Will now undo steps performed.
      Traceback (most recent call last):
        File "/srv/openattic/backend/ceph/librados.py", line 490, in undo_transaction
          yield undo_context
        File "/srv/openattic/backend/ceph/models.py", line 440, in save
          None)
        File "/srv/openattic/backend/ceph/librados.py", line 461, in wrapper
          ret = next(runner)
        File "/srv/openattic/backend/ceph/librados.py", line 641, in osd_pool_create
          output_format='string')
        File "/srv/openattic/backend/ceph/librados.py", line 1059, in _call_mon_command
          timeout)
        File "/srv/openattic/backend/ceph/librados.py", line 439, in call_librados
          return run_in_external_process(with_client, cmd_name, timeout)
        File "/srv/openattic/backend/utilities.py", line 170, in run_in_external_process
          'Command \'{}\' terminated because of timeout ({} sec).'.format(cmd_name, timeout))
      ExternalCommandError: Command 'osd pool create' terminated because of timeout (30 sec).
      2017-12-22 13:37:45,688 3491 mod_wsgi ERROR exception#custom_handler - Internal Server Error: None
      Traceback (most recent call last):
        File "/usr/lib/python2.7/site-packages/rest_framework/views.py", line 400, in dispatch
          response = handler(request, *args, **kwargs)
        File "/usr/lib/python2.7/site-packages/rest_framework/mixins.py", line 54, in create
          self.object = serializer.save(force_insert=True)
        File "/usr/lib/python2.7/site-packages/rest_framework/serializers.py", line 599, in save
          self.save_object(self.object, **kwargs)
        File "/usr/lib/python2.7/site-packages/rest_framework/serializers.py", line 1041, in save_object
          obj.save(**kwargs)
        File "/srv/openattic/backend/ceph/models.py", line 440, in save
          None)
        File "/srv/openattic/backend/ceph/librados.py", line 461, in wrapper
          ret = next(runner)
        File "/srv/openattic/backend/ceph/librados.py", line 641, in osd_pool_create
          output_format='string')
        File "/srv/openattic/backend/ceph/librados.py", line 1059, in _call_mon_command
          timeout)
        File "/srv/openattic/backend/ceph/librados.py", line 439, in call_librados
          return run_in_external_process(with_client, cmd_name, timeout)
        File "/srv/openattic/backend/utilities.py", line 170, in run_in_external_process
          'Command \'{}\' terminated because of timeout ({} sec).'.format(cmd_name, timeout))
      ExternalCommandError: Command 'osd pool create' terminated because of timeout (30 sec).
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                vtheile Theile, Volker
                Reporter:
                lpaduano Paduano, Laura
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: