Ceph Error when running bmi as bmi user

[chemistry-sourabh]

As all of you know I am trying to containerize bmi for easy deployment of light weight dev and production.

Tried installing bmi with proper permissions ( #89 ) for production deployment. Tried running bmi db ls as bmi user, but landed with this error.

Traceback (most recent call last):
  File "/usr/local/bin/bmi", line 9, in <module>
    load_entry_point('ims==0.3', 'console_scripts', 'bmi')()
  File "/usr/local/lib/python2.7/dist-packages/click-6.7-py2.7.egg/click/core.py", line 722, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/click-6.7-py2.7.egg/click/core.py", line 697, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python2.7/dist-packages/click-6.7-py2.7.egg/click/core.py", line 1066, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python2.7/dist-packages/click-6.7-py2.7.egg/click/core.py", line 1066, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python2.7/dist-packages/click-6.7-py2.7.egg/click/core.py", line 895, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python2.7/dist-packages/click-6.7-py2.7.egg/click/core.py", line 535, in invoke
    return callback(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/ims-0.3-py2.7.egg/ims/cli/cli.py", line 40, in function_wrapper
    return func(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/ims-0.3-py2.7.egg/ims/cli/cli.py", line 431, in list_all_images
    with BMI(_username, _password, constants.BMI_ADMIN_PROJECT) as bmi:
  File "/usr/local/lib/python2.7/dist-packages/ims-0.3-py2.7.egg/ims/common/log.py", line 32, in func_wrapper
    ret = func(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/ims-0.3-py2.7.egg/ims/einstein/operations.py", line 57, in __init__
    self.cfg.iscsi.password)
  File "/usr/local/lib/python2.7/dist-packages/ims-0.3-py2.7.egg/ims/common/log.py", line 32, in func_wrapper
    ret = func(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/ims-0.3-py2.7.egg/ims/einstein/ceph.py", line 24, in __init__
    self.cluster = self.__init_cluster()
  File "/usr/local/lib/python2.7/dist-packages/ims-0.3-py2.7.egg/ims/common/log.py", line 60, in func_wrapper
    ret = func(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/ims-0.3-py2.7.egg/ims/einstein/ceph.py", line 52, in __init_cluster
    cluster.connect()
  File "rados.pyx", line 785, in rados.Rados.connect (/build/ceph-RG9HEH/ceph-10.2.6/src/build/rados.c:10073)
rados.ObjectNotFound: error connecting to the cluster

I need to do sudo rbd ls to see the images in ceph. Regular rbd ls doesn't work, it gives a unable to connect to cluster. Error is not observed when running as root.

I am guessing it is some permissions issue. @sirushtim and @ravisantoshgudimetla any ideas ?

[apoorvemohan]

Was the ceph pool and Id configured correctly?

[chemistry-sourabh]

I am able to a sudo rbd ls without giving any --id or --pool, but not able to a rbd ls

The error is as follows

2017-03-24 02:18:06.115339 7f4845915100 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory
2017-03-24 02:18:06.115368 7f4845915100 -1 monclient(hunting): ERROR: missing keyring, cannot use cephx for authentication
2017-03-24 02:18:06.115370 7f4845915100  0 librados: client.admin initialization error (2) No such file or directory
rbd: couldn't connect to the cluster!

[apoorvemohan]

Ceph args must be configured in .bashrc of root user and not for "user" user

[chemistry-sourabh]

Ceph args are not configured for root but it works in root. I tried giving --id and --pool to "user"s rbd, but got the same error.

[apoorvemohan]

Where are you testing this?

[chemistry-sourabh]

in a container

[apoorvemohan]

On which machine?

[chemistry-sourabh]

on my mac

[apoorvemohan]

How are you connecting to CEPH?

[chemistry-sourabh]

Deployed a ceph container on my mac. Connecting through dockers internal network

[apoorvemohan]

I meant which ceph are you connecting to?