user namespace is missing for some of the accounts (side effects is 'Internal Server Error' during che workspace creation)

[mmorhun]

When I try to start any workspace it fails right after loading GWT IDE with Internal Server Error occurred, error time: ******** message in a popup.

I have <username>-che namespace. When I try to see logs or events I only can see No Pods message.
I can always reproduce this issue. It doesn't matter which stack I try to use (I tried a few - the same result).

[AndrienkoAleksandr]

I have the same issue.

[ibuziuk]

@AndrienkoAleksandr @mmorhun could you please provide events from *-che namespaces from oso ?

[ibuziuk]

for @mmorhun case the che server logs shows the following:

com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: No namespace with type 'user' was found in the user tenant at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2214) at com.google.common.cache.LocalCache.get(LocalCache.java:4053) at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057) at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986) at com.redhat.che.multitenant.TenantDataProvider.getUserCheTenantData(TenantDataProvider.java:85)

@AndrienkoAleksandr could you please provide your osio username ?

[AndrienkoAleksandr]

@ibuziuk I'm using oandriie to login.

[ibuziuk]

@AndrienkoAleksandr do you have all the namespaces when you login to oso ? it appeared to be that @mmorhun is missing user namespace (mmorhun namespace does not exist) :

[ibuziuk]

@aslakknutsen any ideas why user namespace could me missing ?

[AndrienkoAleksandr]

[ibuziuk]

@AndrienkoAleksandr O_O you're also missing user namespace oandriie but what is super weird is the TestProject namepace.

[ibuziuk]

@AndrienkoAleksandr have you created TestProject manually via oc / web console ?

[AndrienkoAleksandr]

@ibuziuk, sorry, I can't remember.

[ibuziuk]

@AndrienkoAleksandr I would really appreciate if you could try to delete TestProject (if you would be able to do it, this would mean that you have created the project yourself, otherwise it would mean some subtle bug in init-tenant)

[AndrienkoAleksandr]

@ibuziuk I deleted project. Look at video, please:

[ibuziuk]

The issue with missing / extra namespaces is tracked [1] by the SD team.
@mmorhun @AndrienkoAleksandr the issue for your accounts have been fixed. could you please re-login (in order to trigger init-tenant) and verify that the problem is fixed ?

[1] https://gitlab.cee.redhat.com/dtsd/housekeeping/issues/1852

[ibuziuk]

The issue with extra namespaces is supposed to be fixed as part of #1446

[mmorhun]

@ibuziuk I still cannot start a workspace. I delete all existed workspaces, created new one from Java-CentOS stack and the same error...

[AndrienkoAleksandr]

Doesn't work for me too. The same exception.

[mmorhun]

But namespaces are gone:

[xyntrix]

@mmorhun are you able to go to profile -> edit profile -> update tenant? that should create missing objects. if that doesn't work go to the same spot and try "reset environment".

i am not seeing namespaces for mmorhun* via tier2 or via service account -- so, if they were manually created, this would be in a space that i cannot see into.

[mmorhun]

@mmclanerh yes updating of tenant helped. Thank you.

[AndrienkoAleksandr]

@mmclanerh updating of tenant helped me too. Thank you!

[ibuziuk]

@mmorhun @AndrienkoAleksandr thanks for reporting! Closing this one since the issue with extra namespaces is supposed to be fully fixed as part of #1446