STS Request was denied due to user flow control

[QiXingchuan]

Describe the bug
The query may have errors like this

ErrorCode: Throttling.User. Request was denied due to user flow control. q=Throttling.User&product=Sts

Steampipe version (steampipe -v)
Steampipe v1.0.0

Plugin version (steampipe plugin list)
hub.steampipe.io/plugins/turbot/alicloud@latest | 1.1.0

To reproduce

• Execute query like select * from alicloud_sandbox.alicloud_ecs_instance

Expected behavior
The error should not happen and should show the resource info

Additional context

• It seems that the plugin will call GetCallerIdentity frequently. Will the cache not work in some cases?

• I set the limit, but it seems not to work.

    plugin "alicloud" {
      limiter "exec_max_concurrency_limiter" {
        max_concurrency = 5
        bucket_size     = 5
        fill_rate       = 5
      }
    }

[ParthaI]

Hello, @QiXingchuan,

I’m sorry to hear that you’re encountering this issue. Let me ask a few follow-up questions to better understand and assist you:

• Which authentication mode are you using to query the tables?
• Could you share the content of your ~/.steampipe/config/oci.spc file? (Please ensure any sensitive information is removed before sharing.)
• If the issue occurs with a specific profile authentication, would it be possible to try using a different profile authentication mode to see if the problem persists?
• Have you tested the query with and without the rate-limiter configuration? Does the issue occur in both cases?

Looking forward to your response so we can troubleshoot this further. 😊

[QiXingchuan]

Hi @ParthaI,

Which authentication mode are you using to query the tables?

• I am using RamRoleArn mode

Could you share the content of your ~/.steampipe/config/oci.spc file? (Please ensure any sensitive information is removed before sharing.)

• ~/.steampipe/config/alicloud.spc

plugin "alicloud" {
   limiter "exec_max_concurrency_limiter" {
      max_concurrency = 5
      bucket_size     = 5
      fill_rate       = 5
   }
}

connection "alicloud_all" {
  type        = "aggregator"
  plugin      = "alicloud"
  connections = ["ali*"]
}

connection "ali_sandbox_cloud1" {
  plugin  = "alicloud"
  regions = ["ap-southeast-1"]
  profile = "sandbox_cloud1"
}

connection "ali_sandbox_cloud2" {
  plugin  = "alicloud"
  regions = ["ap-southeast-1"]
  profile = "sandbox_cloud2"
}

...
connection "ali_sandbox_cloud100" {
  plugin  = "alicloud"
  regions = ["ap-southeast-1"]
  profile = "sandbox_cloud100"
}

If the issue occurs with a specific profile authentication, would it be possible to try using a different profile authentication mode to see if the problem persists?

• If I only use AKSK mode, it will only query one account, and the STS issues will not happen
• But if I use AKSK mode to query some resources needing to get attributes by get func like getEcsDiskAutoSnapshotPolicy, it will also have the user flow control issue, and the throttled API will be from ECS. Example: select * from ali_sandbox.alicloud_ecs_disk(The Rate Limiting doesn't work)

Have you tested the query with and without the rate-limiter configuration? Does the issue occur in both cases?

• Yes, the issue happens both
• I checked the audit log, It has far more queries than the limit value I set

[ParthaI]

Hello @QiXingchuan,

Apologies for the delay. Could you please try it with our latest plugin version and let us know if the issue still persists? We have updated the authentication module to leverage the SDK’s native profile authentication and removed manual profile handling.