Upgrade dashboard to support Prometheus 2.11.x and newer

[christoph-buente]

Some metric names have been renamed in prometheus which breaks some of the graphs. Would you mind giving it an upgrade?

Thank you!

[FUSAKLA]

Hi, yes I should update it. Thanks for reminding!
I'll try to look at it hopefully soon :)

[christoph-buente]

Thank you. There are also 2 typos for panel name:

• Cont of concurent queries, guess it should be Count of concurent queries
• Rule evaulation duration should be Rule evaluation duration

[FUSAKLA]

I added a script to verify check of missing Prometheus metrics in the dashboard and on the other hand usage of already not exposed metrics by Prometheus

result is:

Checking for Prometheus metrics not used in the dashboard:
  - go_gc_duration_seconds
  - go_gc_duration_seconds_count
  - go_gc_duration_seconds_sum
  - go_goroutines
  - go_info
  - go_memstats_buck_hash_sys_bytes
  - go_memstats_frees_total
  - go_memstats_gc_cpu_fraction
  - go_memstats_gc_sys_bytes
  - go_memstats_heap_alloc_bytes
  - go_memstats_heap_idle_bytes
  - go_memstats_heap_inuse_bytes
  - go_memstats_heap_objects
  - go_memstats_heap_released_bytes
  - go_memstats_heap_sys_bytes
  - go_memstats_last_gc_time_seconds
  - go_memstats_lookups_total
  - go_memstats_mallocs_total
  - go_memstats_mcache_inuse_bytes
  - go_memstats_mcache_sys_bytes
  - go_memstats_mspan_inuse_bytes
  - go_memstats_mspan_sys_bytes
  - go_memstats_next_gc_bytes
  - go_memstats_other_sys_bytes
  - go_memstats_stack_inuse_bytes
  - go_memstats_stack_sys_bytes
  - go_memstats_sys_bytes
  - go_threads
  - net_conntrack_dialer_conn_attempted_total
  - net_conntrack_dialer_conn_closed_total
  - net_conntrack_dialer_conn_established_total
  - net_conntrack_listener_conn_accepted_total
  - net_conntrack_listener_conn_closed_total
  - process_max_fds
  - process_open_fds
  - process_virtual_memory_bytes
  - process_virtual_memory_max_bytes
  - prometheus_api_remote_read_queries
  - prometheus_config_last_reload_successful
  - prometheus_engine_query_duration_seconds_count
  - prometheus_engine_query_duration_seconds_sum
  - prometheus_http_request_duration_seconds_count
  - prometheus_http_request_duration_seconds_sum
  - prometheus_http_response_size_bytes_count
  - prometheus_http_response_size_bytes_sum
  - prometheus_remote_storage_highest_timestamp_in_seconds
  - prometheus_remote_storage_samples_in_total
  - prometheus_remote_storage_string_interner_zero_reference_releases_total
  - prometheus_rule_evaluation_duration_seconds_count
  - prometheus_rule_evaluation_duration_seconds_sum
  - prometheus_rule_evaluations_total
  - prometheus_rule_group_duration_seconds
  - prometheus_rule_group_duration_seconds_count
  - prometheus_rule_group_duration_seconds_sum
  - prometheus_rule_group_iterations_missed_total
  - prometheus_rule_group_iterations_total
  - prometheus_sd_consul_rpc_duration_seconds
  - prometheus_sd_consul_rpc_duration_seconds_count
  - prometheus_sd_consul_rpc_duration_seconds_sum
  - prometheus_sd_discovered_targets
  - prometheus_sd_dns_lookup_failures_total
  - prometheus_sd_dns_lookups_total
  - prometheus_sd_file_scan_duration_seconds
  - prometheus_sd_file_scan_duration_seconds_count
  - prometheus_sd_file_scan_duration_seconds_sum
  - prometheus_sd_kubernetes_cache_last_resource_version
  - prometheus_sd_kubernetes_cache_list_duration_seconds_count
  - prometheus_sd_kubernetes_cache_list_duration_seconds_sum
  - prometheus_sd_kubernetes_cache_list_items_count
  - prometheus_sd_kubernetes_cache_list_items_sum
  - prometheus_sd_kubernetes_cache_list_total
  - prometheus_sd_kubernetes_cache_short_watches_total
  - prometheus_sd_kubernetes_cache_watch_duration_seconds_count
  - prometheus_sd_kubernetes_cache_watch_duration_seconds_sum
  - prometheus_sd_kubernetes_cache_watch_events_count
  - prometheus_sd_kubernetes_cache_watch_events_sum
  - prometheus_sd_kubernetes_cache_watches_total
  - prometheus_sd_kubernetes_events_total
  - prometheus_sd_received_updates_total
  - prometheus_sd_updates_total
  - prometheus_target_interval_length_seconds_count
  - prometheus_target_interval_length_seconds_sum
  - prometheus_target_scrape_pool_reloads_failed_total
  - prometheus_target_scrape_pool_reloads_total
  - prometheus_target_scrape_pool_sync_total
  - prometheus_target_scrape_pools_failed_total
  - prometheus_target_scrape_pools_total
  - prometheus_target_scrapes_cache_flush_forced_total
  - prometheus_target_sync_length_seconds_sum
  - prometheus_template_text_expansion_failures_total
  - prometheus_template_text_expansions_total
  - prometheus_treecache_watcher_goroutines
  - prometheus_treecache_zookeeper_failures_total
  - prometheus_tsdb_checkpoint_creations_failed_total
  - prometheus_tsdb_checkpoint_creations_total
  - prometheus_tsdb_checkpoint_deletions_failed_total
  - prometheus_tsdb_checkpoint_deletions_total
  - prometheus_tsdb_compaction_chunk_range_seconds_bucket
  - prometheus_tsdb_compaction_chunk_range_seconds_count
  - prometheus_tsdb_compaction_chunk_range_seconds_sum
  - prometheus_tsdb_compaction_chunk_samples_bucket
  - prometheus_tsdb_compaction_chunk_samples_count
  - prometheus_tsdb_compaction_chunk_samples_sum
  - prometheus_tsdb_compaction_chunk_size_bytes_bucket
  - prometheus_tsdb_compaction_chunk_size_bytes_count
  - prometheus_tsdb_compaction_chunk_size_bytes_sum
  - prometheus_tsdb_compaction_duration_seconds_bucket
  - prometheus_tsdb_compaction_duration_seconds_count
  - prometheus_tsdb_compaction_duration_seconds_sum
  - prometheus_tsdb_compaction_populating_block
  - prometheus_tsdb_compactions_total
  - prometheus_tsdb_compactions_triggered_total
  - prometheus_tsdb_head_active_appenders
  - prometheus_tsdb_head_gc_duration_seconds_count
  - prometheus_tsdb_head_gc_duration_seconds_sum
  - prometheus_tsdb_head_max_time_seconds
  - prometheus_tsdb_head_min_time_seconds
  - prometheus_tsdb_head_series_not_found_total
  - prometheus_tsdb_head_truncations_failed_total
  - prometheus_tsdb_head_truncations_total
  - prometheus_tsdb_lowest_timestamp
  - prometheus_tsdb_lowest_timestamp_seconds
  - prometheus_tsdb_retention_limit_bytes
  - prometheus_tsdb_size_retentions_total
  - prometheus_tsdb_storage_blocks_bytes
  - prometheus_tsdb_symbol_table_size_bytes
  - prometheus_tsdb_time_retentions_total
  - prometheus_tsdb_tombstone_cleanup_seconds_bucket
  - prometheus_tsdb_tombstone_cleanup_seconds_count
  - prometheus_tsdb_tombstone_cleanup_seconds_sum
  - prometheus_tsdb_vertical_compactions_total
  - prometheus_tsdb_wal_completed_pages_total
  - prometheus_tsdb_wal_corruptions_total
  - prometheus_tsdb_wal_fsync_duration_seconds
  - prometheus_tsdb_wal_fsync_duration_seconds_count
  - prometheus_tsdb_wal_fsync_duration_seconds_sum
  - prometheus_tsdb_wal_page_flushes_total
  - prometheus_tsdb_wal_segment_current
  - prometheus_tsdb_wal_truncations_failed_total
  - prometheus_tsdb_wal_truncations_total
  - promhttp_metric_handler_requests_in_flight
  - promhttp_metric_handler_requests_total
  - scrape_duration_seconds
  - scrape_samples_post_metric_relabeling
  - scrape_samples_scraped
  - scrape_series_added



Checking for Prometheus metrics used in the dashboard but not exposed by the Prometheus:
  - prometheus_evaluator_iterations_missed_total
  - prometheus_evaluator_iterations_skipped_total
  - prometheus_local_storage_checkpoint_series_chunks_written_sum
  - prometheus_local_storage_indexing_queue_length
  - prometheus_local_storage_maintain_series_duration_seconds_count
  - prometheus_local_storage_memory_chunkdescs
  - prometheus_local_storage_memory_chunks
  - prometheus_local_storage_memory_series
  - prometheus_local_storage_rushed_mode
  - prometheus_sd_marathon_refresh_failures_total
  - prometheus_sd_openstack_refresh_failures_total
  - prometheus_tsdb_compaction_duration_count
  - prometheus_tsdb_compaction_duration_sum

So this is the TODO list more or less :))