Skip to content

Commit

Permalink
[8.x](backport #4232) Add all data set types to quality page (#4344)
Browse files Browse the repository at this point in the history
  • Loading branch information
mergify[bot] authored Oct 7, 2024
1 parent 2a9eb36 commit eff95f8
Show file tree
Hide file tree
Showing 4 changed files with 15 additions and 12 deletions.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file not shown.
5 changes: 3 additions & 2 deletions docs/en/observability/index.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -194,8 +194,6 @@ include::inspect-log-anomalies.asciidoc[leveloffset=+3]

include::configure-logs-sources.asciidoc[leveloffset=+3]

include::logs-monitor-datasets.asciidoc[leveloffset=+2]

include::logs-add-service-name.asciidoc[leveloffset=+2]

include::logs-index-template.asciidoc[leveloffset=+2]
Expand Down Expand Up @@ -235,6 +233,9 @@ include::slo-privileges.asciidoc[leveloffset=+3]

include::slo-create.asciidoc[leveloffset=+3]

//Data Set Quality
include::logs-monitor-datasets.asciidoc[leveloffset=+1]

//Observability AI Assistant
include::observability-ai-assistant.asciidoc[leveloffset=+1]

Expand Down
22 changes: 12 additions & 10 deletions docs/en/observability/logs-monitor-datasets.asciidoc
Original file line number Diff line number Diff line change
@@ -1,14 +1,16 @@
[[monitor-datasets]]
= Monitor log data set quality
= Data set quality

beta:[]

The **Data Set Quality** page provides an overview of your log data sets.
Use this information to get an idea of your overall log data set quality and find data sets that contain incorrectly parsed documents.
The **Data Set Quality** page provides an overview of your log, metric, trace, and synthetic data sets.
Use this information to get an idea of your overall data set quality and find data sets that contain incorrectly parsed documents.

Access the Data Set Quality page from the main {kib} menu at **Stack Management** → **Data Set Quality**.
By default, the page only shows log data sets. To see other data set types, select them from the **Type** menu.

[role="screenshot"]
image::images/logs-dataset-overview.png[Screen capture of the data set overview]
image::images/data-set-quality-overview.png[Screen capture of the data set overview]

.Requirements
[NOTE]
Expand Down Expand Up @@ -36,7 +38,7 @@ Opening the details of a specific data set shows the degraded documents history,

The Data Set Quality page has a couple of different ways to help you find ignored fields and investigate issues.
From the data set table, you can open the data set's details page, and view commonly ignored fields and information about those fields.
You can also open a data set in Logs Explorer to find ignored fields in individual logs.
Open a logs data set in Logs Explorer or other data set types in Discover to find ignored fields in individual documents.

[discrete]
[[find-ignored-fields-in-data-sets]]
Expand All @@ -51,19 +53,19 @@ The **Quality issues** section shows fields that were ignored during ingest, the

[discrete]
[[find-ignored-fields-in-individual-logs]]
=== Find ignored fields in individual logs
=== Find ignored fields in individual documents

To use Logs Explorer to find ignored fields in individual logs:
To use Logs Explorer or Discover to find ignored fields in individual documents:

. Find data sets with degraded documents using the **Degraded Docs** column of the data sets table.
. Click the percentage in the **Degraded Docs** column to open the data set in Logs Explorer.
. Click the percentage in the **Degraded Docs** column to open the data set in Logs Explorer or Discover.

The **Documents** table in Logs Explorer is automatically filtered to show documents that were not parsed correctly.
The **Documents** table in Logs Explorer or Discover is automatically filtered to show documents that were not parsed correctly.
Under the **actions** column, you'll find the degraded document icon.

Now that you know which documents contain ignored fields, examine them more closely to find the origin of the issue:

. Under the **actions** column, click image:images/expand-icon.png[expand icon] to open the log details.
. Under the **actions** column, click image:images/expand-icon.png[expand icon] to open the document details.
. Select the **JSON** tab.
. Scroll towards the end of the JSON to find the `ignored_field_values`.

Expand Down

0 comments on commit eff95f8

Please sign in to comment.