Skip to content

Conversation

@schmikei
Copy link
Collaborator

@schmikei schmikei commented Aug 22, 2022

Description

Related issue

How has this been tested?

Integration testing and updates to confgenerator unit testing

Checklist:

  • Unit tests
    • Unit tests do not apply.
    • Unit tests have been added/modified and passed for this PR.
  • Integration tests
    • Integration tests do not apply.
    • Integration tests have been added/modified and passed for this PR.
  • Documentation
    • This PR introduces no user visible changes.
    • This PR introduces user visible changes and the corresponding documentation change has been made.
  • Minor version bump
    • This PR introduces no new features.
    • This PR introduces new features, and there is a separate PR to bump the minor version since the last release already.

@schmikei schmikei added the kokoro:force-run Forces kokoro to run integration tests on a CL label Aug 23, 2022
@stackdriver-instrumentation-release stackdriver-instrumentation-release removed the kokoro:force-run Forces kokoro to run integration tests on a CL label Aug 23, 2022
@schmikei schmikei added the kokoro:force-run Forces kokoro to run integration tests on a CL label Aug 23, 2022
@stackdriver-instrumentation-release stackdriver-instrumentation-release removed the kokoro:force-run Forces kokoro to run integration tests on a CL label Aug 23, 2022
@schmikei schmikei added the kokoro:force-run Forces kokoro to run integration tests on a CL label Aug 24, 2022
@stackdriver-instrumentation-release stackdriver-instrumentation-release removed the kokoro:force-run Forces kokoro to run integration tests on a CL label Aug 24, 2022
@schmikei schmikei added the kokoro:force-run Forces kokoro to run integration tests on a CL label Aug 24, 2022
@stackdriver-instrumentation-release stackdriver-instrumentation-release removed the kokoro:force-run Forces kokoro to run integration tests on a CL label Aug 24, 2022
@schmikei schmikei added the kokoro:force-run Forces kokoro to run integration tests on a CL label Aug 24, 2022
@stackdriver-instrumentation-release stackdriver-instrumentation-release removed the kokoro:force-run Forces kokoro to run integration tests on a CL label Aug 24, 2022
@schmikei schmikei added the kokoro:force-run Forces kokoro to run integration tests on a CL label Aug 24, 2022
@stackdriver-instrumentation-release stackdriver-instrumentation-release removed the kokoro:force-run Forces kokoro to run integration tests on a CL label Aug 24, 2022
@schmikei schmikei added the kokoro:force-run Forces kokoro to run integration tests on a CL label Aug 24, 2022
@stackdriver-instrumentation-release stackdriver-instrumentation-release removed the kokoro:force-run Forces kokoro to run integration tests on a CL label Aug 24, 2022
@schmikei schmikei added the kokoro:force-run Forces kokoro to run integration tests on a CL label Aug 24, 2022
@stackdriver-instrumentation-release stackdriver-instrumentation-release removed the kokoro:force-run Forces kokoro to run integration tests on a CL label Aug 24, 2022
@schmikei schmikei added the kokoro:force-run Forces kokoro to run integration tests on a CL label Aug 24, 2022
@schmikei schmikei added the kokoro:force-run Forces kokoro to run integration tests on a CL label Sep 9, 2022
@stackdriver-instrumentation-release stackdriver-instrumentation-release removed the kokoro:force-run Forces kokoro to run integration tests on a CL label Sep 9, 2022
@schmikei schmikei added the kokoro:force-run Forces kokoro to run integration tests on a CL label Sep 9, 2022
@stackdriver-instrumentation-release stackdriver-instrumentation-release removed the kokoro:force-run Forces kokoro to run integration tests on a CL label Sep 9, 2022
@schmikei schmikei added the kokoro:force-run Forces kokoro to run integration tests on a CL label Sep 9, 2022
@stackdriver-instrumentation-release stackdriver-instrumentation-release removed the kokoro:force-run Forces kokoro to run integration tests on a CL label Sep 9, 2022
Copy link
Contributor

@qingling128 qingling128 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Compared the implementation with the scope doc. There are a few discrepancies that are not unclear whether they are intentional or by accident. We can discuss them case by case. See detailed comments.

The main concern is:

  • Are the newly added labels gonna cause granularity / scalability burden that is worth revisiting.
  • If there were some proposals to change what metrics should look like, the suggestion should be recorded in the scope doc with reasoning.

kind: GAUGE
- kind: CUMULATIVE
monitored_resource: gce_instance
type: workload.googleapis.com/postgresql.bgwriter.maxwritten
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The scope doc has this as workload.googleapis.com/postgresql.bgwriter.maxwriten.count

Is this an intentional change to the scope doc? If so, can we send a suggested edit to the scope doc and have the approver double check it? If not, can we fix the translation so it matches the scope doc?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Intentional change, due to this open-telemetry/opentelemetry-collector-contrib#13328 (comment)

Will make a suggestion

value_type: INT64
kind: GAUGE
- kind: CUMULATIVE
labels:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For workload.googleapis.com/postgresql.index.scans, the scope doc does not include any labels.

Is this an intentional change to the scope doc? If so, can we send a suggested edit to the scope doc and have the approver double check it? If not, can we fix the translation so it matches the scope doc?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We needed to identify the index with labels for its size. Will make a suggestion to scope doc.

labels:
database: .*
monitored_resource: gce_instance
type: workload.googleapis.com/postgresql.table.count
Copy link
Contributor

@qingling128 qingling128 Sep 9, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The scope doc does not include labels for workload.googleapis.com/postgresql.table.count

Is this an intentional change to the scope doc? If so, can we send a suggested edit to the scope doc and have the approver double check it? If not, can we fix the translation so it matches the scope doc?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Databases give context to the table count. Made a suggestion to the scope doc.

database: .*
table: .*
monitored_resource: gce_instance
type: workload.googleapis.com/postgresql.table.size
Copy link
Contributor

@qingling128 qingling128 Sep 9, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The scope doc include no labels for workload.googleapis.com/postgresql.table.size

Is this an intentional change to the scope doc? If so, can we send a suggested edit to the scope doc and have the approver double check it? If not, can we fix the translation so it matches the scope doc?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It needs these labels to be properly identified per table. Will make a suggestion to the scope doc.

@qingling128
Copy link
Contributor

CC @braydonk for shadowing this PR review.

@schmikei
Copy link
Collaborator Author

* Are the newly added labels gonna cause granularity / scalability burden that is worth revisiting.

I don't believe that the newly added labels should be a large cause of concern. The most nested would be a metric datapoint with a value for
database, table, and index which in most database systems only have less than 5 indexes per table, best practices suggest only indexing columns that are filterable.

* If there were some proposals to change what metrics should look like, the suggestion should be recorded in the scope doc with reasoning.

I submitted a bunch of suggestions based off what I found. Let me know who to ping or if further clarification is needed on them.

@ridwanmsharif ridwanmsharif added the kokoro:force-run Forces kokoro to run integration tests on a CL label Sep 15, 2022
@stackdriver-instrumentation-release stackdriver-instrumentation-release removed the kokoro:force-run Forces kokoro to run integration tests on a CL label Sep 15, 2022
@ridwanmsharif ridwanmsharif added the kokoro:force-run Forces kokoro to run integration tests on a CL label Sep 15, 2022
@ridwanmsharif
Copy link
Contributor

Looks like a flake to me. Re-running to make sure.

@stackdriver-instrumentation-release stackdriver-instrumentation-release removed the kokoro:force-run Forces kokoro to run integration tests on a CL label Sep 15, 2022
@ridwanmsharif
Copy link
Contributor

TestExcludeLogsParseJsonOrder/windows-2012-r2 failed. Looks unrelated so merging this now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants