Skip to content

Conversation

@ccschmitz
Copy link
Contributor

@ccschmitz ccschmitz commented Aug 7, 2023

Summary

Re-enables writing traces to Clickhouse and fixes a bug where we were duplicating traces.

How did you test this change?

Unit test - see the new assertion on len(tracesMessage.PushTraces.TraceRows).

Are there any deployment considerations?

Will monitor Clickhouse metrics once this rolls out.

@ccschmitz ccschmitz requested a review from mayberryzane August 7, 2023 18:48
@ccschmitz ccschmitz marked this pull request as ready for review August 7, 2023 18:49
@ccschmitz
Copy link
Contributor Author

@mayberryzane let me know if you think we should move to async writes now or if that's something we should consider in a follow up.

@mayberryzane
Copy link
Contributor

@mayberryzane let me know if you think we should move to async writes now or if that's something we should consider in a follow up.

It's probably worth doing now since we were getting too many parts errors intermittently for logs even when load was low.
I did it in this PR: https://github.com/highlight/highlight/pull/6239/files, using go-sqlbuilder to create an insert statement and then calling Exec with the async_insert and wait_for_async_insert settings

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Fix duplicate traces

4 participants