Kanban
All in-progress work for Wikidata Analytics.
Team
Task Requests
Please use the Wikidata Analytics request form to create tasks for the team. Thank you!
Change #1097281 abandoned by Brouberol:
[operations/puppet@production] airflow-wmde: stop managing the airflow instance via puppet
Reason:
Superseded by https://gerrit.wikimedia.org/r/c/operations/puppet/+/1097308
Change #1097409 merged by Brouberol:
[operations/deployment-charts@master] airflow-wmde: enable traffic to the airflow-search instance
Change #1097409 had a related patch set uploaded (by Brouberol; author: Brouberol):
[operations/deployment-charts@master] airflow-wmde: enable traffic to the airflow-search instance
Change #1097376 merged by Brouberol:
[operations/deployment-charts@master] airflow-wmde: fix instance name
Change #1097376 had a related patch set uploaded (by Brouberol; author: Brouberol):
[operations/deployment-charts@master] airflow-wmde: fix instance name
Just connecting some dots:
Change #1097280 merged by Brouberol:
[operations/deployment-charts@master] airflow-wmde: migrate scheduler to Kubernetes
Adding this to the Wikidata Analytics kanban so the work that I'll do to check the WMDE Airflow instance is recorded :) Thanks for all the efforts here, @brouberol!
I wonder - is there a relatively easy way to know what kinds of queries are run the most? without having a hypothesis?
Thanks @Ifrahkhanyaree_WMDE and @karapayneWMDE.
Ah got it, thank you. I think this task with it's scope is finished, I'd have to think about what other analyses we need in order to understand whether moving these out would make an impact.
This is @Ifeatu_Nnaobi_WMDE's ticket so handing over to her
@Ifrahkhanyaree_WMDE , could you answer these questions:
Hello hello! I'd assume that there is a bit less than 7% and the process of finding other non-inverse values and bind queries to remove as not actually inverse statements is proving to be difficult right now, but can be looked into further. All of these values and bind queries would come up as inverse statements at first, and I'm assuming that we've removed a good amount by removing the single statement ones, but I'm not sure on those that are more than one statement. Can of course look into it if need be :)
Thanks so much for this @AndrewTavis_WMDE! Since this is a little out of my zone of expertise, I need some more clarification
Hey @Ifrahkhanyaree_WMDE 👋 Result here is 7.47% of queries for 90 days from 2024/08/24 with the notebook for the work being T377704_wd_inverse_statement_queries.ipynb.
Goal is to have this done by EOD tomorrow, @Ifrahkhanyaree_WMDE :) As of now no further explanations are needed, but I'll send along something by tomorrow morning if something comes up.
@AndrewTavis_WMDE would you happen to have an update on how this is going? thank youu!
This is great, thanks so much :)
Data report has been updated with the numbers for October and I just checked and the user agents table has also been updated with those from October :)
Hey @So9q 👋 "Text" was a typo - these are "talk" page users :) And I've noted your point that casual could be <5 in the notes that I have in defining these for WMDE. I have a meeting with Product on our end to discuss this Wednesday, with finalized versions of the metrics we'll focus on coming early next year.