Is there a performance profile for buildbot UI #5769
-
|
We want to launch 1000s of builds per day, mostly as PR verification and MRs , wanted to ask if there is any performance profiling done on buildbot hosted UI in terms of scalability and large traffic ? |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments 5 replies
-
|
Hello, You can use https://github.com/tardyp/buildbot_profiler in order to look at buildbot performance issue. If you are planning to build a performance critical bot, we recommand:
If you do that, you should be fine and scale thousands of build a day. |
Beta Was this translation helpful? Give feedback.
-
|
Tardyp, What is the benefit of the multi-master in this case? I ask because we do many hundreds of builds a day and while postgres has been an improvement we needed, I have not really noticed the need for the multi-master. What symptoms am I ignoring? |
Beta Was this translation helpful? Give feedback.
-
|
Python is effectively single threaded due to the global interpreter lock and thus only a total of 1 CPU core worth of computations can happen in Python code. In single master case web backend is run in the same process as the build handling and everything else, so each web user reduces the amount of CPU bandwidth available to the rest of the master. If there are many web users this becomes a problem. |
Beta Was this translation helpful? Give feedback.
-
|
hi @tardyp! |
Beta Was this translation helpful? Give feedback.
-
|
|
Beta Was this translation helpful? Give feedback.
-
|
sry, my bad: a |
Beta Was this translation helpful? Give feedback.
-
|
Not sure if this information is still useful to you, but Buildbot easily handles thousands of builds per day and large numbers of historical builds. The web backend can be split off to multiple servers and thus can handle even large amount of user traffic. |
Beta Was this translation helpful? Give feedback.
Hello,
You can use https://github.com/tardyp/buildbot_profiler in order to look at buildbot performance issue.
If you are planning to build a performance critical bot, we recommand:
If you do that, you should be fine and scale thousands of build a day.