Makes sense. While end to end benchmarks may be too much to run per commit, I think they do make sense to run per release. I agree that comparing frameworks does not really help, I think it makes more sense to compare versions of the same framework to see how performance evolves.
Are you guys planning to build a suite of tests that I could re-use to run these performance test cases? I am currently using DBMonster, but a good, canonical set of test cases that React cares about would be something I could run these tests on, and watch the performance.
I also think these end to end tests could help validate design decisions though.
- Tests showed that most of the time in React is spent in the event loop rather than paints. That would actually mean that doing some of this work in a Web worker would make things faster.