These are chat archives for dropbox/pyston

10th
Oct 2016
Victor Stinner
@haypo
Oct 10 2016 07:44
Hi. I'm working on Python benchmarks. I wrote http://github.com/python/performance - a redesign of the old CPython benchmark suite. I started to add PyPy benchmarks. The new benchmarks should be better isolated, more reliable, more configurable, and produce JSON output, easier to analyze in depth.
Sun
@Daetalus
Oct 10 2016 07:44
:+1:
Victor Stinner
@haypo
Oct 10 2016 07:45
Did you already have the opportunity to take a look at performance? My goal is to use the same benchmark suite for CPython, PyPy, Pyston, Pyjion, etc.
And also to run benchmarks on CPython, PyPy, Pyston, Pyjion, etc. and publish results at http://speed.python.org/
Sun
@Daetalus
Oct 10 2016 07:46
me? no, you should ask @kmod :smile:
Victor Stinner
@haypo
Oct 10 2016 07:46
@Daetalus : "you" means "Pyston" (developers of the Pyston developers, or more generally users of Pyston) in this context ;-)
Sun
@Daetalus
Oct 10 2016 07:47
ah, thanks. Sorry for the misunderstanding...
Victor Stinner
@haypo
Oct 10 2016 07:48
The benchmark suite is designed to be a superset of all benchmarks, almost all benchmarks work on Python 2 and Python 3. Later we will decide which benchmarks are the most representative of Python performance, but it's too early to discuss that
Nathaniel J. Smith
@njsmith
Oct 10 2016 15:40
@haypo: That's really awesome, great work! Are you interested in including benchmarks that rely on third-party extension modules like lxml or numpy?
Nathaniel J. Smith
@njsmith
Oct 10 2016 16:06
(these can have radically different performance profiles under different interpreters because of differences in how the C API is implemented)