From 8afcb16d8e91757d4e9aaec098e85b097652211c Mon Sep 17 00:00:00 2001 From: Lovell Fuller Date: Sun, 7 Jan 2018 14:30:25 +0000 Subject: [PATCH] Update performance benchmark results for v0.19.0 --- docs/performance.md | 49 ++++++++++++++++++++++++--------------------- 1 file changed, 26 insertions(+), 23 deletions(-) diff --git a/docs/performance.md b/docs/performance.md index 376d0c5d..c32ba183 100644 --- a/docs/performance.md +++ b/docs/performance.md @@ -2,19 +2,20 @@ ### Test environment -* AWS EC2 eu-central-1 [c4.xlarge](http://aws.amazon.com/ec2/instance-types/#c4) (4x E5-2666 v3 @ 2.90GHz) -* Ubuntu 16.04.1 LTS (HVM, SSD, 20161115, ami-82cf0aed) -* Node.js v6.9.1 +* AWS EC2 eu-west-1 [c5.large](https://aws.amazon.com/ec2/instance-types/c5/) (2x Xeon Platinum 8124M CPU @ 3.00GHz) +* Ubuntu 17.10 (hvm:ebs-ssd, 20180102, ami-0741d47e) +* Node.js v8.9.4 ### The contenders -* [jimp](https://www.npmjs.com/package/jimp) v0.2.27 - Image processing in pure JavaScript. Bilinear interpolation only. -* [lwip](https://www.npmjs.com/package/lwip) v0.0.9 - Wrapper around CImg. Compiles outdated, insecure dependencies from source. -* [mapnik](https://www.npmjs.org/package/mapnik) v3.5.14 - Whilst primarily a map renderer, Mapnik contains bitmap image utilities. +* [jimp](https://www.npmjs.com/package/jimp) v0.2.28 - Image processing in pure JavaScript. Bilinear interpolation only. +* [pajk-lwip](https://www.npmjs.com/package/pajk-lwip) v0.2.0 (fork) - Wrapper around CImg that compiles dependencies from source. +* [mapnik](https://www.npmjs.org/package/mapnik) v3.6.2 - Whilst primarily a map renderer, Mapnik contains bitmap image utilities. * [imagemagick-native](https://www.npmjs.com/package/imagemagick-native) v1.9.3 - Wrapper around libmagick++, supports Buffers only. * [imagemagick](https://www.npmjs.com/package/imagemagick) v0.1.3 - Supports filesystem only and "*has been unmaintained for a long time*". -* [gm](https://www.npmjs.com/package/gm) v1.23.0 - Fully featured wrapper around GraphicsMagick's `gm` command line utility. -* sharp v0.17.0 / libvips v8.4.2 - Caching within libvips disabled to ensure a fair comparison. +* [gm](https://www.npmjs.com/package/gm) v1.23.1 - Fully featured wrapper around GraphicsMagick's `gm` command line utility. +* [images](https://www.npmjs.com/package/images) v3.0.1 - Compiles dependencies from source. Provides bicubic interpolation. +* sharp v0.19.0 / libvips v8.6.1 - Caching within libvips disabled to ensure a fair comparison. ### The task @@ -26,18 +27,19 @@ then compress to JPEG at a "quality" setting of 80. | Module | Input | Output | Ops/sec | Speed-up | | :----------------- | :----- | :----- | ------: | -------: | -| jimp (bilinear) | buffer | buffer | 1.06 | 1.0 | -| lwip | buffer | buffer | 1.87 | 1.8 | -| mapnik | buffer | buffer | 2.91 | 2.7 | -| imagemagick-native | buffer | buffer | 4.03 | 3.8 | -| imagemagick | file | file | 7.10 | 6.7 | -| gm | buffer | buffer | 7.08 | 6.7 | -| gm | file | file | 7.10 | 6.7 | -| sharp | stream | stream | 27.61 | 26.0 | -| sharp | file | file | 28.41 | 26.8 | -| sharp | buffer | file | 28.71 | 27.1 | -| sharp | file | buffer | 28.60 | 27.0 | -| sharp | buffer | buffer | 29.08 | 27.4 | +| jimp (bilinear) | buffer | buffer | 1.14 | 1.0 | +| lwip | buffer | buffer | 1.86 | 1.6 | +| mapnik | buffer | buffer | 3.34 | 2.9 | +| imagemagick-native | buffer | buffer | 4.13 | 3.6 | +| gm | buffer | buffer | 4.21 | 3.7 | +| gm | file | file | 4.27 | 3.7 | +| imagemagick | file | file | 4.67 | 4.1 | +| images (bicubic) | file | file | 6.22 | 5.5 | +| sharp | stream | stream | 24.43 | 21.4 | +| sharp | file | file | 25.97 | 22.7 | +| sharp | file | buffer | 26.00 | 22.8 | +| sharp | buffer | file | 26.33 | 23.0 | +| sharp | buffer | buffer | 26.43 | 23.1 | Greater libvips performance can be expected with caching enabled (default) and using 8+ core machines, especially those with larger L1/L2 CPU caches. @@ -46,19 +48,20 @@ The I/O limits of the relevant (de)compression library will generally determine ### Benchmark test prerequisites -Requires both _ImageMagick_ and _GraphicsMagick_: +Requires _ImageMagick_, _GraphicsMagick_ and _Mapnik_: ```sh brew install imagemagick brew install graphicsmagick +brew install mapnik ``` ```sh -sudo apt-get install imagemagick libmagick++-dev graphicsmagick +sudo apt-get install imagemagick libmagick++-dev graphicsmagick mapnik-dev ``` ```sh -sudo yum install ImageMagick-devel ImageMagick-c++-devel GraphicsMagick +sudo yum install ImageMagick-devel ImageMagick-c++-devel GraphicsMagick mapnik-devel ``` ### Running the benchmark test