Dirk Eddelbuettel: RcppSimdJson 0.1.16 on CRAN: Much Faster Again!
A brand new release 0.1.16 of the RcppSimdJson
package is now on CRAN, has
been built for r2u,
and is updated on r-universe.
RcppSimdJson
wraps the fantastic and genuinely impressive simdjson library by Daniel Lemire and collaborators. Via
very clever algorithmic engineering to obtain largely branch-free code,
coupled with modern C++ and newer compiler instructions, it results in
parsing gigabytes of JSON parsed per second which is quite
mindboggling. The best-case performance is faster than CPU speed as
use of parallel SIMD instructions and careful branch avoidance can lead
to less than one cpu cycle per byte parsed; see the video of the talk by Daniel Lemire
at QCon.
This version updates to the recent 5.0.2 upstream release with
improved performance. Given the strong focus on performance, this
release also alters some of the R and C++ interfaces to be more direct.
Rcpp generally aims for a balance between readable / maintainable code
and good performance; this moves the dial closer to strong performance
gains. As Daniel noted in a table in
the (main) PR for this release, this now consistently beats yyjsonr, and
improves considerably over the previous release of this package. I had
made some smaller interim upgrades earlier (without a CRAN releases),
and made a number of minor standard packaging updates.
The short NEWS entry for this release follows.
Courtesy of my CRANberries, there is also a diffstat report for this release. For questions, suggestions, or issues please use the issue tracker at the GitHub repo.Changes in version 0.1.16 (2026-10-09)
- simdjson was upgraded to versions 4.6.1 and 4.6.3 (Dirk in #100 and #102 fixing #99 and #101)
- simdjson was upgraded to version 5.0.2 (Daniel in #104)
- A number of small tweaks to the Rcpp interface were made too (Daniel in #104)
- Diagnostics for
gccandclangare not suppressed per CRAN Policy (Dirk in #106 closing #105)- The continuous integration matrix was extended to
g++version 15 and 16 (Dirk in #108 closing #107)- A few minor packaging nags were address (Dirk in #109)
This post by Dirk Eddelbuettel originated on his Thinking inside the box blog. If you like this or other open-source work I do, you can now sponsor me at GitHub.
My Debian contributions this month were all
A few days ago, a colleague reached out to me, asking if I could help draft a
resolution on digital autonomy and free software for the upcoming renewal of
our collective bargaining agreement. Although she's very politicised and
generally a great individual, she is not a techie and we never really talked
about these issues before.
This took me by surprise. I should have been rejoicing; no, I should have been
the one who brought up this topic in our union. Wasn't I the technical expert
on these issues? But alas, my first reaction when she came to me was to snicker
and tell myself: "That's cute, but nothing's ever gonna change, Big Tech is too
strong and our governments don't give a damn."
How sad and cynical is that? That's not the person I want to be.
Something in the Quebecois political landscape has shifted in the last few
years with regards to tech. More and more "regular" people seem to be talking
about the importance of digital autonomy, how government services shouldn't
rely on Big Tech and how we should be using FOSS on hardware we actually
control.
A few years ago, I would have been at the vanguard of this change. I would have
been part of the creation of
Japanese input method editors (IMEs) such as Mozc are essential for typing
Japanese (yes, skk, anthy and more, but it's out-of-scope in this article). Testing them is a surprisingly fiddly job: an IME behaves differently
depending on the desktop environment (GNOME, KDE, Xfce, Budgie), the input
framework (ibus, fcitx5, uim), and the Wayland or X11 session. Setting up a
fresh VM for every combination from scratch is slow and repetitive, and
breaking your host's environment while experimenting is no fun.
Each release of Debian has a shiny new theme which is visible on the installer,
the boot screen, the login screen and, most prominently, on the desktop
wallpaper. It's a very important part of a Debian release as it is usually the
first thing new users see when installing or booting the system for the first
time. Not only that, but also the first thing appearing when debianites share
their screen or connect to an external device when giving talks around the
world.
As the most enthusiastic users will know, the forky - yes, that is the name of
the next stable version, Debian 14 - release cycle is rapidly approaching its
latter stages. This means we need to select the artwork shipping with forky
soon, really soon!
And as with everything else in Debian, collecting artwork is a collaborative
effort which Debian shares with its community. So, if you would like (or know
someone who would like) to create a desktop look and feel that will be seen by
trillions of people around the world - and in space! - be sure to send in your
artwork ASAP!
The deadline for submissions is: 2026-11-26.
For the most up to date details please refer to the