Fast and Simple Object Serialization to Protocol Buffers

Optimized C++ implementations for reading and writing protocol-buffers. Currently supports 'rexp.proto' for serializing R objects and 'geobuf.proto' for geojson data. This lightweight package is complementary to the much larger 'RProtoBuf' package which provides a full featured toolkit for working with protocol-buffers in R.


and writing protocol-buffers. Currently supports rexp.proto for serializing R objects and geobuf.proto for geojson data. This lightweight package is complementary to the much larger 'RProtoBuf' package which provides a full featured toolkit for working with protocol-buffers in R.

This small package contains optimized C++ implementations for reading and writing protocol-buffers. Currently it supports rexp.proto for serializing R objects and geobuf.proto for geojson data. To extend the package with additional formats, put your .proto file in the src directory. The package configure script will automatically generate the code and header file to include in your C++ bindings.

The protolite package is much faster than RProtoBuf because it binds directly to generated C++ code from the protoc compiler. RProtoBuf on the other hand uses the more flexible but slower reflection-based interface, which parses the descriptors at runtime. With RProtoBuf you can create new protocol buffers of a schema, read in arbitrary .proto files, manipulate fields, and generate / parse .prototext ascii format protocol buffers. For more details have a look at our paper: RProtoBuf: Efficient Cross-Language Data Serialization in R.

# Serialize and unserialize an object
library(protolite)
buf <- serialize_pb(iris)
out <- unserialize_pb(buf)
stopifnot(identical(iris, out))
 
# Fully compatible with RProtoBuf
buf <- RProtoBuf::serialize_pb(iris, NULL)
out <- protolite::unserialize_pb(buf)
stopifnot(identical(iris, out))
 
# Other way around
buf <- protolite::serialize_pb(mtcars, NULL)
out <- RProtoBuf::unserialize_pb(buf)
stopifnot(identical(mtcars, out))
 

Use the countries.geo.json example data:

# Example data
download.file("https://github.com/johan/world.geo.json/raw/master/countries.geo.json",
  "countries.geo.json")
 
# Convert geojson to geobuf
buf <- json2geobuf("countries.geo.json")
writeBin(buf, "countries.buf")
 
# The other way around
geobuf2json(buf) #either in memory
geobuf2json("countries.buf") #or from disk
 
# Read directly from geobuf
mydata <- read_geobuf("countries.buf")

Binary packages for OS-X or Windows can be installed directly from CRAN:

install.packages("protolite")

Installation from source on Linux or OSX requires Google's Protocol Buffers library. On Debian or Ubuntu install libprotobuf-dev and protobuf-compiler:

sudo apt-get install -y libprotobuf-dev protobuf-compiler

On Fedora we need protobuf-devel:

sudo yum install protobuf-devel

On CentOS / RHEL we install protobuf-devel via EPEL:

sudo yum install epel-release
sudo yum install protobuf-devel

On OS-X use protobuf from Homebrew:

brew install protobuf

News

1.5

  • Fix for Solaris
  • Switch to C++11 on Windows

1.4

  • Add support for reading/writing geobuf (binary geojson)

1.3

  • Use new Homebrew URL in configure script
  • Switch to CXX_STD=CXX11 to suppress some warnings

1.2

  • Fix configure script to test if protoc version matches libprotobuf

1.1

  • Cross reference to RProtoBuf pkg in description and readme
  • Add option 'skip_native' in serialize_pb()
  • Fix bug where 'native' objects were stored in 'raw' field

1.0

  • Initial CRAN release

Reference manual

It appears you don't have a PDF plugin for this browser. You can click here to download the reference manual.

install.packages("protolite")

1.6 by Jeroen Ooms, 2 months ago


https://github.com/jeroen/protolite#readme


Report a bug at https://github.com/jeroen/protolite/issues


Browse source code at https://github.com/cran/protolite


Authors: Jeroen Ooms


Documentation:   PDF Manual  


MIT + file LICENSE license


Imports Rcpp, jsonlite

Suggests testthat, RProtoBuf

Linking to Rcpp

System requirements: libprotobuf and protobuf-compiler


Imported by geojson, opencpu.


See at CRAN