protocol-buffers

We have an Android app that uses Protocol Buffers to store application data. The data format (roughly) is a single protobuf ("container") that contains a list of protobufs ("items") as a repeated field: message Container { repeated Item item = 1; } When we want to save a change to an item, we must recreate the protobuf container, add all the items to it, then serialize it and write it to a file. The problem with this a approach is it potentially triples the memory used when saving because the data has to first be copied from the model class to the protobuf builder and then to a byte array when

I would like to send simple TCP message to a device (Karotz) from NodeJS Script on Windows. NodeJS correctly installed an working TCP connection working Here is my .proto file (http://wiki.karotz.com/index.php/Voos-message.proto) I compile it to .desc using google's protoc I don't know how to build my message to send it to the device ? I read Google Description And protobuff_for_node and other fork But I don't understand how to install it on windows. Seems complicated because of native librarie. Is there dead simple javascript librarie that read the .desc Schema and build the message ? Without

I have very little knowledge of pig. I have protobuf format data file. I need to load this file into a pig script. I need to write a LoadFunc UDF to load it. say function is Protobufloader() . my PIG script would be A = LOAD 'abc_protobuf.dat' USING Protobufloader() as (name, phonenumber, email); All i wish to know is How do i get the file input stream. Once i get hold of file input stream, i can parse the data from protobuf format to PIG tuple format. PS: thanks in advance Twitter's open source library elephant bird has many such loaders: https://github.com/kevinweil/elephant-bird You can use

Lets say I want to do non blocking reads from a network socket. I can async await for the socket to read x bytes and all is fine. But how do I combine this with deserialization via protobuf? Reading objects from a stream must be blocking? that is, if the stream contains too little data for the parser, then there has to be some blocking going on behind the scenes so that the reader can fetch all the bytes it needs. I guess I can use lengthprefix delimiters and read the first bytes and then figure out how many bytes I have to fetch minimum before I parse, is this the right way to go about it? e

I have code that currently passes around a lot of (sometimes nested) C (or C++ Plain Old Data) structs and arrays. I would like to convert these to/from google protobufs. I could manually write code that converts between these two formats, but it would be less error prone to auto-generate such code. What is the best way to do this? (This would be easy in a language with enough introspection to iterate over the names of member variables, but this is C++ code we're talking about) One thing I'm considering is writing python code that parses the C structs and then spits out a .proto file, along

I currently have a file called addressbook.proto in next to my protoc.exe. I am having difficulty generating the .h and the .cc file. Here is what I am doing protoc --cpp_out=c:\addressbook.proto However I get the following response Missing input file. Any suggestions on what I might be doing wrong ? The -cpp_out tag specifies the output directory for generated c source code. I would suggest trying (if proto is actually stored under the c: directory c:\addressbook.proto) protoc c:\addressbook.proto --cpp_out=./ or protoc addressbook.proto --cpp_out=./ 来源： https://stackoverflow.com/questions