google-cloud-pubsub

My test pipeline is really simple. It attempts to read from a topic created via the console. public static void main(String[] args) throws IOException { Options options = PipelineOptionsFactory.fromArgs(args). withValidation().as(Options.class); options.setStreaming(true); Pipeline pipeline = Pipeline.create(options); PCollection<String> input = pipeline .apply(PubsubIO.Read.topic(options.getPubsubTopic())) .apply(ParDo.of(new ExtractEvents())); pipeline.run(); } When I attempt to execute this pipeline I get the following error: Workflow failed. Causes: (de5f777e2e08c1d9): Step setup_resource

I would like to perform an action once all the messages from a pubsub topic have been acknowledged. I tried using Stackdriver monitoring API for the metric "Number of unacknowledged messages broken down by a cloud region" but did not understand the filter for region and why it is required. Where can I see what region my topics use? And for some unknown reason, for some of the topics, the API call fails for no reason at all. What is the best way of knowing if all messages have been acknowledged or not. A Cloud Pub/Sub Topic has no concept of an unacknowledged message. This is purely a property

This question is a follow up to Unable to configure Google Cloud Pub/Sub push subscriber As per the answer, self-signed certificates are not supported when using a push subscriber. Are certificates generated via letsencrypt client supported ? Is it recommended to use letsencrypt ? Yes. Sorry it took a long time, but I have verified that letsencrypt certs are working fine for this purpose. 来源： https://stackoverflow.com/questions/33790132/does-google-cloud-pub-sub-support-letsencrypt-certificates

We use the REST service API to pull messages from a PubSub subscription. Messages ready to be serviced are acknowledged, leaving other messages unacknowledged to be serviced during a later execution cycle. During an execution cycle, we send a single reqeust to the pull service REST API with returnImmediately=true and maxMessages=100 . While testing we encountered a situation when only 3 "old" messages would be returned during each execution cycle. Newly published messages were never included in the request to pull . We verified new messages were successfully arriving at the subscription by

I am using Google IOT core with mongoose os. I wanted to update device connection status to firestore. But i am unable to find event which reports mqtt connection status to pub/sub like when device disconnects or reconnect i.e if device is offline or not. I am stuck on this problem for days.Any help will be appreciated Update As @devunwired mentioned in this response it is now possible to monitor Stackdriver logs for disconnect events. You must have at a minimum enabled INFO level logging on your project in IoT Core > Registries > [your registry] > Edit Registry > Select "Info" log level >

The NODEJS example code for batching pubsub requests looks like this: // Imports the Google Cloud client library const PubSub = require(`@google-cloud/pubsub`); // Creates a client const pubsub = new PubSub(); /** * TODO(developer): Uncomment the following lines to run the sample. */ // const topicName = 'your-topic'; // const data = JSON.stringify({ foo: 'bar' }); // const maxMessages = 10; // const maxWaitTime = 10000; // Publishes the message as a string, e.g. "Hello, world!" or JSON.stringify(someObject) const dataBuffer = Buffer.from(data); pubsub .topic(topicName) .publisher({ batching: