broker

ActiveMQ：Communications link failure问题以及解决办法

由 荒凉一梦 提交于 2021-02-01 11:21:44
ActiveMQ版本：5.5.1 MQ 所使用的 MySQL 是 InnoDB存储引擎 记录人：@郑昀 现象： 业务表面现象：无。系统现象：无。 日志信息：业务系统发送 MQ 消息时，下面这种错误日志断断续续地一直都有： com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure The last packet successfully received from the server was 60,001 milliseconds ago. The last packet sent successfully to the server was 0 milliseconds ago. 原因： ActiveMQ 持久化方案我们选的是 MySQL 。 MySQL 的全局变量 wait_timeout 默认是28800，单位是秒，即8小时。 运维部早先在测试 ActiveMQ 5.5 主从方案时，发现当 Master 宕机后，锁（数据库里的一个排他锁）有可能没有释放，导致 Slave 无法成为 Master（ 这是 ActiveMQ 5.5 的 BUG ，已在 5.6.0和5.7.0 修复）。 所以运维部将 wait_timeout 参数调短为了 60秒 ，希望能加速锁释放。

Unwanted validation rule being applied on password reset

由 China☆狼群 提交于 2021-01-29 20:46:09
问题 I'm trying to use the password reset ability of Laravel's authentication. After running make:auth command, inside my ResetPasswordController, I have overridden rules function of Illuminate\Foundation\Auth\ResetsPasswords trait as the following: protected function rules() { return [ 'token' => 'required', 'email' => 'required|email', 'password' => 'required|confirmed|min:4', ]; } So, I am trying to change the minimum length value to 4. But when I try to reset my password, a rule of minimum of

Pact for MessageQueue's : Sample Provider test in case of MessageQueues

由 只愿长相守 提交于 2020-07-18 08:00:30
问题 I have written sample Pact test for MessageProvider by referring to sample example given in pact repo. Following is the consumer test which is generating the PACT json file for the message expected from Provider. In case of API, to verify the PACT, I was able to do this using "pact-jvm-provider-maven" plugin. In this case the PACT is verified against the actual hosted API service of Provider. My Question is, how in case of MessageQueue, PACT will be verified? Will a mock Queue gets created?

WebSphere Message Broker - how to send a PCF message

由 偶尔善良 提交于 2020-01-29 19:02:27
问题 We need to issue some MQ commands from a MB flow. The way to go is to send a PCF command, but I dont know how to create it. Any pointers ? Sebastian. 回答1: To issue commands to an MQ Queue Manager via PCF messages you can look at the examples in /opt/mqm/samp/pcf/samples on *nix or where ever you have installed MQ. (On Windows try "C:\Program Files (x86)\IBM\WebSphere MQ\tools\pcf\samples"). To issue the commands 'from' broker you can use a Java compute node and use methods in the supplied

Integrating Security to Kafka 1.0 with SSL Enabled

由 余生长醉 提交于 2020-01-14 03:34:08
问题 I am unable to integrate security to Kafka 1.0 with ssl enabled. Here are changes to my server.properties security.inter.broker.protocol=SSL listeners=PLAINTEXT://localhost:9092,SSL://localhost:9094 Here is my advertised listeners advertised.listeners=PLAINTEXT://EXTERNAL_IP:9092,SSL://EXTERNAL_IP:9094 ssl.keystore.location=/var/private/ssl/server.keystore.jks ssl.keystore.password=PASSWORD ssl.key.password=PASSWORD ssl.truststore.location=/var/private/ssl/server.truststore.jks ssl.truststore

Mosquitto 1.4.2 Websocket support

由 Deadly 提交于 2020-01-11 06:49:08
问题 I'm trying to utilize Mosquittos recent update to support websockets in the broker. I'm running Mosquitto v1.4.2 and I've added the following lines to the mosquitto configuration file (mosquitto.conf): listener 10001 127.0.0.1 protocol websockets listener 1883 protocol mqtt When I try and start the broker with the new configuration I get the following : $ mosquitto -c /etc/mosquitto/mosquitto.conf Error: Websockets support not available. Error found at /etc/mosquitto/mosquitto.conf:16. Error:

handling broker down in kafka

由 旧时模样 提交于 2020-01-03 02:48:06
问题 I'am using kafka producer in async mode but when all brokers are down it acts like sync and it waits until metadata.fetch.timeout.ms expires which is 60 sec for my case. My first question, is this is a normal behaviour or am i doing something wrong? Since transactions in my logic should finish in maximum 100 ms, this timeout value is a really big delay for me. Perhaps setting metadata.fetch.timeout.ms to 10 ms may solve my problem but i am not sure how this effect my system. Does this cause a

Kafka Cluster - Producer

由 坚强是说给别人听的谎言 提交于 2019-12-25 18:02:07
问题 I have several questions about Kafka. If someone can help me by responding to one of them, i will be very thankful. Thank you in advance :) Q1) I know that partitions are split across Kafka Broker. But the split is based on what ?. For instance, if I have 3 brokers and 6 partitions, how to ensure that each broker will have 2 partitions ? How this split is currently made in Kafka ? Q2) When a producer send a new message, what id the default format of the message ? Avro format ? How can I

WARNING as java.io.EOFException when ActiveMQ starts

由 独自空忆成欢 提交于 2019-12-18 07:38:09
问题 am trying to start the ActiveMQ 5.11 and I see a WARNING as below: WARN | Transport Connection to: tcp://127.0.0.1:40890 failed: java.io.EOFException My activemq.xml is as below: <transportConnectors> <transportConnector name="openwire" uri="tcp://0.0.0.0:${JMS_PORT}" /> <transportConnector name="stomp" uri="stomp://0.0.0.0:${JMS_STOMP_PORT}"/> <transportConnector name="ssl" uri="ssl://0.0.0.0:${JMS_SSL_PORT}"/> </transportConnectors> <sslContext> <sslContext keyStore="file:${JMS_KEY_STORE}"

How to reduce disk space occupied by a partition?

由 混江龙づ霸主 提交于 2019-12-11 16:54:05
问题 In my specific use-case, we are going to ingest 1000GB of data everyday. If I compress the files locally then it comes about 100GB. I wrote a sample application to stream 100MB file (which converts to 10MB after compression). Single producer, single topic with single partition. I have use transactions and enabled compression (gzip). I ran command to find out the total size of the partition and it came about 85MB. As Kafka, might be adding some data; in order to guarantee exactly-once
订阅 broker