SingleStore DB

ERROR 1970 (HY000): Subprocess /var/lib/memsql/master-3306/extractors/kafka-extract –get-offsets –kafka-version=0.8.2.2 timed out

Issue

This error occurs when there are connectivity issues between a SingleStore DB node and the data source (e.g. Kafka cluster or S3). This error is particularly common when using S3 pipelines because of throttling and other S3 behavior.

Solution

To solve this issue, edit the value of pipelines_extractor_get_offsets_timeout_ms. The default value is 10000. Increase this value to eliminate the timeout error. See Pipelines Variables for more information on this timeout variable and how to set it.