Kafka to Blob

The technical documentation of the kafka-to-blob microservice, which stores raw images from Kafka to a blob storage.
This microservice is still in development and is not considered stable for production use

How it works

Kubernetes resources

  • Deployment: united-manufacturing-hub-kafkatoblob
  • Secret: united-manufacturing-hub-kafkatoblob-secrets


Environment variables

Environment variables
Variable nameDescriptionTypeAllowed valuesDefault
BUCKET_NAMEThe name of the bucket to store the images instringAnyumh
DEBUG_ENABLE_FGTRACEEnables the use of the fgtrace library. Not reccomended for productionstringtrue, falsefalse
KAFKA_BASE_TOPICThe base topic for KafkastringAnyia
KAFKA_BOOTSTRAP_SERVERURL of the Kafka broker used, port is requiredstringAnyunited-manufacturing-hub-kafka:9092
KAFKA_LISTEN_TOPICThe topic to listen to for new images. It can be a regular expressionstringAny^ia\\..+\\.rawImage
KAFKA_SSL_KEY_PASSWORDKey password to decode the SSL private keystringAny""
KAKFA_USE_SSLEnables the use of SSL for the kafka connectionstringtrue, falsefalse
MICROSERVICE_NAMEName of the microservice (used for tracing)stringAnyunited-manufacturing-hub-kafkastatedetector
MINIO_ACCESS_KEYAccess key for the MinIO serverstringAny""
MINIO_SECRET_KEYSecret key for the MinIO serverstringAny""
MINIO_SECUREWhether to use TLS for the MinIO connectionstringtrue, falsetrue
MINIO_URLURL of the MinIO serverstringAnyumhminio-hl.united-manufacturing-hub.svc.cluster.local:9000
SERIAL_NUMBERSerial number of the cluster. Used for tracingstringAnydefalut
SSL_CERT_FILEPath to the SSL certificate filestringAny/certs/kubernetes-ca.pem