Cloudera Streams Messaging - Surveyor

Introducing Cloudera Streams Messaging Surveyor

Recently released CSM 1.6 brings Surveyor, Iceberg Connector, and Schema Registry. In my previous blog post Schema Registry, I expose the steps to get to the UI. Now let’s do the same with Surveyor.

First, skip the “hard install” docs, and work with the basic evaluation docs. We just want to evaluate that the operator works and that we can get to and see the Surveyor UI.

Pro Tip! It is important to have a basic working install confidence. Without you will quickly be blocked. With confidence you can solve the difficulties you will encounter while installing these services in existing or alternative kubernetes platforms.

We will need the following contents for values.yaml:

clusterConfigs:
  clusters:
    - clusterName: my-cluster
      tags:
        - csm1.6
      bootstrapServers: my-cluster-kafka-bootstrap.csm-operator.svc:9092
      adminOperationTimeout: PT1M
      authorization:
        enabled: false
      commonClientConfig:
        security.protocol: PLAINTEXT
surveyorConfig:
  surveyor:
    authentication:
      enabled: false
tlsConfigs:
  enabled: false

Check out these two methods for getting your bootstrap servers:

kubectl get kafka my-cluster -n csm-operator -o jsonpath='{.status.listeners[?(@.name=="plain")].bootstrapServers}'

minikube service my-cluster-kafka-bootstrap --url -n csm-operator

Last but not least, while working with Schema Registry I learned how to use the minikube service command:

minikube service cloudera-surveyor-service --namespace csm-operator

which swiftly moved me from terminal to the UI:

Also take a look at my full minikube cluster:

Note: Check out my full command stream for the session above:

Watch out! Be careful with upstream documentation copy paste code boxes with \\ and return lines they will often times mess you up.

minikube service my-cluster-kafka-external-bootstrap --url -n csm-operator
kubectl get kafka my-cluster -n csm-operator -o jsonpath='{.status.listeners[?(@.name=="plain")].bootstrapServers}'
minikube service my-cluster-kafka-bootstrap --url -n csm-operator
nano values.yaml
helm uninstall cloudera-surveyor --namespace csm-operator
helm install cloudera-surveyor \\
  --namespace csm-operator \\
  --values values.yaml \\
  --set 'image.imagePullSecrets=docker-pull-secret' \\
  --set-file clouderaLicense.fileContent=./license.txt \\
  oci://container.repository.cloudera.com/cloudera-helm/csm-operator/surveyor \\
  --version 1.6.0-b99\
kubectl get deployments --namespace csm-operator
kubectl get pods --namespace csm-operator
minikube service cloudera-surveyor-service --namespace csm-operator
k9s
helm uninstall cloudera-surveyor --namespace csm-operator

As always, check out the entire DOCS for the CSM Operator.

If you would like a deeper dive, hands on experience, demos, or are interested in speaking with me further about Cloudera Streams Messaging Operator please reach out to schedule a discussion.