Exposing neo4j bolt port on Kubernetes cluster

[sirhc_page]

Hi,

I've installed neo4j after playing with it in Sandbox onto my Kubernetes cluster using the official stable/neo4j helm chart.

I would like to make this neo4j cluster accessible remotely (not just within the Kubernetes cluster) so I've written a service to expose the bolt port. The cluster has one LEADER & two FOLLOWER role servers, which is great for redundancy. However, when I try and access my service, it's a gamble as to whether I'll be served a LEADER or a FOLLOWER.

If I'm connected to a follower and I attempt a write, I get -

Neo.ClientError.Cluster.NotALeader: No write operations are allowed directly on this database. Writes must pass through the leader. The role of this server is: FOLLOWER

Here is my service -

apiVersion: v1
kind: Service
metadata:
  name: pool1-neo4j-nodeport
  namespace: neo4j
spec:
  type: NodePort
  ports:
  - port: 7687
    nodePort: 30725
    protocol: TCP
  selector:
    app: neo4j
    component: core
    release: pool1

Am I missing something, is there something specific I need to do? I've also raised an issue on the Helm package.

Thanks!

[david_allen · Accepted solution]

EDIT -- I'm editing this comment in May 2020. A specific example is available on how to do this, you can read all about it here.

My older response below:

This topic is covered in this article, under the subheading, "Looking at Neo4j from Outside of Kubernetes"

Medium – 29 Jun 20

Neo4j Considerations in Orchestration Environments

Considerations for running Neo4j on Kubernetes and other Orchestration managers

Reading time: 7 min read

Additionally, "Querying Neo4j Clusters" will describe how all of this works, and why you're running into trouble. I recommend reading both -- they cover what's going on in your scenario, why it doesn't work, and also suggest possible approaches.

Medium – 8 Mar 19

Querying Neo4j Clusters

How Neo4j clusters and smart query routing work!

Reading time: 8 min read

[sirhc_page]

Thank you! I'll have a read!

[gerwin_van_de_s]

Suggestions are great, but they're not practical solutions without examples. These are problems generally only of interest to people "who need to make it work right now". They don't have the time to try to figure it out for themselves and spend a few days or weeks to change configurations. Actually answering the question of "how to make it go" in a typical 3 node cluster running on kubernetes would be good. (I've got < 12 hours to solve this problem before it has to be live, and there's a powerful need to sleep that has to share that 12 hours). The only allowable access is via either an Ingress route or via a Load Balancer, the application that needs to connect can only get there via a LoadBalancer since it needs to route traffic over the Internet and the the cluster nodes do not have public IPs on them which makes the NodePort approach unsuitable (even if only vaguely described without any practical information).

Another alternative would be to develop and make available a bolt connection proxy that just deals with the internal/external DNS naming problems.