Skip to content

Add Kuberay Support for Ray Offline Store and Compute engine #5633

@ntkathole

Description

@ntkathole

Describe the solution you'd like

Enable seamless integration with Kubernetes-managed Ray clusters through the CodeFlare SDK. This enhancement is for Feast users running on Kubernetes and wants to use Kuberay.

Currently, Feast's Ray integration supports:

  • Local Ray clusters
  • Remote Ray clusters (via ray_address)

We need to add support for Kubernetes-managed Ray clusters (KubeRay):

  • Authenticate with CodeFlare SDK using token
  • Generate TLS certificates for cluster access
  • Connect to KubeRay cluster via cluster.cluster_uri()
  • Initialize Ray with runtime environment

Example:

offline_store:
  type: ray
  use_kuberay: true
  kuberay_conf:
    cluster_name: "ray-cluster"
    namespace: "ray-system"

batch_engine:
  type: ray.engine
  use_kuberay: true
  kuberay_conf:
    cluster_name: "ray-cluster"
    namespace: "ray-system"

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions