feat: Added Ray Compute Engine and Ray Offline Store Support (#5526)

* feat: Added ray to requirements

Signed-off-by: ntkathole <[email protected]>

* feat: Added Ray offline store

Signed-off-by: ntkathole <[email protected]>

* feat: Improved Ray distributed processing

Signed-off-by: ntkathole <[email protected]>

* Fixed tests

Signed-off-by: ntkathole <[email protected]>

* fix: Added utils for validation

Signed-off-by: ntkathole <[email protected]>

* feat: Use Ray Dataset for data processing

Signed-off-by: ntkathole <[email protected]>

* feat: Added Ray Compute Engine

Signed-off-by: ntkathole <[email protected]>

* fix: Fixed logic for source/derived feature views

Signed-off-by: ntkathole <[email protected]>

* fix: Remove redundant source resolution

Signed-off-by: ntkathole <[email protected]>

* fix: Handle comments and removed use_ray_cluster config

Signed-off-by: ntkathole <[email protected]>

---------

Signed-off-by: ntkathole <[email protected]>

Author: ntkathole

Makefile

@@ -302,6 +302,29 @@ test-python-universal-postgres-offline: ## Run Python Postgres integration tests
  				not test_spark" \
  			sdk/python/tests
 
+test-python-universal-ray-offline: ## Run Python Ray offline store integration tests
+	PYTHONPATH='.' \
+		FULL_REPO_CONFIGS_MODULE=sdk.python.feast.infra.offline_stores.contrib.ray_repo_configuration \
+		PYTEST_PLUGINS=sdk.python.feast.infra.offline_stores.contrib.ray_offline_store.tests \
+		python -m pytest -n 8 --integration \
+			-m "not universal_online_stores and not benchmark" \
+			-k "not test_historical_retrieval_with_validation and \
+				not test_universal_cli and \
+				not test_go_feature_server and \
+				not test_feature_logging and \
+				not test_logged_features_validation and \
+				not test_lambda_materialization_consistency and \
+				not gcs_registry and \
+				not s3_registry and \
+				not test_snowflake and \
+				not test_spark" \
+			sdk/python/tests
+
+test-python-ray-compute-engine: ## Run Python Ray compute engine tests
+	PYTHONPATH='.' \
+		python -m pytest -v --integration \
+			sdk/python/tests/integration/compute_engines/ray_compute/
+
 test-python-universal-postgres-online: ## Run Python Postgres integration tests
 	PYTHONPATH='.' \
 		FULL_REPO_CONFIGS_MODULE=sdk.python.feast.infra.online_stores.postgres_online_store.postgres_repo_configuration \

docs/SUMMARY.md

@@ -107,6 +107,7 @@
   * [Trino (contrib)](reference/offline-stores/trino.md)
   * [Azure Synapse + Azure SQL (contrib)](reference/offline-stores/mssql.md)
   * [Clickhouse (contrib)](reference/offline-stores/clickhouse.md)
+  * [Ray (contrib)](reference/offline-stores/ray.md)
   * [Remote Offline](reference/offline-stores/remote-offline-store.md)
 * [Online stores](reference/online-stores/README.md)
   * [Overview](reference/online-stores/overview.md)
@@ -143,6 +144,7 @@
   * [Snowflake](reference/compute-engine/snowflake.md)
   * [AWS Lambda (alpha)](reference/compute-engine/lambda.md)
   * [Spark (contrib)](reference/compute-engine/spark.md)
+  * [Ray (contrib)](reference/compute-engine/ray.md)
 * [Feature repository](reference/feature-repository/README.md)
   * [feature\_store.yaml](reference/feature-repository/feature-store-yaml.md)
   * [.feastignore](reference/feature-repository/feast-ignore.md)

docs/reference/compute-engine/README.md

@@ -57,6 +57,14 @@ An example of built output from FeatureBuilder:
 - Supports point-in-time joins and large-scale materialization
 - Integrates with `SparkOfflineStore` and `SparkMaterializationJob`
 
+### ⚡ RayComputeEngine (contrib)
+
+- Distributed DAG execution via Ray
+- Intelligent join strategies (broadcast vs distributed)
+- Automatic resource management and optimization
+- Integrates with `RayOfflineStore` and `RayMaterializationJob`
+- See [Ray Compute Engine documentation](ray.md) for details
+
 ### 🧪 LocalComputeEngine
 
 {% page-ref page="local.md" %}