Skip to content

Releases: fluid-cloudnative/fluid

v1.0.6

12 Jul 12:11
fd70210
Compare
Choose a tag to compare

New Features

  1. Prefetch Sidecar
    Accelerates model file loading for inference services and improves bandwidth utilization.
  2. JuiceFSRuntime: Fuse Seamless Upgrade
    Automatically cleans up idle pods during Fuse image updates (enabled via cleanPolicy: onFuseChange).
  3. JuiceFSRuntime: Preheating Parameter Customization
    Supports advanced preheating parameters in Dataload (refer to JuiceFS Documentation).
  4. Configurable Fluid Control Plane
    Flexible parameter tuning for components (runtimeWorkers, kubeClient, workQueue, env) based on cluster/business scale.

Enhancements

  1. Security Hardening
    Upgraded Helm to v3.17.3 and base image Alpine to v3.19.1.
  2. ThinRuntime Lightweight Optimization
    Controller performance improved to 35 instances/second.
  3. Reduced Webhook Resource Consumption
    Optimized Fuse mount-check ConfigMap to enable namespace-level sharing.
  4. Lowered DatasetController Load
    Batch API detection optimized to reduce APIServer requests.

Bug Fixes

  1. ThinRuntime Network Config
    Fixed issue where containerNetwork settings did not take effect.
  2. JuiceFSRuntime Unexpected Updates
    Resolved unintended updates during sync operations.

Full Changelog: v1.0.5...v1.0.6

v1.0.5

26 Feb 08:00
1b2dd59
Compare
Choose a tag to compare

New Features

  • Enhanced Binding Efficiency in Kubernetes Clusters
    Optimized ThinRuntimeController’s binding performance for large-scale Dataset deployments, reducing resource scheduling latency in Kubernetes clusters.

  • Integration with Third-Party Storage via HostPath
    Enabled Dataset to mount third-party storage systems (e.g., NFS, Ceph) through node-local HostPath volumes, extending compatibility with heterogeneous data sources.

  • Distributed Fault Tolerance for High Availability
    Isolated single-node FUSE failures from impacting Dataset-wide availability, ensuring cluster-level stability in distributed environments.

  • Extended Support for Long Naming Conventions
    Permitted creation of Datasets with lengthy names and namespaces, avoiding Kubernetes label length constraints (63-character lim
    it).

Bug Fixes

  • Fix log panic when webhook running in development mode

What's Changed

  • build(deps): bump helm/kind-action from 1.11.0 to 1.12.0 by @dependabot in #4462
  • Prepare for v1.0.5 by @cheyang in #4464
  • Update golang v1.22.10 by @cheyang in #4446
  • build(deps): bump golang.org/x/time from 0.8.0 to 0.9.0 by @dependabot in #4465
  • build(deps): bump golang.org/x/net from 0.33.0 to 0.34.0 by @dependabot in #4467
  • Build docker images for golang 1.22 by @cheyang in #4468
  • build(deps): bump github/codeql-action from 3.28.0 to 3.28.1 by @dependabot in #4469
  • bugfix: fix log panic when webhook running in development mode by @TrafalgarZZZ in #4470
  • build(deps): bump github.com/golang/glog from 1.2.3 to 1.2.4 by @dependabot in #4472
  • Feature: support to skip the validation of indirectly related resources involved in webhook mutating by @Syspretor in #4473
  • Build docker images for skipping resource check by @cheyang in #4475
  • Set JindoCache's defaut readahead prefetcher version to "legacy" by @TrafalgarZZZ in #4477
  • enhance: prettify post start script log for sidecar by @TrafalgarZZZ in #4479
  • Enhancement: Unify the implementation of label concatenation and support labels with over limit length by @Syspretor in #4466
  • build(deps): bump github/codeql-action from 3.28.1 to 3.28.5 by @dependabot in #4482
  • Build docker images for enhancing the logging of post start script by @cheyang in #4481
  • build(deps): bump github/codeql-action from 3.28.5 to 3.28.8 by @dependabot in #4484
  • Create initial security self-assessment by @cheyang in #4483
  • Doc: update dingtalk and wechat group QR code to join the group by @Syspretor in #4485
  • Roadmap 2025 by @cheyang in #4487
  • build(deps): bump golang.org/x/time from 0.9.0 to 0.10.0 by @dependabot in #4486
  • build(deps): bump google.golang.org/grpc from 1.68.1 to 1.70.0 by @dependabot in #4480
  • Build docker images for grpc upgrade by @cheyang in #4489
  • fix code static check by @Syspretor in #4495
  • build(deps): bump github/codeql-action from 3.28.8 to 3.28.9 by @dependabot in #4491
  • Support useNodeAuthorization option to enable node authorized client for CSI by @TrafalgarZZZ in #4494
  • build(deps): bump github.com/agiledragon/gomonkey/v2 from 2.12.0 to 2.13.0 by @dependabot in #4497
  • build(deps): bump golang.org/x/net from 0.34.0 to 0.35.0 by @dependabot in #4493
  • build(deps): bump github.com/spf13/cobra from 1.8.1 to 1.9.1 by @dependabot in #4502
  • Enhancement: refactor and unify checkFuseHealth implementation for all runtimes by @Syspretor in #4498
  • support mountPoint on host for thinruntime by @Syspretor in #4492
  • Completion runtime schedule info of runtime fuse status by @Syspretor in #4506
  • Build docker images for enhancing health check by @cheyang in #4507
  • Add comments to UpdateDatasetStatus in pkg/ddc/jindo/dataset.go by @JiGuoDing in #4505
  • improve the runtimeController performance in large-scale scenarios by @Syspretor in #4509
  • docker build for enhancing performance in large scale by @cheyang in #4511

New Contributors

Full Changelog: v1.0.4...v1.0.5

v1.0.4

01 Jan 11:09
4e199c8
Compare
Choose a tag to compare

New Features

  • Added support to configure the maxConcurrentReconciles parameter for the ThinRuntimeController, allowing for improved concurrency management.
  • Introduced support for resource configuration within the Fluid webhook, enabling more precise control over resource allocation.
  • Added support for configuring Burst (default 30) and Qps (default 20) settings for client interactions with the APIServer through the Fluid Webhook, enhancing request handling capabilities.
  • Implemented mountMode configuration to allow skipping the check for mount readiness, streamlining deployment processes.

Bug Fixes

  • Resolved high availability issues in JindoRuntime by implementing pod anti-affinity for the master StatefulSet, improving system resilience.

What's Changed

New Contributors

Full Changelog: v1.0.3...v1.0.4

v1.0.3

30 Oct 13:33
2c1809a
Compare
Choose a tag to compare

New Features

  1. Dynamic mount now supports exposing mount status updates to users.
  2. Supports configuring current data flow operations based on the affinity of previous data operations to optimize processing efficiency.
  3. Enables data plane monitoring of JindoRuntime using Prometheus.
  4. Allows configuration of imagePullSecret in Runtime level.

Bug Fixes.

  1. Fixed an issue where configuring affinity/nodeSelector/schedulerName/imagePullSecrets parameters in CronDataload caused preloading failures.
  2. Resolved an issue where upgrading the Fluid version caused data operation failures due to datasets with the same name.

What's Changed

  • build(deps): bump github/codeql-action from 3.26.2 to 3.26.5 by @dependabot in #4296
  • Chore: Fixed docker build command in Makefile by @omerap12 in #4299
  • build(deps): bump github.com/prometheus/client_golang from 1.20.1 to 1.20.2 by @dependabot in #4295
  • add fuse properties with default xengine by @frankleaf in #4302
  • Build docker images for releasing v1.0.2 by @cheyang in #4303
  • build(deps): bump github.com/onsi/gomega from 1.34.1 to 1.34.2 by @dependabot in #4300
  • Prepare for v1.0.3 by @cheyang in #4304
  • Docker build for fixing fuse properties of jindocache by @cheyang in #4307
  • build(deps): bump github/codeql-action from 3.26.5 to 3.26.6 by @dependabot in #4305
  • build(deps): bump google.golang.org/grpc from 1.65.0 to 1.66.0 by @dependabot in #4301
  • build(deps): bump github.com/felixge/fgprof from 0.9.4 to 0.9.5 by @dependabot in #4306
  • Sort packages, optimize Dockerfile by @omerap12 in #4309
  • build(deps): bump golang.org/x/net from 0.28.0 to 0.29.0 by @dependabot in #4310
  • build(deps): bump github.com/prometheus/client_golang from 1.20.2 to 1.20.3 by @dependabot in #4311
  • build(deps): bump google.golang.org/grpc from 1.66.0 to 1.66.1 by @dependabot in #4314
  • build(deps): bump google.golang.org/grpc from 1.66.1 to 1.66.2 by @dependabot in #4315
  • enhance: NodeUnpublishVolume returns early when target path is not existed by @TrafalgarZZZ in #4318
  • enhance: optimize fluid helm chart by @TrafalgarZZZ in #4319
  • build(deps): bump github/codeql-action from 3.26.6 to 3.26.7 by @dependabot in #4320
  • build(deps): bump com.google.protobuf:protobuf-java from 3.16.3 to 3.25.5 in /samples/hdfs by @dependabot in #4323
  • build(deps): bump github.com/prometheus/client_golang from 1.20.3 to 1.20.4 by @dependabot in #4321
  • build(deps): bump google.golang.org/grpc from 1.66.2 to 1.67.0 by @dependabot in #4325
  • build(deps): bump github/codeql-action from 3.26.7 to 3.26.8 by @dependabot in #4326
  • Use Variables for simplify edits and enhance readability. by @omerap12 in #4313
  • doc: fix installation guide for how to set resources for controllers by @TrafalgarZZZ in #4330
  • bugfix: fix data operation failure when upgrading cache engine implementation with same Dataset name by @TrafalgarZZZ in #4329
  • build(deps): bump github/codeql-action from 3.26.8 to 3.26.9 by @dependabot in #4332
  • build(deps): bump google.golang.org/grpc from 1.67.0 to 1.67.1 by @dependabot in #4333
  • fix: fix slice init length by @cuishuang in #4335
  • Refactor Makefile: Add .PHONY declarations by @omerap12 in #4334
  • build(deps): bump golang.org/x/time from 0.6.0 to 0.7.0 by @dependabot in #4336
  • support dataflow affinity using any preceding data operations by @xliuqq in #4324
  • bugfix: avoid setting "storage.data-dirs.capacity" when using MEM as tieredstore's medium type by @TrafalgarZZZ in #4339
  • feat: enable client-side metrics scraping for JindoCache engine by @TrafalgarZZZ in #4331
  • Build docker image for supporting dataflow affinity by @cheyang in #4340
  • Make dataflow affinity's annotations consistent with others by @TrafalgarZZZ in #4342
  • build(deps): bump github/codeql-action from 3.26.9 to 3.26.11 by @dependabot in #4338
  • Revert PR #4339 by @TrafalgarZZZ in #4343
  • bugfix: add startup probe to gha-e2e minio setup by @TrafalgarZZZ in #4344
  • refactor: remove tieredstore argument in func base.BuildRuntimeInfo by @TrafalgarZZZ in #4341
  • feat: support imagePullSecrets in thinRuntime & thinRuntimeProfile by @Syspretor in #4348
  • Make metrics scrape target flexible with mountModeSelector by @TrafalgarZZZ in #4350
  • Fix: fix some typo and log fmt error by @Syspretor in #4347
  • feat: support imagePullSecrets in jindoRuntime by @Syspretor in #4349
  • feat: support mountMode configuration to skip checking mount ready by @Syspretor in #4346
  • Docker build for fixing the skipping check mount ready by @cheyang in #4351
  • build(deps): bump golang.org/x/net from 0.29.0 to 0.30.0 by @dependabot in #4337
  • docs updated by @vaibhav93076 in #4352
  • build(deps): bump github/codeql-action from 3.26.11 to 3.26.12 by @dependabot in #4353
  • refactor: sync schedule info to cache nodes by @TrafalgarZZZ in #4355
  • dataflow ensure the dependent operation was completed by @xliuqq in #4345
  • [WIP] fix: fix the dataload with cronJob failure in jindoCacheRuntime by @Syspretor in #4359
  • Fix: fix the invalid fmt of dataload cronJob helm template by @Syspretor in #4360
  • Build docker images for fixing cron dataload with annotations by @cheyang in #4362
  • Prepare for v1.0.4 by @cheyang in #4365
  • build(deps): bump github.com/prometheus/client_golang from 1.20.4 to 1.20.5 by @dependabot in #4361
  • Revert to v1.0.3 by @cheyang in #4372
  • fix some issues of helm chart by @Syspretor in #4373
  • bugfix: fix NodeUnpublishVolume when checking corrupted mount points by @TrafalgarZZZ in #4374
  • Docker build for fixing NodeUnpublishVolume when checking corrupted by @cheyang in #4375

New Contributors

Full Changelog: v1.0.2...v1.0.3

v1.0.2

30 Aug 11:03
41eefb6
Compare
Choose a tag to compare

New Features

  • Support setting resources requests and limits for DataProcess
  • Add dataset in used info to mutated app pods
  • Support hierarchical imagePullSecrets configuration in AlluxioRuntime
  • Support subpath in dynamic-mount

What's Changed

New Contributors

Full Changelog: v1.0.1...v1.0.2

v1.0.1

12 Jul 06:00
644a191
Compare
Choose a tag to compare

New Features

  • Support data flow affinity scheduling.
  • Support dynamic updates for dataset mount points.
  • Support data acceleration for Fluid Persistent Volume Claim in sidecar mode

What's Changed

Full Changelog: v1.0.0...v1.0.1

v1.0.0

14 May 12:46
b106093
Compare
Choose a tag to compare

Highlights

  • Introduced a flexible, configurable, tiered data locality scheduling capability to optimize the affinity between application pods and data cache.
  • Provided DataProcess for custom data operations, and add three trigger strategies for data operations for all the data operations – once, onEvent, Cron.
  • Provided a Python SDK with dataflow capabilities for data scientists.
  • Implemented A new runtime for sharing in-memory immutable data: VineyardRuntime is supported in Fluid.
  • Major improvements have been made in:
    • Improved security measures by defining stricter, minimum necessary cluster role permissions for Fluid components.
    • Significantly optimized FUSE Recovery features to enhance their performance and reliability.
    • Made significant updates to the project documentation and website.

We acknowledge all the contributors who put their effort in the version release. Credits to @zwwhdls, @xliuqq, @wangshli, @Hexilee, @weixiao-huang, @abowloflrf, @uniqueni, @TrafalgarZZZ, @dashanji, @cheyang, @fengshunli, @frankleaf, @zhang-x-z, @BillyChen1, @wushiming540, @RongGu and many others for their great contributions to Fluid v1.0.0 !

New Features

Data Operation Features

  • Add cron for data migrate.
  • Support cron dataload.
  • Make toleration configurable in helm charts.
  • Data process crd definition.
  • Support dataflow.
  • Data operations support resources.
  • Support ssh password free pod for parallel data migrate.

Vineyard Runtime

  • Add the Vineyard runtime CRD definitions.
  • Add the helm chart for Vineyard runtime.
  • Add the controller and RBAC yaml for Vineyard runtime.
  • Implement Vineyard runtime engine and controller.
  • Add a replicas field to the Vineyard Runtime and delete the svc suffix in the Vineyard helm chart.

Enhancements & Optimizations

CSI Plugin & FUSE Recovery

  • Check path existence and lock in NodeUnpublishVolume.
  • umountDuplicate larger than the threshold.
  • Fix csi plugin concurrency issue on FuseRecovery and NodeUnpublishVolume.
  • Enhancement: recover fuse according to multiple peer group options.
  • Support symlink for NodePublish.

Bug Fix

Website & Documentation Update

Full Changelog: v0.9.0...v1.0.0

v0.9.3

13 Mar 13:26
00741af
Compare
Choose a tag to compare

What's Changed

Full Changelog: v0.9.2...v0.9.3

v0.9.2

01 Oct 08:09
880474b
Compare
Choose a tag to compare

What's Changed

Full Changelog: v0.9.1...v0.9.2

v0.8.7

25 Jul 03:35
f03b7ff
Compare
Choose a tag to compare

What's Changed

Full Changelog: v0.8.6...v0.8.7