What's Changed

• Master
  • Fix implementation of master_pb.CollectionList RPC call by @proton-lisandro-pin in #6715
• S3 APIs
  • [s3] fix checksum algorithm CRC64NVMe by @kmlebedev in #6722
  • [s3] use chunkedReader in PutObjectPartHandler to handle aws-chunked encoding by @ehooi in #6725
  • fix #6733 add s3.ip.bind command line parameter by @ARibster in #6741
  • [s3] add tests for s3 over https using aws-cli by @ehooi in #6731
  • [s3] refactor duplicate put-object code paths by @ehooi in #6727
  • fix: S3 Feature: please add s3.idleTimeout command line parameter #6746 by @ARibster in #6747
• Misc
  • golang up version to 1.24 by @kmlebedev in #6724
• Shell
  • fix: volume.list volume info output not in order by @NyaMisty in #6737
• Filer Store
  • feat(redis): add mTLS support for Redis connection initialization by @jadedevin13 in #6738

New Contributors

• @ARibster made their first contribution in #6741
• @jadedevin13 made their first contribution in #6738

Full Changelog: 3.86...3.87

What's Changed

• Filer Store

  • Cassandra loss dir by @Werberus in #6559
  • add cassandra2 by @chrislusf in #6582
  • add lua redis store to ensure atomicity by @chrislusf in #6671
  • Tarantool filer store by @MaratKarimov in #6669

• Shell

  • fix: error info size bug in command_fs_merge_volumes.go by @GeoffreyChen777 in #6567
  • ec.encode: Fix resolution of target collections. by @proton-lisandro-pin in #6585

• Volume Server

  • added re-generating and writing the Volume UUID if it is empty by @Werberus in #6568
  • Fix volume ttl by @bwlfhu in #6683

• Helm Charts

  • Removed unused certificate mounts from helm chart by @warrenhodg in #6581
  • Revert "Removed unused certificate mounts from helm chart" by @chrislusf in #6597
  • Fix typos and YAML syntax issues by @skycaptain in #6628
  • feature/add-cosi-resources by @klinch0 in #6638

• Master

  • Fix calculation of node's free EC shard slots. by @proton-lisandro-pin in #6584

• FUSE Mount

  • clear cache directory when mount exits by @lizhengui007 in #6605
  • Fixes files with TTL are not listed in a mounted folder. by @jang1lee in #6621
  • Fixes files with TTL can not be read in a mounted folder by @jang1lee in #6646

• Filer

  • [filer] UploadRequestToChunks: terminate the upload of remaining chunks as early as possible might be more reasonable when one chunk upload goroutine encounters a failure. by @hoverseu in #6610
  • fix: restore deletion audit of individual objects by @SmoothDenis in #6644
  • added a check for the nil value when requesting FindEntry. by @Werberus in #6651

• Message Queue

  • Accumulated changes for message queue by @chrislusf in #6600

• WebDAV

  • Allow standalone webdav server to bind specific address by @Victrid in #6403

• S3 API

  • Fix s3 auth failed with X-Forwarded-Host and X-Forwarded-Port by @zuzuviewer in #6650
  • add more logging for s3 signature by @tcrasset in #6652
  • feat/fix: add s3.cacert.file/tlsVerifyClientCert to filer command by @KarolBedkowski in #6659
  • [filer] void panic if s3opt.tlsCACertificate is nill by @kmlebedev in #6685
  • Revert "[filer] void panic if s3opt.tlsCACertificate is nill" by @kmlebedev in #6694
  • Fix s3 auth failed with X-Forwarded-Host and X-Forwarded-Port by @zuzuviewer in #6698

• Cloud Drive

  • errors when reading uncached files from cloud drive by @chrislusf in #6674

• Misc

  • fix: fix the wrong error return value by @tiaoxizhan in #6603
  • chore: make function comment match function name by @NinaLua in #6607
  • fix call writeJsonError with a nil value error after check another err by @alingse in #6673

New Contributors

• @GeoffreyChen777 made their first contribution in #6567
• @tiaoxizhan made their first contribution in #6603
• @lizhengui007 made their first contribution in #6605
• @NinaLua made their first contribution in #6607
• @hoverseu made their first contribution in #6610
• @jang1lee made their first contribution in #6621
• @skycaptain made their first contribution in #6628
• @klinch0 made their first contribution in #6638
• @Victrid made their first contribution in #6403
• @alingse made their first contribution in #6673
• @bwlfhu made their first contribution in #6683

Full Changelog: 3.85...3.86

Seaweed Admin

A close-source SeaweedAdmin server for flexible metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Volume Server
  • fix: The free disk size and percentage are quite different from the output of df -h. by @zouyixiong in #6550
• Misc
  • Nit: fix missing newline on EC balancing warnings regarding replica settings by @proton-lisandro-pin in #6509
  • fix: bucket-hook fails with gnu wget by @emosbaugh in #6521
• S3 API
  • use X-Forwarded-Host and X-Forwarded-Port to determine correct host for AWS signature by @tcrasset in #6514
  • fix: record and delete bucket metrics after inactive by @zouyixiong in #6523
  • add s3 signature tests and prepare implementation of STREAMING-UNSIGNED-PAYLOAD-TRAILER by @tcrasset in #6525
  • omit http and https ports when using X-Forwarded-Port by @tcrasset in #6527
  • implement s3 streaming-unsigned-payload-trailer by @tcrasset in #6539
  • fix: s3 command ignore -tlsVerifyClientCert and -cacert.file arguments by @KarolBedkowski in #6547
• Shell
  • Remove warning on EC balancing if no replica placement settings are found. by @proton-lisandro-pin in #6516
  • Nit: remove missing newlines on weed shell commands output. by @proton-lisandro-pin in #6524
  • ec.encode: Explictly mount EC shards after volume conversion. by @proton-lisandro-pin in #6528
• Helm Charts
  • fix helm: s3 allowEmptyFolder flag if (#6204) by @FQHSLycopene in #6206
  • Helm: Support map format for image pull secrets by @gtudan in #6546
• Filer
  • stop retry when all nodes have tried it by @Numblgw in #6551

New Contributors

• @emosbaugh made their first contribution in #6521
• @FQHSLycopene made their first contribution in #6206
• @KarolBedkowski made their first contribution in #6547

Full Changelog: 3.84...3.85

What's Changed

• reverting this change in S3 API #6489

Full Changelog: 3.83...3.84

Seaweed Admin

A close-source SeaweedAdmin server for flexible metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Cloud Tier
  • cloud tier: support for Alibaba Cloud OSS by @ludwigxia in #6466
• Filer Store
  • filer store YDB: fix upsert with TTL by @MaratKarimov in #6469
• Misc
  • Update README.md - space for label creation by @dooblem in #6471
• S3 API
  • Add metrics for uploaded and deleted s3 objects by @hadizamani021 in #6475
  • return error on invalid action in PutUserPolicy by @tcrasset in #6482
  • verify if bucket exists in GetBucketLocationHandler by @tcrasset in #6485
• Erasure Coding
  • ec.encode: Display a warning on EC balancing if no replica placement settings are found. by @proton-lisandro-pin in #6487
  • ec.balance: Allow EC balancing without collections. by @proton-lisandro-pin in #6488
  • Improve EC shards balancing logic regarding replica placement settings. by @proton-lisandro-pin in #6491
• Filer
  • Add content length to filer's requests by @hadizamani021 in #6489
• Master
  • Remove rate limit semaphore on master's leader selection logic. by @proton-lisandro-pin in #6494

New Contributors

• @ludwigxia made their first contribution in #6466
• @MaratKarimov made their first contribution in #6469
• @dooblem made their first contribution in #6471

Full Changelog: 3.82...3.83

Seaweed Admin

A close-source SeaweedAdmin server for flexible metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Shell

  • [weed] change -n to -force by @dsd2077 in #6421
  • fix force arg dropped during volume balance command by @ftong2020 in #6432
  • ec.encode: Fix bug causing source volumes not being deleted after EC conversion. by @proton-lisandro-pin in #6447
  • Add JWT authentication to fs.mergeVolumes command by @hadizamani021 in #6461

• S3

  • Bugfix s3 audit missing requester for PUT requests by @ftong2020 in #6434
  • improve iam error handling by @tcrasset in #6446
  • Add bucket's traffic metrics by @hadizamani021 in #6444
  • fix S3 per-user-directory Policy by @tcrasset in #6443

New Contributors

• @ftong2020 made their first contribution in #6432
• @tcrasset made their first contribution in #6446
• @hadizamani021 made their first contribution in #6444

Full Changelog: 3.81...3.82

In this release, @proton-lisandro-pin re-engineered the EC operations! Thanks!

Seaweed Admin

A close-source SeaweedAdmin server for flexible metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Erasure Coding

  • Introduce logic to resolve volume replica placement within EC rebalancing. by @proton-lisandro-pin in #6254
  • Unify usage of shell.EcNode.dc as DataCenterId. by @proton-lisandro-pin in #6258
  • Improve EC shards rebalancing logic across racks by @proton-lisandro-pin in #6270
  • fix EcVolumes sorting in volume UI by @trim21 in #6275
  • Improve EC shards rebalancing logic across nodes by @proton-lisandro-pin in #6297
  • Display details upon failures to re-balance EC shards racks. by @proton-lisandro-pin in #6299
  • Resolve replica placement for EC volumes from master server defaults. by @proton-lisandro-pin in #6303
  • Account for replication placement settings when balancing EC shards across racks. by @proton-lisandro-pin in #6316
  • Account for replication placement settings when balancing EC shards within the same rack. by @proton-lisandro-pin in #6317
  • Share common parameters for EC re-balancing functions under a single struct. by @proton-lisandro-pin in #6319
  • Remove average constraints when selecting nodes/racks to balance EC shards into. by @proton-lisandro-pin in #6325
  • Unify the re-balancing logic for ec.encode with ec.balance. by @proton-lisandro-pin in #6339
  • Delete legacy balancing code for ec.encode. by @proton-lisandro-pin in #6344
  • Limit EC re-balancing for ec.encode to relevant collections when a volume ID argument is provided. by @proton-lisandro-pin in #6347
  • Begin implementing EC balancing parallelization support. by @proton-lisandro-pin in #6342
  • Parallelize EC balancing for racks. by @proton-lisandro-pin in #6351
  • Parallelize EC shards balancing across racks. by @proton-lisandro-pin in #6352
  • Parallelize EC shards balancing within racks by @proton-lisandro-pin in #6354
  • fatal error: concurrent map iteration and map write by @coffeecloudgit in #6358 #6359
  • Rework shell.EcBalance()'s waitgroup code into a standalone type. by @proton-lisandro-pin in #6373
  • Parallelize volume replica operations within ec.encode. by @proton-lisandro-pin in #6374
  • Allow configuring the maximum number of concurrent tasks for EC parallelization. by @proton-lisandro-pin in #6376
  • Fix volume replica parallelization within ec.encode. by @proton-lisandro-pin in #6377

• Shell

  • [shell] add noLock param for volume.move by @kmlebedev in #6261
  • [shell] don't require lock when there are no changes for volume.fix.replication by @kmlebedev in #6266
  • [shell] use constant for hdd of type by @kmlebedev in #6337
  • volume.list avoid output empty data center and rack and disk info by @kmlebedev in #6341
  • [shell] volume.list show only writable volumes by @kmlebedev in #6338
  • [shell] feat:stop vacuum immediately once volume.vacuum.disable was executed by @dsd2077 in #6375
  • [shell] only apply the balancing for writable volumes by @kmlebedev in #6346
  • Moving the warning report after the code sees if the file is on the source volume. by @bradmurray in #6406

• Master

  • [master] avoid crowded more writable for auto grow by @kmlebedev in #6214
  • [master] Revert back automatic volume grow in case of compensate for crowded volumes by @kmlebedev in #6267
  • fix missing register master metric MasterPickForWriteErrorCounter by @kmlebedev in #6277
  • use ShouldGrowVolumesByDcAndRack by @kmlebedev in #6280
  • [master] update LastLeaderChangeTime for hashicorp raft by @kmlebedev in #6292
  • [master] avoid timeout when assigning for main request with filter by DC or rack by @kmlebedev in #6291
  • [security] reload whiteList on http seerver by @kmlebedev in #6302

• Filer Sync

  • filer sync: source path and exclude path support dir suffix by @Numblgw in #6268

• S3 API

  • fix: record and delete bucket metrics after inactive by @zouyixiong in #6349
  • fix: filer may crash by bucketLastActiveTsNs concurrency access. by @zouyixiong in #6350
  • Fix for DeleteMultipleObjectsHandler wrongly deleting parent folders by @warrenhodg in #6380

• FUSE Mount

  • mount metacache add ttl by @zemul in #6360

• Volume Server

  • skip error while executing volume.fix.replication by @dsd2077 in #6382

• Filer WORM support

  • worm grace period and retention time support by @27149chen in #6404

• Misc

  • ExclusiveLocker only create one renew goroutine by @Numblgw in #6269
  • use readable bytes size string in shell output by @trim21 in #6288
  • change comment for expect header by @CodeRusher in #6289
  • Replaced https.client.enabled with false in scaffold/security by @vadimartynov in #6320
  • Replace bolt dependency with bbolt by @hack3ric in #6387
  • use same time format in volume volume UI and filter UI by @trim21 in #6395
  • Update LICENSE, fix copyright license year by @JasonnnW3000 in #6405

New Contributors

• @trim21 made their first contribution in #6275
• @warrenhodg made their first contribution in #6380
• @hack3ric made their first contribution in #6387
• @JasonnnW3000 made their first contribution in #6405

Full Changelog: 3.80...3.81

Seaweed Admin

A close-source SeaweedAdmin server for flexible metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Filer
  • SubscribeMetadata can miss some events when big files are written by @half-life666 in #6183
  • When uploading a file named ".txt" in chunks in Seaweed Java client, an error occurs when reading the uploaded file by @liangyihan in #6188
  • Fix/parse upload filename by @KevinBLT in #6241
• Shell
  • [shell] volume.balance collect volume servers by dc rack node by @kmlebedev in #6191
  • Refactor ec.balance logic into a weed/shell/command_ec_common.go… by @proton-lisandro-pin in #6195
  • [shell] add admin noLock for balance by @kmlebedev in #6209
• Master
  • fix deadlock hang when broadcast to clients by @kungf in #6184
• Helm Charts
  • [helm] fix s3 servicemonitor label matching by @glycerine102 in #6218
  • Add a loop to wait for master and filer services in post-install-bucket-hook by @ScribblerCoder in #6240
• Volume Server
  • delete aborted ec shards from both source and target servers by @chrislusf in #6221
  • added backward compatible CRC check and extra explanatory comments by @evgmik in #6233
• Misc
  • feat(filer.backup): add ignore errors option by @mdenushev in #6235
  • fix java.lang.IllegalArgumentException: Comparison method violates its general contract! by @fo40225 in #6239
  • Adjust threshold config by @zemul in #6246
• Minor
  • fix format by @kungf in #6185
  • remove dup code for section.reader access by @half-life666 in #6169

New Contributors

• @liangyihan made their first contribution in #6188
• @proton-lisandro-pin made their first contribution in #6195
• @glycerine102 made their first contribution in #6218
• @fo40225 made their first contribution in #6239
• @ScribblerCoder made their first contribution in #6240

Full Changelog: 3.79...3.80

Seaweed Admin

A close-source SeaweedAdmin server for flexible metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Volume Server

  • feat: add in-flight metric for s3/file/volume-server by @CodeRusher in #6120
  • fix(volume): to avoid duplicate write a same needle by @dsd2077 in #6138

• Filer

  • Fix invalid metric name by @bradmurray in #6141
  • fix permission check in put request by @27149chen in #6142
  • stop renaming worm files by @27149chen in #6154

• Heml Chart

  • Fix dataDirs.maxVolumes default value when not included in a values.yaml by @rschnei87 in #6119
  • Support topologySpreadConstraints in helm chart by @dominikgrygiel in #6132
  • feat: add resource annotations by @oldgiova in #6134
  • Support specifying rack and dataCenter for filers in helm chart by @dominikgrygiel in #6144
  • [helm] Allow setting notification.toml config by @dacalabrese in #6159

New Contributors

• @rschnei87 made their first contribution in #6119
• @dominikgrygiel made their first contribution in #6132
• @oldgiova made their first contribution in #6134
• @bradmurray made their first contribution in #6141
• @dacalabrese made their first contribution in #6159

Full Changelog: 3.77...3.78

Seaweed Admin

A close-source SeaweedAdmin server for flexible metadata management:

• Flexible and efficient TTL management.
• Point-in-time recovery of any file to any point of time.
• Off-site continuous file metadata backup.

What's Changed

• Helm Chart
  • feat: Add support for "custom" dataDirs type for volume server in kubernetes helm chart by @TheHackmeister in #6094
• FUSE Mount
  • Fix nil issue #6110

New Contributors

• @TheHackmeister made their first contribution in #6094

Full Changelog: 3.76...3.77