Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Tiered Storage] Support Azure BlobStore offload configuration #8436

Merged
merged 3 commits into from
Nov 4, 2020

Conversation

gaoran10
Copy link
Contributor

@gaoran10 gaoran10 commented Nov 3, 2020

Fix https://github.com/streamnative/pulsar/issues/1606

Motivation

Support Azure BlobStore offload configuration.

Modifications

The new tiered-storage configuration was introduced in the offload refinement.
Add new universal configurations in OffloadPolicies

Verifying this change

Add a new integration test.

  • org.apache.pulsar.tests.integration.offload.TestUniversalConfigurations

Does this pull request potentially affect one of the following parts:

If yes was chosen, please highlight the changes

  • Dependencies (does it add or upgrade a dependency): (no)
  • The public API: (no)
  • The schema: (no)
  • The default values of configurations: (yes)
  • The wire protocol: (no)
  • The rest endpoints: (no)
  • The admin cli options: (no)
  • Anything that affects deployment: (no)

Documentation

Update related documents.

@gaoran10
Copy link
Contributor Author

gaoran10 commented Nov 3, 2020

/pulsarbot run-failure-checks

Copy link
Contributor

@eolivelli eolivelli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@gaoran10
Copy link
Contributor Author

gaoran10 commented Nov 3, 2020

/pulsarbot run-failure-checks

@codelipenghui codelipenghui added this to the 2.7.0 milestone Nov 3, 2020
@codelipenghui codelipenghui merged commit 4d98dc6 into apache:master Nov 4, 2020
@gaoran10 gaoran10 deleted the offload-azure branch November 5, 2020 01:27
huangdx0726 pushed a commit to huangdx0726/pulsar that referenced this pull request Nov 13, 2020
…e#8436)

Fix https://github.com/streamnative/pulsar/issues/1606

### Motivation

Support Azure BlobStore offload configuration. 

### Modifications

The new tiered-storage configuration was introduced in the offload refinement.
Add new universal configurations in `OffloadPolicies`
flowchartsman pushed a commit to flowchartsman/pulsar that referenced this pull request Nov 17, 2020
…e#8436)

Fix https://github.com/streamnative/pulsar/issues/1606

### Motivation

Support Azure BlobStore offload configuration. 

### Modifications

The new tiered-storage configuration was introduced in the offload refinement.
Add new universal configurations in `OffloadPolicies`
@codelipenghui
Copy link
Contributor

/pulsarbot cherry-pick to branch-2.6

codelipenghui pushed a commit that referenced this pull request Nov 21, 2020
Fix https://github.com/streamnative/pulsar/issues/1606

### Motivation

Support Azure BlobStore offload configuration. 

### Modifications

The new tiered-storage configuration was introduced in the offload refinement.
Add new universal configurations in `OffloadPolicies`

(cherry picked from commit 4d98dc6)
@codelipenghui
Copy link
Contributor

cherry-picked to branch-2.6

codelipenghui pushed a commit to streamnative/pulsar-archived that referenced this pull request Nov 21, 2020
…e#8436)

Fix https://github.com/streamnative/pulsar/issues/1606

### Motivation

Support Azure BlobStore offload configuration. 

### Modifications

The new tiered-storage configuration was introduced in the offload refinement.
Add new universal configurations in `OffloadPolicies`

(cherry picked from commit 4d98dc6)
(cherry picked from commit 89d1cb8)
codelipenghui pushed a commit to streamnative/pulsar-archived that referenced this pull request Nov 21, 2020
…e#8436)

Fix https://github.com/streamnative/pulsar/issues/1606

### Motivation

Support Azure BlobStore offload configuration. 

### Modifications

The new tiered-storage configuration was introduced in the offload refinement.
Add new universal configurations in `OffloadPolicies`

(cherry picked from commit 4d98dc6)
(cherry picked from commit 89d1cb8)
(cherry picked from commit 241da3f)
@Jennifer88huang-zz Jennifer88huang-zz added the doc-required Your PR changes impact docs and you will update later. label Dec 21, 2020
@Anonymitaet Anonymitaet added doc Your PR contains doc changes, no matter whether the changes are in markdown or code files. and removed doc-required Your PR changes impact docs and you will update later. labels Feb 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/tieredstorage doc Your PR contains doc changes, no matter whether the changes are in markdown or code files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Offload] Azure offload support
5 participants