Skip to content

Need to reinitialize certain components for externally managed runtimes when moving functions #5007

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Aug 22, 2019
Merged

Need to reinitialize certain components for externally managed runtimes when moving functions #5007

merged 1 commit into from
Aug 22, 2019
+27 −13

Conversation

jerrypeng
Copy link
Contributor

Motivation

In Pulsar Functions, for externally managed runtimes e.g. KubernetesRuntime, certain components such as GRPC channels need to be reinitialized when moving functions from one machine to another. If this is not done then exception like this

java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.RuntimeException: Not alive
        at org.apache.pulsar.functions.worker.rest.api.ComponentImpl$GetStatus.getComponentInstanceStatus(ComponentImpl.java:164) ~[org.apache.pulsar-pulsar-functions-worker-2.4.0-streamlio-32.jar:2.4.0-streamlio-32]
        at org.apache.pulsar.functions.worker.rest.api.FunctionsImpl$GetFunctionStatus.getStatusExternal(FunctionsImpl.java:556) ~[org.apache.pulsar-pulsar-functions-worker-2.4.0-streamlio-32.jar:2.4.0-streamlio-32]
        at org.apache.pulsar.functions.worker.rest.api.FunctionsImpl$GetFunctionStatus.getStatusExternal(FunctionsImpl.java:446) ~[org.apache.pulsar-pulsar-functions-worker-2.4.0-streamlio-32.jar:2.4.0-streamlio-32]
        at org.apache.pulsar.functions.worker.rest.api.ComponentImpl$GetStatus.getComponentStatus(ComponentImpl.java:220)

will keep on being thrown when getting metrics or status of the function

@jerrypeng jerrypeng added type/bug The PR fixed a bug or issue reported a bug area/function labels Aug 22, 2019
@jerrypeng jerrypeng added this to the 2.4.1 milestone Aug 22, 2019
@jerrypeng jerrypeng requested review from merlimat and sijie August 22, 2019 00:54
@jerrypeng jerrypeng self-assigned this Aug 22, 2019
@jerrypeng jerrypeng merged commit 27a9f62 into apache:master Aug 22, 2019
jiazhai pushed a commit that referenced this pull request Aug 28, 2019
@jerrypeng @jiazhai
Need to reinitialize certain components for externally managed runtim…
166cf44 
…es when moving functions (#5007)

(cherry picked from commit 27a9f62)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@merlimat merlimat

@sijie sijie

@jiazhai jiazhai

Assignees

@jerrypeng jerrypeng

Labels
area/function type/bug The PR fixed a bug or issue reported a bug
Projects
None yet
Milestone
2.4.1
Development

Successfully merging this pull request may close these issues.

None yet
4 participants
@jerrypeng @merlimat @sijie @jiazhai