Skip to content

[serve] Add multi app support to serve run - #33347

Merged
edoakes merged 14 commits into
ray-project:masterfrom
zcin:serve-run-multi
Mar 23, 2023
Merged

[serve] Add multi app support to serve run#33347
edoakes merged 14 commits into
ray-project:masterfrom
zcin:serve-run-multi

Conversation

@zcin

@zcin zcin commented Mar 16, 2023

Copy link
Copy Markdown
Contributor

Why are these changes needed?

Add support for serve run to run multiple applications at once.

To run multiple applications with a config file:

serve run new_config

CANNOT run multiple applications with import path arguments:

Related issue number

Checks

  • I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR.
  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

zcin added 2 commits March 15, 2023 16:46
Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>
Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>
@zcin
zcin marked this pull request as ready for review March 16, 2023 16:08
zcin added 4 commits March 16, 2023 09:09
Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>
Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>
Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>
Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>
@zcin

zcin commented Mar 20, 2023

Copy link
Copy Markdown
Contributor Author

Comment thread python/ray/serve/scripts.py Outdated
Comment thread python/ray/serve/tests/test_cli.py Outdated
Comment thread python/ray/serve/tests/test_cli.py
Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>
zcin added 7 commits March 20, 2023 17:23
Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>
Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>
Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>
Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>
Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>
Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>
Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>
@zcin

zcin commented Mar 23, 2023

Copy link
Copy Markdown
Contributor Author

@edoakes should be ready for merge

@edoakes
edoakes merged commit 095712c into ray-project:master Mar 23, 2023
elliottower pushed a commit to elliottower/ray that referenced this pull request Apr 22, 2023
* add multi app support to serve run

Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>

* improve

Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>

* lint

Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>

* remove multiple import paths

Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>

* address comments

Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>

* improve serve run config

Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>

* fixes

Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>

* extend serve run port tests

Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>

---------

Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>
Signed-off-by: elliottower <elliot@elliottower.com>
ProjectsByJackHe pushed a commit to ProjectsByJackHe/ray that referenced this pull request May 4, 2023
* add multi app support to serve run

Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>

* improve

Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>

* lint

Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>

* remove multiple import paths

Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>

* address comments

Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>

* improve serve run config

Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>

* fixes

Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>

* extend serve run port tests

Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>

---------

Signed-off-by: Cindy Zhang <cindyzyx9@gmail.com>
Signed-off-by: Jack He <jackhe2345@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants