Skip to content

[Tune] Unrevert "Add more comprehensive support for remote_checkpoint_dir w/ url params (#32479)" - #32576

Merged
krfricke merged 7 commits into
ray-project:masterfrom
justinvyu:tune/fix_uri_pr
Feb 16, 2023
Merged

[Tune] Unrevert "Add more comprehensive support for remote_checkpoint_dir w/ url params (#32479)"#32576
krfricke merged 7 commits into
ray-project:masterfrom
justinvyu:tune/fix_uri_pr

Conversation

@justinvyu

@justinvyu justinvyu commented Feb 15, 2023

Copy link
Copy Markdown
Contributor

Why are these changes needed?

This reverts the revert made here #32571.

This PR fixes two suites of tests that were failing:

  1. workflows tests were failing due to the pinned moto version being too old.
  2. test_syncer errors were caused by reusing the same bucket name between tests.

This PR also fixes the restore path for URIs with params, which was missing from the previous PR. The e2e sync test has been updated to also test restoration.

See changes from new commits only here: new commits

Related issue number

Checks

  • I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR.
  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

…r remote `upload_dir` w/ endpoint and params (ray-project#32479)" (ray-project#32571)"

This reverts commit 350fb13.
Signed-off-by: Justin Yu <justinvyu@berkeley.edu>
Signed-off-by: Justin Yu <justinvyu@berkeley.edu>
Signed-off-by: Justin Yu <justinvyu@berkeley.edu>
Signed-off-by: Justin Yu <justinvyu@berkeley.edu>
Signed-off-by: Justin Yu <justinvyu@berkeley.edu>
@justinvyu

Copy link
Copy Markdown
Contributor Author

@krfricke Before merging, I want to run workflows tests - how do I kick these off?

@krfricke
krfricke merged commit abdb7c7 into ray-project:master Feb 16, 2023
@krfricke

Copy link
Copy Markdown
Contributor

Ah sorry, that was a quick merge...

usually it would have been [all_tests] or changing something in a workflows file.

Well, now it will run on master, let's see if everything works

@justinvyu

Copy link
Copy Markdown
Contributor Author

Ah ok, hopefully it is ok!

@xwjiang2010

Copy link
Copy Markdown
Contributor

Thanks folks! Will keep an eye out!

edoakes pushed a commit to edoakes/ray that referenced this pull request Mar 22, 2023
…_dir w/ url params (ray-project#32479)" (ray-project#32576)

This reverts the revert made here ray-project#32571.

This PR fixes two suites of tests that were failing:
1. workflows tests were failing due to the pinned `moto` version being too old.
2. `test_syncer` errors were caused by reusing the same bucket name between tests.

This PR also fixes the `restore` path for URIs with params, which was missing from the previous PR. The e2e sync test has been updated to also test restoration.

Signed-off-by: Justin Yu <justinvyu@berkeley.edu>
Signed-off-by: Edward Oakes <ed.nmi.oakes@gmail.com>
peytondmurray pushed a commit to peytondmurray/ray that referenced this pull request Mar 22, 2023
…_dir w/ url params (ray-project#32479)" (ray-project#32576)

This reverts the revert made here ray-project#32571.

This PR fixes two suites of tests that were failing:
1. workflows tests were failing due to the pinned `moto` version being too old.
2. `test_syncer` errors were caused by reusing the same bucket name between tests.

This PR also fixes the `restore` path for URIs with params, which was missing from the previous PR. The e2e sync test has been updated to also test restoration.

Signed-off-by: Justin Yu <justinvyu@berkeley.edu>
elliottower pushed a commit to elliottower/ray that referenced this pull request Apr 22, 2023
…_dir w/ url params (ray-project#32479)" (ray-project#32576)

This reverts the revert made here ray-project#32571.

This PR fixes two suites of tests that were failing:
1. workflows tests were failing due to the pinned `moto` version being too old.
2. `test_syncer` errors were caused by reusing the same bucket name between tests.

This PR also fixes the `restore` path for URIs with params, which was missing from the previous PR. The e2e sync test has been updated to also test restoration.

Signed-off-by: Justin Yu <justinvyu@berkeley.edu>
Signed-off-by: elliottower <elliot@elliottower.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants