Skip to content

Add S3Repository.LEGACY_MD5_CHECKSUM_CALCULATION to list of repository-s3 settings - #19788

Merged
cwperks merged 3 commits into
opensearch-project:mainfrom
cwperks:add-legacy-md5-setting
Oct 28, 2025
Merged

cwperks merged 3 commits into
opensearch-project:mainfrom
cwperks:add-legacy-md5-setting

Conversation

@cwperks

@cwperks cwperks commented Oct 27, 2025

Copy link
Copy Markdown
Member

Description

This is a small PR to make sure this setting can be used in opensearch.yml and not just on repo creation.

This was missed in #19220

Related Issues

See discussion around here: #18240 (comment)

Check List

  • Functionality includes testing.
  • API changes companion pull request created, if applicable.
  • Public documentation issue/PR created, if applicable.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

…y-s3 settings

Signed-off-by: Craig Perkins <cwperx@amazon.com>
@cwperks
cwperks requested a review from a team as a code owner October 27, 2025 19:16
Signed-off-by: Craig Perkins <cwperx@amazon.com>
@github-actions

Copy link
Copy Markdown
Contributor

❌ Gradle check result for fc4970e: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Signed-off-by: Craig Perkins <cwperx@amazon.com>
@owaiskazi19

Copy link
Copy Markdown
Member

@cwperks we can make this to 3.3.2

@cwperks

cwperks commented Oct 27, 2025

Copy link
Copy Markdown
Member Author

@peterzhuamazon Can we get this to 3.3.2?

@github-actions

Copy link
Copy Markdown
Contributor

❌ Gradle check result for 0786cff: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

@github-actions

Copy link
Copy Markdown
Contributor

βœ… Gradle check result for 0786cff: SUCCESS

@codecov

codecov Bot commented Oct 28, 2025 •

Copy link
Copy Markdown

Codecov Report

βœ… All modified and coverable lines are covered by tests.
βœ… Project coverage is 73.14%. Comparing base (753c135) to head (0786cff).
⚠️ Report is 7 commits behind head on main.

Additional details and impacted files
@@             Coverage Diff              @@
##               main   #19788      +/-   ##
============================================
+ Coverage     73.10%   73.14%   +0.03%     
- Complexity    70959    70976      +17     
============================================
  Files          5737     5737              
  Lines        324766   324775       +9     
  Branches      46981    46982       +1     
============================================
+ Hits         237425   237558     +133     
+ Misses        68226    68108     -118     
+ Partials      19115    19109       -6     

β˜” View full report in Codecov by Sentry.
πŸ“’ Have feedback on the report? Share it here.

πŸš€ New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@cwperks
cwperks merged commit 80141d5 into opensearch-project:main Oct 28, 2025
39 of 41 checks passed
anandpatel9998 pushed a commit to anandpatel9998/OpenSearch that referenced this pull request Nov 3, 2025
…y-s3 settings (opensearch-project#19788)

* Add S3Repository.LEGACY_MD5_CHECKSUM_CALCULATION to list of repository-s3 settings

Signed-off-by: Craig Perkins <cwperx@amazon.com>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <cwperx@amazon.com>

* Use the affix setting

Signed-off-by: Craig Perkins <cwperx@amazon.com>

---------

Signed-off-by: Craig Perkins <cwperx@amazon.com>
@gbbafna

gbbafna commented Nov 10, 2025

Copy link
Copy Markdown
Contributor

Hi @cwperks , we are seeing a regression due to aws sdk version update . Details are in aws/aws-sdk-java-v2#6556 .

What would be the impact of reverting that ?

@cwperks

cwperks commented Nov 10, 2025

Copy link
Copy Markdown
Member Author

@gbbafna I needed to upgrade to a later version of the SDK that had LegacyMd5Plugin.

@cwperks

cwperks commented Nov 10, 2025

Copy link
Copy Markdown
Member Author

@gbbafna It was introduced in 2.31.32, can we try downgrading to that version?

Ref: https://docs.aws.amazon.com/sdk-for-java/latest/developer-guide/s3-checksums.html?utm_source=chatgpt.com

@gbbafna

gbbafna commented Nov 10, 2025

Copy link
Copy Markdown
Contributor

Sure , I will try that and update this thread

@gbbafna

gbbafna commented Nov 13, 2025

Copy link
Copy Markdown
Contributor

It was introduced in 2.31.32, can we try downgrading to that version?

With this version , cluster is stable. Going to try latest version now

@cwperks

cwperks commented Nov 13, 2025

Copy link
Copy Markdown
Member Author

It was introduced in 2.31.32, can we try downgrading to that version?

With this version , cluster is stable. Going to try latest version now

Thank you for confirming :)

liuguoqingfz pushed a commit to liuguoqingfz/OpenSearch that referenced this pull request Dec 15, 2025
…y-s3 settings (opensearch-project#19788)

* Add S3Repository.LEGACY_MD5_CHECKSUM_CALCULATION to list of repository-s3 settings

Signed-off-by: Craig Perkins <cwperx@amazon.com>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <cwperx@amazon.com>

* Use the affix setting

Signed-off-by: Craig Perkins <cwperx@amazon.com>

---------

Signed-off-by: Craig Perkins <cwperx@amazon.com>
@RamHaridas

Copy link
Copy Markdown

Is there a plan to deprecate this parameter in any near future versions?

@cwperks

cwperks commented Jan 29, 2026

Copy link
Copy Markdown
Member Author

Is there a plan to deprecate this parameter in any near future versions?

@RamHaridas is there an issue with this setting? Its supported so that some s3-compatible repositories can be used with this plugin.

@RamHaridas

Copy link
Copy Markdown

quiet the opposite πŸ™‚, we need this flag to be available for our s3-compatible storage. Thank you for adding this @cwperks

@cwperks

cwperks commented Jan 29, 2026

Copy link
Copy Markdown
Member Author

ah, thanks for confirming it works for you! :).

There is no plan to deprecate. This would maintain support for as long as its in the aws sdk.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants