Skip to content

fix: remove Sonnet 3.5 for DAP

Manoj M Jrequested to merge
manojmj-main-patch-27556 into main

What does this merge request do and why?

During testing of model selection for DAP, we realized that Sonnet 3.5 does not work on DAP as of today due to token size mismatch.

"event": "Error code: 400 - {'type': 'error', 'error': {'type': 'invalid_request_error', 'message': 'max_tokens: 16384 > 8192, which is the maximum allowed number of output tokens for claude-3-5-sonnet-20240620'}, 'request_id': 'req_011CT4WbHSn6wJ2gcUoxZcrb'}", "logger": "exceptions", "level": "error", "correlation_id": "01K4YYHYQPM36FKHRDYNNMBCQR", "gitlab_global_user_id": "ui/A6IWVVUv68Ch3UG1bk76xfMiee6Thm9TTcuwlpxs=", "workflow_id": "35", "status_code": null

We can probably add it back after this is resolved, but we can't add it as a supported model for the time being.

Slack conversation: Link

How to set up and validate locally

Numbered steps to set up and validate the change are strongly suggested.

Merge request checklist

  • Tests added for new functionality. If not, please raise an issue to follow up.
  • Documentation added/updated, if needed.
  • If this change requires executor implementation: verified that issues/MRs exist for both Go executor and Node executor or confirmed that changes are backward-compatible and don't break existing executor functionality.

Merge request reports