Skip to content

Update turbo edits E2E snapshot for simplified error message#2384

Merged
wwwillchen merged 1 commit intodyad-sh:mainfrom
wwwillchen:update-turbo-edits-snapshot
Jan 28, 2026
Merged

Update turbo edits E2E snapshot for simplified error message#2384
wwwillchen merged 1 commit intodyad-sh:mainfrom
wwwillchen:update-turbo-edits-snapshot

Conversation

@wwwillchen
Copy link
Copy Markdown
Collaborator

@wwwillchen wwwillchen commented Jan 28, 2026

Summary

  • Updates the E2E test snapshot for the turbo edits search-replace fallback test
  • The error message format changed to remove the fuzzy match similarity percentage, simplifying the error output

Test plan

  • E2E snapshot updated to reflect new error message format
  • All existing tests pass (654/654)

#skip-bugbot

🤖 Generated with Claude Code


Open with Devin

Summary by cubic

Update the turbo edits E2E snapshot to match the new simplified search-replace error message. Removes the fuzzy match similarity percentage from the expected output so tests align with current behavior.

Written for commit c256a72. Summary will update on new commits.

The search-replace error message no longer includes fuzzy match
similarity percentage, simplifying the error output.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@gemini-code-assist
Copy link
Copy Markdown
Contributor

Summary of Changes

Hello @wwwillchen, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request focuses on maintaining the accuracy of end-to-end tests by updating a snapshot. The necessity for this update stems from a recent modification to how error messages are presented, resulting in a more concise and user-friendly error output for search-replace operations. The change ensures that our automated tests correctly reflect the current system behavior without introducing new failures.

Highlights

  • E2E Snapshot Update: The pull request updates an existing E2E test snapshot for the turbo edits search-replace fallback test.
  • Simplified Error Message: The update reflects a change in the error message format, specifically removing the fuzzy match similarity percentage to simplify the output.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

Copy link
Copy Markdown
Contributor

@devin-ai-integration devin-ai-integration bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no bugs or issues to report.

Open in Devin Review

@github-actions
Copy link
Copy Markdown
Contributor

🔍 Multi-Agent Code Review

3 independent reviewers analyzed this PR. No issues were identified.

Summary

Severity Count
🔴 HIGH 0
🟡 MEDIUM 0
🟢 LOW 0

Review Notes

All reviewers agreed this is a straightforward E2E test snapshot update that:

  • Reflects a simplification in error messaging (removing fuzzy match similarity details)
  • Correctly synchronizes test expectations with updated source code behavior
  • Has no correctness, security, or maintainability concerns

LGTM - No issues to address.


Generated by multi-agent consensus review (3 agents, randomized file ordering, 2+ consensus threshold)

Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request successfully updates the E2E test snapshot to align with the new, simplified error message format for dyad-search-replace operations. The change correctly reflects the removal of fuzzy match similarity details from the user-facing error output.

{
"role": "user",
"content": "There was an issue with the following `dyad-search-replace` tags. Make sure you use `dyad-read` to read the latest version of the file and then trying to do search & replace again.\n \nFile path: src/pages/Index.tsx\nError: Unable to apply search-replace to file because: Search block did not match any content in the target file. Best fuzzy match had similarity of 0.0% (threshold: 90.0%)"
"content": "There was an issue with the following `dyad-search-replace` tags. Make sure you use `dyad-read` to read the latest version of the file and then trying to do search & replace again.\n \nFile path: src/pages/Index.tsx\nError: Unable to apply search-replace to file because: Search block did not match any content in the target file."
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The removal of the fuzzy match similarity percentage from this error message, while simplifying the output, might inadvertently remove valuable diagnostic context for users. For those debugging dyad-search-replace failures, details about how close a fuzzy match was (e.g., '0.0% similarity') can be crucial for understanding why a block didn't match. It might be beneficial to retain this information, perhaps in a collapsible detail section or a more concise format, to aid in troubleshooting.

@greptile-apps
Copy link
Copy Markdown
Contributor

greptile-apps bot commented Jan 28, 2026

Greptile Overview

Greptile Summary

Updates the E2E test snapshot to align with the simplified search-replace error message format. The error message was simplified in PR #2367 when the fuzzy matching system was replaced with cascading exact matching.

Key Changes:

  • Removes "Best fuzzy match had similarity of 0.0% (threshold: 90.0%)" from error messages
  • Error now reads: "Search block did not match any content in the target file."
  • This change appears in two locations within the snapshot (lines 21 and 29)
  • The test validates the turbo edits search-replace fallback behavior when initial search-replace fails

Context:
The underlying implementation changed from Levenshtein distance-based fuzzy matching to a cascading exact match system (exact → trailing whitespace ignored → all edge whitespace ignored → unicode normalized). Since fuzzy matching with percentage similarity is no longer used, the error message was simplified to remove confusing percentage metrics.

Confidence Score: 5/5

  • This PR is safe to merge with no risk - it's a straightforward test snapshot update
  • The change is a necessary and correct E2E snapshot update following the implementation change in PR Add stringent search_replace tool for local agent #2367. The error message simplification accurately reflects the removal of fuzzy matching logic. All tests pass (654/654), and the change only affects test expectations, not production code.
  • No files require special attention

Important Files Changed

Filename Overview
e2e-tests/snapshots/turbo_edits_v2.spec.ts_turbo-edits-v2---search-replace-fallback-1.txt Updates E2E snapshot to reflect simplified error message format after removal of fuzzy match similarity percentage

Sequence Diagram

sequenceDiagram
    participant Test as E2E Test
    participant Agent as Turbo Edits Agent
    participant Processor as Search Replace Processor
    participant File as Target File

    Test->>Agent: Send "tc=turbo-edits-v2-trigger-fallback"
    Agent->>Processor: Attempt dyad-search-replace
    Processor->>File: Try to match search block
    File-->>Processor: No match found
    Processor-->>Agent: Error: "Search block did not match any content"
    Note over Processor: No fuzzy match % (simplified error)
    Agent->>Test: Return error message (user role)
    Agent->>Processor: Retry with dyad-read
    Agent->>Processor: Fallback to dyad-write
    Processor->>File: Write complete file content
    File-->>Processor: Success
    Processor-->>Agent: File updated
    Agent-->>Test: Complete with fallback success
Loading

Copy link
Copy Markdown
Contributor

@cubic-dev-ai cubic-dev-ai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 1 file

@wwwillchen wwwillchen merged commit e8ab08d into dyad-sh:main Jan 28, 2026
11 of 14 checks passed
@github-actions github-actions bot locked and limited conversation to collaborators Jan 28, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant