Skip to main content
Moderne OnlyThis recipe is proprietary to Moderne and runs on the Moderne platform or CLI — it isn’t part of the open-source catalog. Available with a Moderne subscription.Contact Sales

Find similar code

Recipe IDio.moderne.prethink.quality.FindSimilarCode
Artifactio.moderne.recipe:rewrite-prethink

Detect structurally similar (but not identical) methods with MinHash/LSH near-duplicate matching over their AST shingles (zero AI), reporting an approximate similarity percentage. Complements exact duplicate detection by surfacing restructured near-duplicates worth consolidating.

Single recipeOpenRewriteModerne Proprietary License
Try in PlatformTry this recipe in the Moderne platform. Not a user yet? You’ll get a no-setup demo environment, with nothing to install or configure.

Options

9 parameters
9 optional
ParameterExampleTypeRequired
includeTestSourcesfalseBooleanOptional
Whether to include test sources (paths under src/test). Defaults to false.
maxMembersPerGroup200IntegerOptional
Cap on the number of member methods listed per group. Defaults to 200.
maxSimilarity99IntegerOptional
Maximum similarity (percentage) to report. Pairs more similar than this are exact or near-exact duplicates that exact clone detection already covers, so they are excluded here. Defaults to 99; set to 100 to include perfect matches.
minFeatures8IntegerOptional
Minimum number of distinct AST shingles a method must have to be considered. Defaults to 8.
minMethodMass40IntegerOptional
Minimum number of AST nodes a method must contain to be considered. Smaller methods have too few features for a meaningful similarity signal. Defaults to 40.
minShingleMass3IntegerOptional
Minimum number of AST nodes a subtree must contain to be used as a shingle (feature). Defaults to 3.
similarityThreshold70IntegerOptional
Minimum Jaccard similarity (as a percentage) for two methods to be considered similar. Defaults to 70.
snippetMaxLines40IntegerOptional
Maximum number of lines of the representative method to include in the snippet. Defaults to 40.
suppressBoilerplatetrueBooleanOptional
Whether to skip getters/setters, equals/hashCode/toString, and all-trivial methods. Defaults to true.

Examples

Example 1
ParameterValue
similarityThreshold50
maxSimilarity99
minMethodMass15
minFeatures3
minShingleMass3
includeTestSourcesfalse
suppressBoilerplatetrue
snippetMaxLines40
maxMembersPerGroup200
Unchanged
package com.example;

public class SimA {
public int summarize(java.util.List<String> items) {
int total = 0;
int count = 0;
for (String s : items) {
total = total + s.length();
count = count + 1;
}
return total - count;
}
}

Usage

Run this recipe

This recipe has no required configuration options. Users of Moderne can run it via the Moderne CLI.

You will need to have configured the Moderne CLI on your machine before you can run the following command.

shell
mod run . --recipe FindSimilarCode

If the recipe is not available locally, then you can install it using:

mod config recipes jar install io.moderne.recipe:rewrite-prethink:0.9.0

Data tables

Similar code
io.moderne.prethink.table.SimilarCode

Groups of structurally similar methods detected by MinHash/LSH near-duplicate matching, with an approximate similarity percentage. Complements exact duplicate detection by finding restructured near-duplicates.

ColumnDescription
Similar group idStable identifier for the group of similar methods.
Method countNumber of similar methods in the group.
SimilarityAverage pairwise similarity (Jaccard over AST shingles, as a percentage) of the verified edges that formed the group.
Source pathPath of the representative method.
TypeFully qualified name of the class enclosing the representative method.
MethodName of the representative method.
SnippetThe representative method, truncated for large fragments.
LinesLine count of the representative method.
MembersNewline-separated list of the similar methods (path :: enclosingType#method).
Source files that had results
org.openrewrite.table.SourcesFileResults

Source files that were modified by the recipe run.

ColumnDescription
Source path before the runThe source path of the file before the run. null when a source file was created during the run.
Source path after the runA recipe may modify the source path. This is the path after the run. null when a source file was deleted during the run.
Parent of the recipe that made changesIn a hierarchical recipe, the parent of the recipe that made a change. Empty if this is the root of a hierarchy or if the recipe is not hierarchical at all.
Recipe that made changesThe specific recipe that made a change.
Estimated time savingAn estimated effort that a developer to fix manually instead of using this recipe, in unit of seconds.
CycleThe recipe cycle in which the change was made.
Source files that had search results
org.openrewrite.table.SearchResults

Search results that were found during the recipe run.

ColumnDescription
Source path of search result before the runThe source path of the file with the search result markers present.
Source path of search result after run the runA recipe may modify the source path. This is the path after the run. null when a source file was deleted during the run.
ResultThe trimmed printed tree of the LST element that the marker is attached to.
DescriptionThe content of the description of the marker.
Recipe that added the search markerThe specific recipe that added the Search marker.
Source files that errored on a recipe
org.openrewrite.table.SourcesFileErrors

The details of all errors produced by a recipe run.

ColumnDescription
Source pathThe file that failed to parse.
Recipe that made changesThe specific recipe that made a change.
Stack traceThe stack trace of the failure.
Recipe performance
org.openrewrite.table.RecipeRunStats

Statistics used in analyzing the performance of recipes.

ColumnDescription
The recipeThe recipe whose stats are being measured both individually and cumulatively.
Source file countThe number of source files the recipe ran over.
Source file changed countThe number of source files which were changed in the recipe run. Includes files created, deleted, and edited.
Cumulative scanning time (ns)The total time spent across the scanning phase of this recipe.
Max scanning time (ns)The max time scanning any one source file.
Cumulative edit time (ns)The total time spent across the editing phase of this recipe.
Max edit time (ns)The max time editing any one source file.