As a library developer, it’s possible you’ll create a well-liked utility that tons of of
hundreds of builders depend on each day, corresponding to lodash or React. Over time,
utilization patterns would possibly emerge that transcend your preliminary design. When this
occurs, it’s possible you’ll want to increase an API by including parameters or modifying
perform signatures to repair edge circumstances. The problem lies in rolling out
these breaking modifications with out disrupting your customers’ workflows.
That is the place codemods are available in—a strong device for automating
large-scale code transformations, permitting builders to introduce breaking
API modifications, refactor legacy codebases, and preserve code hygiene with
minimal guide effort.
On this article, we’ll discover what codemods are and the instruments you possibly can
use to create them, corresponding to jscodeshift, hypermod.io, and codemod.com. We’ll stroll by means of real-world examples,
from cleansing up characteristic toggles to refactoring element hierarchies.
You’ll additionally discover ways to break down complicated transformations into smaller,
testable items—a observe generally known as codemod composition—to make sure
flexibility and maintainability.
By the tip, you’ll see how codemods can turn into an important a part of your
toolkit for managing large-scale codebases, serving to you retain your code clear
and maintainable whereas dealing with even essentially the most difficult refactoring
duties.
Breaking Adjustments in APIs
Returning to the situation of the library developer, after the preliminary
launch, new utilization patterns emerge, prompting the necessity to prolong an
For easy modifications, a fundamental find-and-replace within the IDE would possibly work. In
extra complicated circumstances, you would possibly resort to utilizing instruments like sed
or awk
. Nonetheless, when your library is broadly adopted, the
scope of such modifications turns into more durable to handle. You’ll be able to’t make sure how
extensively the modification will affect your customers, and the very last thing
you need is to interrupt present performance that doesn’t want
updating.
A standard strategy is to announce the breaking change, launch a brand new
model, and ask customers emigrate at their very own tempo. However this workflow,
whereas acquainted, typically would not scale properly, particularly for main shifts.
Contemplate React’s transition from class elements to perform elements
with hooks—a paradigm shift that took years for big codebases to completely
undertake. By the point groups managed emigrate, extra breaking modifications have been
typically already on the horizon.
For library builders, this example creates a burden. Sustaining
a number of older variations to assist customers who haven’t migrated is each
pricey and time-consuming. For customers, frequent modifications threat eroding belief.
They could hesitate to improve or begin exploring extra steady alternate options,
which perpetuating the cycle.
However what when you might assist customers handle these modifications mechanically?
What when you might launch a device alongside your replace that refactors
their code for them—renaming features, updating parameter order, and
eradicating unused code with out requiring guide intervention?
That’s the place codemods are available in. A number of libraries, together with React
and Subsequent.js, have already embraced codemods to clean the trail for model
bumps. For instance, React offers codemods to deal with the migration from
older API patterns, just like the previous Context API, to newer ones.
So, what precisely is the codemod we’re speaking about right here?
What’s a Codemod?
A codemod (code modification) is an automatic script used to rework
code to observe new APIs, syntax, or coding requirements. Codemods use
Summary Syntax Tree (AST) manipulation to use constant, large-scale
modifications throughout codebases. Initially developed at Fb, codemods helped
engineers handle refactoring duties for big tasks like React. As
Fb scaled, sustaining the codebase and updating APIs turned
more and more troublesome, prompting the event of codemods.
Manually updating hundreds of information throughout completely different repositories was
inefficient and error-prone, so the idea of codemods—automated scripts
that remodel code—was launched to sort out this drawback.
The method sometimes includes three primary steps:
- Parsing the code into an AST, the place every a part of the code is
represented as a tree construction. - Modifying the tree by making use of a change, corresponding to renaming a
perform or altering parameters. - Rewriting the modified tree again into the supply code.
Through the use of this strategy, codemods make sure that modifications are utilized
constantly throughout each file in a codebase, lowering the prospect of human
error. Codemods may deal with complicated refactoring eventualities, corresponding to
modifications to deeply nested buildings or eradicating deprecated API utilization.
If we visualize the method, it could look one thing like this:
Determine 1: The three steps of a typical codemod course of
The concept of a program that may “perceive” your code after which carry out
computerized transformations isn’t new. That’s how your IDE works whenever you
run refactorings like
Basically, your IDE parses the supply code into ASTs and applies
predefined transformations to the tree, saving the end result again into your
information.
For contemporary IDEs, many issues occur below the hood to make sure modifications
are utilized accurately and effectively, corresponding to figuring out the scope of
the change and resolving conflicts like variable title collisions. Some
refactorings even immediate you to enter parameters, corresponding to when utilizing
order of parameters or default values earlier than finalizing the change.
Use jscodeshift in JavaScript Codebases
Let’s take a look at a concrete instance to grasp how we might run a
codemod in a JavaScript undertaking. The JavaScript group has a number of
instruments that make this work possible, together with parsers that convert supply
code into an AST, in addition to transpilers that may remodel the tree into
different codecs (that is how TypeScript works). Moreover, there are
instruments that assist apply codemods to complete repositories mechanically.
One of the vital fashionable instruments for writing codemods is jscodeshift, a toolkit maintained by Fb.
It simplifies the creation of codemods by offering a strong API to
manipulate ASTs. With jscodeshift, builders can seek for particular
patterns within the code and apply transformations at scale.
You should utilize jscodeshift
to determine and exchange deprecated API calls
with up to date variations throughout a whole undertaking.
Let’s break down a typical workflow for composing a codemod
manually.
Clear a Stale Characteristic Toggle
Let’s begin with a easy but sensible instance to exhibit the
energy of codemods. Think about you’re utilizing a feature
toggle in your
codebase to regulate the discharge of unfinished or experimental options.
As soon as the characteristic is dwell in manufacturing and dealing as anticipated, the subsequent
logical step is to wash up the toggle and any associated logic.
As an example, think about the next code:
const knowledge = featureToggle('feature-new-product-list') ? { title: 'Product' } : undefined;
As soon as the characteristic is absolutely launched and not wants a toggle, this
will be simplified to:
const knowledge = { title: 'Product' };
The duty includes discovering all cases of featureToggle
within the
codebase, checking whether or not the toggle refers to
feature-new-product-list
, and eradicating the conditional logic surrounding
it. On the similar time, different characteristic toggles (like
feature-search-result-refinement
, which can nonetheless be in growth)
ought to stay untouched. The codemod must perceive the construction
of the code to use modifications selectively.
Understanding the AST
Earlier than we dive into writing the codemod, let’s break down how this
particular code snippet seems to be in an AST. You should utilize instruments like AST
Explorer to visualise how supply code and AST
are mapped. It’s useful to grasp the node varieties you are interacting
with earlier than making use of any modifications.
The picture under exhibits the syntax tree when it comes to ECMAScript syntax. It
incorporates nodes like Identifier
(for variables), StringLiteral
(for the
toggle title), and extra summary nodes like CallExpression
and
ConditionalExpression
.
Determine 2: The Summary Syntax Tree illustration of the characteristic toggle examine
On this AST illustration, the variable knowledge
is assigned utilizing a
ConditionalExpression
. The check a part of the expression calls
featureToggle('feature-new-product-list')
. If the check returns true
,
the consequent department assigns { title: 'Product' }
to knowledge
. If
false
, the alternate department assigns undefined
.
For a process with clear enter and output, I want writing checks first,
then implementing the codemod. I begin by defining a unfavorable case to
guarantee we don’t by chance change issues we need to go away untouched,
adopted by an actual case that performs the precise conversion. I start with
a easy situation, implement it, then add a variation (like checking if
featureToggle known as inside an if assertion), implement that case, and
guarantee all checks go.
This strategy aligns properly with Test-Driven Development (TDD), even
when you don’t observe TDD frequently. Realizing precisely what the
transformation’s inputs and outputs are earlier than coding improves security and
effectivity, particularly when tweaking codemods.
With jscodeshift, you possibly can write checks to confirm how the codemod
behaves:
const remodel = require("../remove-feature-new-product-list"); defineInlineTest( remodel, {}, ` const knowledge = featureToggle('feature-new-product-list') ? { title: 'Product' } : undefined; `, ` const knowledge = { title: 'Product' }; `, "delete the toggle feature-new-product-list in conditional operator" );
The defineInlineTest
perform from jscodeshift means that you can outline
the enter, anticipated output, and a string describing the check’s intent.
Now, working the check with a standard jest
command will fail as a result of the
codemod isn’t written but.
The corresponding unfavorable case would make sure the code stays unchanged
for different characteristic toggles:
defineInlineTest( remodel, {}, ` const knowledge = featureToggle('feature-search-result-refinement') ? { title: 'Product' } : undefined; `, ` const knowledge = featureToggle('feature-search-result-refinement') ? { title: 'Product' } : undefined; `, "don't change different characteristic toggles" );
Writing the Codemod
Let’s begin by defining a easy remodel perform. Create a file
known as remodel.js
with the next code construction:
module.exports = perform(fileInfo, api, choices) { const j = api.jscodeshift; const root = j(fileInfo.supply); // manipulate the tree nodes right here return root.toSource(); };
This perform reads the file right into a tree and makes use of jscodeshift’s API to
question, modify, and replace the nodes. Lastly, it converts the AST again to
supply code with .toSource()
.
Now we will begin implementing the remodel steps:
- Discover all cases of
featureToggle
. - Confirm that the argument handed is
'feature-new-product-list'
. - Substitute your entire conditional expression with the consequent half,
successfully eradicating the toggle.
Right here’s how we obtain this utilizing jscodeshift
:
module.exports = perform (fileInfo, api, choices) { const j = api.jscodeshift; const root = j(fileInfo.supply); // Discover ConditionalExpression the place the check is featureToggle('feature-new-product-list') root .discover(j.ConditionalExpression, { check: { callee: { title: "featureToggle" }, arguments: [{ value: "feature-new-product-list" }], }, }) .forEach((path) => { // Substitute the ConditionalExpression with the 'consequent' j(path).replaceWith(path.node.consequent); }); return root.toSource(); };
The codemod above:
- Finds
ConditionalExpression
nodes the place the check calls
featureToggle('feature-new-product-list')
. - Replaces your entire conditional expression with the resultant (i.e.,
{
), eradicating the toggle logic and leaving simplified code
title: 'Product' }
behind.
This instance demonstrates how straightforward it’s to create a helpful
transformation and apply it to a big codebase, considerably lowering
guide effort.
You’ll want to jot down extra check circumstances to deal with variations like
if-else
statements, logical expressions (e.g.,
!featureToggle('feature-new-product-list')
), and so forth to make the
codemod strong in real-world eventualities.
As soon as the codemod is prepared, you possibly can check it out on a goal codebase,
such because the one you are engaged on. jscodeshift offers a command-line
device that you need to use to use the codemod and report the outcomes.
$ jscodeshift -t transform-name src/
After validating the outcomes, examine that every one practical checks nonetheless
go and that nothing breaks—even when you’re introducing a breaking change.
As soon as glad, you possibly can commit the modifications and lift a pull request as
a part of your regular workflow.
Codemods Enhance Code High quality and Maintainability
Codemods aren’t simply helpful for managing breaking API modifications—they’ll
considerably enhance code high quality and maintainability. As codebases
evolve, they typically accumulate technical debt, together with outdated characteristic
toggles, deprecated strategies, or tightly coupled elements. Manually
refactoring these areas will be time-consuming and error-prone.
By automating refactoring duties, codemods assist hold your codebase clear
and freed from legacy patterns. Often making use of codemods means that you can
implement new coding requirements, take away unused code, and modernize your
codebase with out having to manually modify each file.
Refactoring an Avatar Part
Now, let’s take a look at a extra complicated instance. Suppose you’re working with
a design system that features an Avatar
element tightly coupled with a
Tooltip
. At any time when a person passes a title
prop into the Avatar
, it
mechanically wraps the avatar with a tooltip.
Determine 3: A avatar element with a tooltip
Right here’s the present Avatar
implementation:
import { Tooltip } from "@design-system/tooltip"; const Avatar = ({ title, picture }: AvatarProps) => { if (title) { return ( <Tooltip content material={title}> <CircleImage picture={picture} /> </Tooltip> ); } return <CircleImage picture={picture} />; };
The purpose is to decouple the Tooltip
from the Avatar
element,
giving builders extra flexibility. Builders ought to be capable to resolve
whether or not to wrap the Avatar
in a Tooltip
. Within the refactored model,
Avatar
will merely render the picture, and customers can apply a Tooltip
manually if wanted.
Right here’s the refactored model of Avatar
:
const Avatar = ({ picture }: AvatarProps) => { return <CircleImage picture={picture} />; };
Now, customers can manually wrap the Avatar
with a Tooltip
as
wanted:
import { Tooltip } from "@design-system/tooltip"; import { Avatar } from "@design-system/avatar"; const UserProfile = () => { return ( <Tooltip content material="Juntao Qiu"> <Avatar picture="/juntao.qiu.avatar.png" /> </Tooltip> ); };
The problem arises when there are tons of of Avatar usages unfold
throughout the codebase. Manually refactoring every occasion can be extremely
inefficient, so we will use a codemod to automate this course of.
Utilizing instruments like AST Explorer, we will
examine the element and see which nodes signify the Avatar
utilization
we’re focusing on. An Avatar
element with each title
and picture
props
is parsed into an summary syntax tree as proven under:
Determine 4: AST of the Avatar element utilization
Writing the Codemod
Let’s break down the transformation into smaller duties:
- Discover
Avatar
utilization within the element tree. - Test if the
title
prop is current. - If not, do nothing.
- If current:
- Create a
Tooltip
node. - Add the
title
to theTooltip
. - Take away the
title
fromAvatar
. - Add
Avatar
as a baby of theTooltip
. - Substitute the unique
Avatar
node with the brand newTooltip
.
To start, we’ll discover all cases of Avatar (I’ll omit a few of the
checks, however it’s best to write comparability checks first).
defineInlineTest(
{ default: remodel, parser: "tsx" },
{},
`
<Avatar title="Juntao Qiu" picture="/juntao.qiu.avatar.png" />
`,
`
<Tooltip content material="Juntao Qiu">
<Avatar picture="/juntao.qiu.avatar.png" />
</Tooltip>
`,
"wrap avatar with tooltip when title is offered"
);
Much like the featureToggle
instance, we will use root.discover
with
search standards to find all Avatar nodes:
root .discover(j.JSXElement, { openingElement: { title: { title: "Avatar" } }, }) .forEach((path) => { // now we will deal with every Avatar occasion });
Subsequent, we examine if the title
prop is current:
root
.discover(j.JSXElement, {
openingElement: { title: { title: "Avatar" } },
})
.forEach((path) => {
const avatarNode = path.node;
const nameAttr = avatarNode.openingElement.attributes.discover(
(attr) => attr.title.title === "title"
);
if (nameAttr) {
const tooltipElement = createTooltipElement(
nameAttr.worth.worth,
avatarNode
);
j(path).replaceWith(tooltipElement);
}
});
For the createTooltipElement
perform, we use the
jscodeshift API to create a brand new JSX node, with the title
prop utilized to the Tooltip
and the Avatar
element as a baby. Lastly, we name replaceWith
to
exchange the present path
.
Right here’s a preview of the way it seems to be in
Hypermod, the place the codemod is written on
the left. The highest half on the precise is the unique code, and the underside
half is the remodeled end result:
Determine 5: Run checks inside hypermod earlier than apply it to your codebase
This codemod searches for all cases of Avatar
. If a
title
prop is discovered, it removes the title
prop
from Avatar
, wraps the Avatar
inside a
Tooltip
, and passes the title
prop to the
Tooltip
.
By now, I hope it’s clear that codemods are extremely helpful and
that the workflow is intuitive, particularly for large-scale modifications the place
guide updates can be an enormous burden. Nonetheless, that is not the entire
image. Within the subsequent part, I’ll make clear a few of the challenges
and the way we will tackle these less-than-ideal points.