Domain Scanning

Domain Scanning

Find every page on the site, not just the ones you remember.

ChangeTower crawls the whole domain on the schedule you set and returns every page it finds, with a dated snapshot behind each one and a list you can export.

TARGET URL
Domain Scan
URL RULES
One URL to start with. Include and exclude rules are plain text strings, one per line, so a scan can cover the whole site or only the sections that matter.
MONITOR NAME
FOLDER
FREQUENCY
CRAWL SETTINGS
SAVE OPTIONS
Applies to every page the crawl reaches
The scan runs weekly, every 14 days or monthly, whichever you pick, and files itself into a folder with the rest of that account's work.
RUNFinished
Pages crawled
Pages processed
Check typeDomain Scan
Export
Every run lists each page it reached, with a dated snapshot behind it. Export the list, or turn the pages worth watching into monitors.

You cannot monitor a page you do not know is there.

A site grows one page at a time and nobody keeps the whole list in their head. ChangeTower crawls the domain and reports what is actually published.

Doing it by handWith a domain scan
Finding the pages
Someone lists the URLs they remember, or exports a sitemap that was last generated in March.
The crawler follows the site's own links and reports every page it actually reaches.
New pages
A page published last week gets watched whenever somebody happens to notice it.
The next run lists it, whether or not anyone mentioned it was coming.
Scope
The list is whatever one person had time to compile, and it drifts from then on.
Include and exclude strings set the scope once, and it holds on every run.
Keeping it current
Somebody re-checks the site when there is time, which is not a schedule.
Weekly, every 14 days or monthly, without anyone remembering to start it.
Proof of what was there
A screenshot somebody took, if they took one, saved wherever they saved it.
A dated snapshot of every page the crawl reached, kept on the terms you set.
Handing it over
The list lives in a spreadsheet on one person's laptop, and leaves when they do.
Export the run report, or point the team at the folder the scan lives in.

A crawl that knows your site better than your sitemap does.

Point it at one URL and it works out the rest of the site for itself, on the cadence you choose.

One URL, the whole site

Give the scan a starting URL and it follows the links from there across the domain, reporting every page it reaches rather than only the one you named.

Include and exclude rules

Narrow a scan to the parts of the site that matter. List the text strings a URL has to contain, or the ones it should skip, one per line.

Crawl settings that match your site

Strip query parameters, skip pages whose canonical tag points somewhere else, obey robots.txt, and read the sitemaps you already publish.

A dated snapshot of every page

Each page the crawl reaches is stored exactly as it was served, on every run or only on the runs that found a change, whichever you choose.

Retries for the pages that stall

Choose fixed, linear or exponential backoff on failed checks, so one slow response does not leave a page missing from the report.

Export the list

Take the full URL list out of the run report and share it with the team, or use it to decide which pages get a monitor of their own.

Three steps, and then it runs on its own.

Nothing to install, nothing to keep running, and no list of URLs to maintain by hand.

01

Point it at a domain

Enter the target URL. If you only want part of the site, open Advanced configuration and add include or exclude strings, one per line.

02

Set the cadence and the folder

Choose weekly, every 14 days or monthly, name the folder the scan belongs in, and pick who gets the email when a run finishes.

03

Read the run report

Every run lists each page it crawled, with a dated snapshot behind it. Export the list, or create monitors for the pages worth watching.

Domain scanning is available on the Enterprise plan.

View pricing →

The list matters most when nobody has one.

Every one of these starts the same way. Somebody needs to know what is on a site now, not what was on it when the list was written.

Agencies running client sites

One scan per client domain, each in its own folder. When a client asks what changed on their site this quarter, the run reports are already sitting there.

Compliance and legal teams

Disclosures, policies and terms move around a site as it is rebuilt. A scan scoped to /legal and /policies reports every page under them, with a dated snapshot of each.

Competitive intelligence

A competitor's pricing page is easy to find. The comparison page they built for one segment, the new integration listing and the quiet regional variant are not.

Sites nobody has a full map of

A site that has been through three CMS migrations and four marketing teams has pages nobody remembers publishing. The crawl reports what is actually served today.

Reviews

What Our Customers Say

4.6 / 5 on G2

“One of the most powerful website monitoring tools I have used. It detects even the smallest changes across text, images, and complex DOM structures — with impressive results tracking competitor pricing in real time.”

Corey M.Sr. Full Stack Developer
via G2

“ChangeTower lets me monitor changelogs, release notes, and pricing pages on competing products. The change detection is accurate and detailed — I can see exactly what was added or removed.”

Eric L.VP of Product, Mid-Market
via G2

“The ability to track dozens of competitor websites at once and tailor alert rules to each client is handy. Continually impressed with how it applies across very different industries.”

Daniel B.Managing Principal, Small-Business
via G2

“Creating monitors is very easy — I have around 200 active at any given time. I haven’t come across a webpage yet that I couldn’t get ChangeTower to work for.”

Alex Z.Project Manager, Enterprise
via G2

“I can’t say enough great things about the ChangeTower team. They took a problem I couldn’t solve and delivered results quickly and professionally. Highly recommend!”

Patrick B.Program Manager, Small-Business
via G2

“ChangeTower makes it easy to monitor competitor websites for updates. I love the visual differences that highlight exactly what’s changed. The alert system is reliable.”

Joe B.CFO, Mid-Market
via G2

“I use ChangeTower to monitor competitor brand pages and keep our own marketing content consistent across touchpoints. The notifications and team dashboard are very intuitive.”

Evan F.Director, Innovation Marketing
via G2

“ChangeTower helps us stay on top of compliance-related webpage changes. The real-time notifications are critical, letting us respond quickly when updates occur.”

Verified UserFinancial Services, Mid-Market
via G2

“One of the most powerful website monitoring tools I have used. It detects even the smallest changes across text, images, and complex DOM structures — with impressive results tracking competitor pricing in real time.”

Corey M.Sr. Full Stack Developer
via G2

“ChangeTower lets me monitor changelogs, release notes, and pricing pages on competing products. The change detection is accurate and detailed — I can see exactly what was added or removed.”

Eric L.VP of Product, Mid-Market
via G2

“The ability to track dozens of competitor websites at once and tailor alert rules to each client is handy. Continually impressed with how it applies across very different industries.”

Daniel B.Managing Principal, Small-Business
via G2

“Creating monitors is very easy — I have around 200 active at any given time. I haven’t come across a webpage yet that I couldn’t get ChangeTower to work for.”

Alex Z.Project Manager, Enterprise
via G2

“I can’t say enough great things about the ChangeTower team. They took a problem I couldn’t solve and delivered results quickly and professionally. Highly recommend!”

Patrick B.Program Manager, Small-Business
via G2

“ChangeTower makes it easy to monitor competitor websites for updates. I love the visual differences that highlight exactly what’s changed. The alert system is reliable.”

Joe B.CFO, Mid-Market
via G2

“I use ChangeTower to monitor competitor brand pages and keep our own marketing content consistent across touchpoints. The notifications and team dashboard are very intuitive.”

Evan F.Director, Innovation Marketing
via G2

“ChangeTower helps us stay on top of compliance-related webpage changes. The real-time notifications are critical, letting us respond quickly when updates occur.”

Verified UserFinancial Services, Mid-Market
via G2

Start with the pages you already know about.

Set up your first monitor in under 5 minutes. No credit card, no sales call.