Scrape Semrush Public Pages With Rendering Built In
Scrape Semrush's public surface, the portion of their data that doesn't require a paid Semrush subscription.
Key Benefits:
Sign up with Google
based on 100+ reviews.
Mike Ritchie
CEO @ SeekWell
ScrapingBee simplified our day-to-day marketing and engineering operations a lot. We no longer have to worry about managing our own fleet of headless browsers, and we no longer have to spend days sourcing the right proxy provider
Three Ways Developers Scrape Semrush
Three workflows teams build with the Semrush scraper: tracking competitor keyword rankings, monitoring backlink profile changes, and aggregating SERP feature data across markets.
Track domain authority
Pull domain Authority Score, top organic keywords, and backlink count previews from Semrush's free Domain Overview tool. Build a competitor-authority leaderboard without paying for Semrush seats.
Extract keyword rankings
Extract keyword rankings to enhance competitor analysis, identify market trends, and refine SEO strategies, driving informed business decisions effectively.
Analyze competitor backlinks
Pull backlink counts, referring domains, and top anchor texts from any competitor's profile. Build link-gap datasets for outreach and authority-tracking workflows.
Transparent Semrush Scraper API pricing
Cancel anytime, no questions asked!
Need more credits and concurrency per month?
(No credit card required)
How Semrush API works
Manually collecting data from Semrush is slow, limited and hard to scale. That's why more and more teams choose our API.
Create an account - get instant access to API key and 1,000 free credits to get started
Install our Python SDK (or Node, Go, PHP, Ruby - pick your stack). Each Semrush scrape becomes a single function call. No proxy rotation, no headless Chrome to manage.
POST or GET the Semrush URL to our API. We render public pages on Semrush.com, handle anti-bot, and return rendered HTML (or structured JSON via extract_rules or ai_extract_rules).
When Semrush pages need more, gain advanced parameters. render_js for JavaScript, stealth_proxy for CAPTCHAs, country_code for geo-targeting, ai_extract_rules for natural-language data extraction.
Semrush Scraper API - Built for Semrush's Anti-Bot Stack
Pull Semrush public-surface pages at scale. Domain Authority Score, top organic keywords preview, backlink count snapshot, traffic estimate, and competitor profile all parse in one call.
Send a natural-language spec via ai_extract_rules and get structured JSON of Semrush public metrics back, no selectors required.
AI Web Scraping
Capture full-page Semrush screenshots through our Screenshot API. Useful for visual reports of competitor profiles.
Screenshot API
Scrape Google search to extract Semrush search results, enabling you to efficiently analyze and gather data for your digital marketing strategies.
Explore Google Search API
Click, scroll, wait for dynamic content to appear, or just run some custom JavaScript code. Our JavaScript scenarios simulate real user behavior.
JavaScript Scraping API
Pull Semrush public pages as clean Markdown, ready to feed into an LLM for SEO-competitor summaries or backlink-analysis workflows.
Markdown Scraper API
Scrape Semrush by using our no-code automation feature, allowing you to create automated workflows with n8n and our API for data extraction.
n8n Scraper
Trusted by 4,000+ developers and data teams
Scraping is 50% dealing with ever-changing HTML files and 50% massaging data into a useable format. ScrapingBee’s incredible AI feature can do both much better than I ever could. Now I can spend 100% of my time on what matters most; my business.
Arvid Kahl,
Founder at Podscan
ScrapingBee helps us to retrieve information from sites that use very sophisticated mechanism to block unwanted traffic, we were struggling with those sites for some time now and I'm very glad that we found ScrapingBee.
Anton R,
CTO
ScrapingBee clear documentation, easy-to-use API, and great success rate made it a no-brainer.
Dominic Phillips,
Co-Founder at CodeSubmit
I'm a PhD candidate with absolutely no web scraping experience and needed to scrape some data for a dissertation project. ScrapingBee helped me get the job done quickly and easily. Excellent customer support too. Couldn't be happier!
Sam,
PhD candidate
So easy to set-up, straightforward and performance. They are reachable and kind, they introduced us properly their tool and offered the best solution for our need.
Maxime Y,
Product Manager @ NordFolk
Great SaaS tool for legitimate scraping and data extraction. ScrapingBee makes it easy to automatically pull down data from the sites that publish periodic data in a human-readable format.
Andy Hawkes,
Founder at Loadster
Good experience. I found this proxy service more effective compared to previous ones that were being used. It is fast and efficient.
Aayushi,
Senior analyst
Fantastic service: works flawlessly, best support I've experienced. It just works: and its parsing meta-language is wonderfully powerful. Most importantly, the support I've received has been superlative.
Mike P.,
VP
Excellent service, glad we made the switch! We could always dedicate resources and build our own systems for everything... or we could simply call the scrapingBee API and focus on the data. It makes our work so much easier.
Daniel L,
Lead dev
Recognized for excellence
in web scraping
You're in great company
3,500+ developers use ScrapingBee to handle proxies, browsers, and anti-bot bypass.
What You Can Pull from Semrush
Every Semrush public page returns Authority Score, top organic keywords preview, backlink count snapshot, traffic estimate, and competitor list.
Setup in Under Five Minutes
Six SDKs (Python, Node.js, Go, PHP, Ruby, Java) plus raw cURL examples. Get from docs to first request in under five minutes.
DocumentationSemrush URL In. Structured Data Out
Our API ingests Semrush URLs plus your extraction logic. JS renders behind the scenes, you receive clean structured output.
Web Scraping API
ScrapingBee in numbers
Developer Experience
Top-rated support &
documentation
Our team is here to guide you when you need the extra assistance. And we're constantly working on new features to make your life easier.
Fantastic documentation
Take a look at our documentation and get started in minutes!
Code samples
Whatever the programming language you enjoy, we have written code examples in Java, Python, Go, PHP, cURL and JavaScript.
Knowledge base
Our extensive knowledge base covers the most frequent use cases with code samples.
Exceptional support
Fast, engineer-led support via live chat or email
Explore web scraping insights
Check out our documentation to find out more on how to utilise our API for your scraping needs.
AI Data Extraction
JS Rendering
Stealth Proxy
Screenshots
Custom Cookies
Download Images
More markets. More opportunities.
Expand your data collection beyond this scraper.
Why ScrapingBee?
The most reliable web scraping API, trusted by 4,000+ developers worldwide.
- Data analysts
- Growth teams
- Developers
- E-commerce businesses
GDPR and CCPA compliant
ScrapingBee does not collect or store personal data from scraped sites unless their user explicitly requests it.
CAPTCHA bypass capacity
We handle proxy rotation to avoid IP-based blocking. With headless browser rendering, we mimic real user browsing behaviour and reduce the blocking risk.
Scalable
The platform scales smoothly with thousands of headless browsers and rotating proxies, ensuring fast, reliable performance even during traffic spikes.
Speed and accuracy
We deliver fast, reliable results in 1-5 seconds with high accuracy across most sites, even JavaScript-heavy ones.
Semrush Scraper FAQs
No external account required. Sign up for one of our API keys (1,000 free credits, no card), send the URL, and we handle the rest.