Suggest an affordable SEO metrics API for 10M+ requests/month? .. for our live auction feed

[HelmutsHelmuts is verified member.]

We’re building a live auction feed and need to enrich a large volume of domains with SEO-style metrics (e.g. backlinks, referring domains, authority/trust-type scores, etc.) so buyers can quickly evaluate names.

Right now we’re already doing around 10 million API requests per month across various domains — and this will likely increase as we expand coverage and add more marketplaces.

Price is the biggest factor.

We currently use Majestic, but we’ve outgrown our existing agreement by 10x+, so we’re looking for more scalable and affordable options (or smarter approaches).

What API services do you use/recommend for pulling backlink + authority metrics at this kind of volume?

Bonus points if you can share:

• what you’re paying (even rough ranges are helpful)
• reliability/coverage at scale
• bulk endpoints / batching options
• rate limits you’ve hit in real life
• cost-saving tactics (caching, refresh frequency, prefetching, etc.)

Any advice from people running high-volume domain tools would be hugely appreciated.

Tx!! Helmuts

 

[HelmutsHelmuts is verified member.]

.. yes, we are even considering developing and self-hosting an seo tool, if unable to find any affordable solutions

 

[accurate]

DataForSEO maybe.

That's a lot of requests a month.

 

[HelmutsHelmuts is verified member.]

DataForSEO maybe.

That's a lot of requests a month.

Price per task: $0.1
Price per item: $0.001
= approx. $1,100 for 1M domains
ref: https://dataforseo.com/pricing/domain-analytics-api/domain-analytics-whois-api

x 10 (10 mil requests/month) = approx. $11,000/month

.. we don't have such income

 

[accurate]

Reachout and negotiate the price. @Helmuts

I'm sure at that level you can knock down the costs.

 

[cactusfly]

@DNF Admin

Noticed a small issue in "Live Auction Feed".

After filtering the content, when I navigate to Page2, it doesn't match the current filters. Did you see that?

c/ @Helmuts

 

[HelmutsHelmuts is verified member.]

@DNF Admin

Noticed a small issue in "Live Auction Feed".

After filtering the content, when I navigate to Page2, it doesn't match the current filters. Did you see that?

c/ @Helmuts

@DNF Admin can you please check it?

@cactusfly - thank you!!

 

[HelmutsHelmuts is verified member.]

Reachout and negotiate the price. @Helmuts

I'm sure at that level you can knock down the costs.

Yes, of course.. though it needs to make business sense - we can't spend more than we take in for ads + wages + server cost

another option is going hardcore and creating our own solition.. in this case we would need to start with having 200-300 TB disk space for the starters that would gradually grow to 1 petbyte.. so many things to be considered..

--

as for the development, @birajst is working on our own dotbd alternative.. and he has almost filled the 1Tb disk space of the dedicated server (allocated to this) playing with zone files.. and we haven't even started digging into ccTLD zone files.. just Gs

exciting times