Data sources
We load a wide variety of different data sources, some more common than others.
We'll get all the data your SEO teams in one place
The four data sources we get the most requests for are:
- Google Search Console
- Google Analytics
- Rank tracking
- Log Data
But we can integrate any kind of SEO data - everything from crawls & site speed to internal sales data. Let us know what you're trying to accomplish and we can advise and talk through it.
Breakdown
Backfilling Search Console
Google Search Console is a brilliant free tool, but if you're serious about search, you'll often bump into its limitations. You get a tiny fraction of the data in the interface.
The new BigQuery Search Console export Google have released is the best way to get data in the future. If you're reading this and haven't turned it on, please do so.
The primary caveat is it doesn't backfill. We'll backfill all your data and align it with your new ongoing data.
Then you're ready to dive in!
Working with Search Console data
Once your data is loaded, you need to be able to use it. We've got years of SEO and SQL expertise to help you get the most out of your data.
We can help you handle everything from basics like plotting clicks over time to complex questions like finding URLs which cannibalise.
We've got a query builder and reporting templates to help you get the most out of it.
Getting more data out of inspect
Search Console doesn't just have traffic data, you can also get indexability data from it.
We'll let you bulk extract this indexability data automatically to allow for larger scale analysis of indexation problems.
Log data at your fingertips
Log data is one of the most important data sources we have as SEOs.
Fixing crawling and indexing, understanding freshness, prioritising, debugging weird anomalies. It's brilliant at them.
But log files are large and need processing. We take care of all of that and give you easy access to all of it.
Processing the log data
We run DNS/ASN lookups on all our log data so you'll know what is actually coming from Google.
We'll work with your devs to get the log data and validate it, making sure you've got all the logs and no-one missed that Wordpress subfolder on your Magento site...
Raw unsampled data
If you're seeing weird numbers in Google Analytics, sampling is usually the first thing to check for.
And if you want to look at data over longer windows or with more complex questions, you'll find it samples a lot.
We download and store your data day by day, to help you avoid sampling.
Working with the raw export
The easiest way to get access to the raw, unlimited data from GA4 is with the BigQuery export.
It comes out as an event stream however and so you can't just query it like another data source it requires you to process and work with it.
We'll set-up your GA4 just like all our other data sources, build pipelines for it, plug it into reports and get it ready for easy ad-hoc analysis.
Working with analytics more quickly
Everytime you change anything in the Google Analytics interface it reloads your data.
Setting up and exploring data with it is slow. Exporting large reports from it is impossible. With Piped Out you can quickly have all the data ready to go with just a handful of clicks.
Tracking all parts of the SERP
We'll ingest rank tracking data from many of the big providers, but we primarily recommend Data For SEO.
It provides incredibly rich SERP data which allows you to dig into every part of the SERP, the PAA, the local pack, ratings snippets and everything else.
Rank tracking reports
To see the sort of things you can accomplish with the rich rank tracking model take a look at our example report templates.
Branded SERP Monitoring
Monitor and control your brand image on Google.Rank Tracking
Analyse rich rank tracking data.Own all your rank tracking data
if you decide to stop using us, all the data is in your warehouse, it's yours.
No more missing data because business requirements have changed.
Loading your crawl data
We can integrate with cloud crawling providers or we can help you set-up a process to load your local data (like Screaming Frog or Sitebulb crawls).
We can either store multiple crawls or just keep your most recent one to work with.
Better together
We focus on combining the crawl data with other data sources.
You can combine with backlinks, branded traffic, conversions, Google requests.
It'll make it easier to prioritise and you'll be able to find different opportunities.
Your own personal link database.
We can integrate with main link providers so you can keep all your sites' link data ready to access.
We'll help you work at scale across millions of backlinks for large websites and properties, with quick, easily repeatable analysis.
Joining links with other data sources
Links are good by themselves and even better with other data sources.
Trying to decide if you want to remove a site section? Go check traffic and links.
Looking to optimise internal links? Connect crawl data with link and select the pages with backlinks but few outlinks.
