ScrapeIN SERP Google API returns results in HTML, JSON or CSV format.
Each JSON file includes technical information such as query parameters, execution time, navigation and pagination links, and other structured information from HTML. For each endpoint and the page itself, the main JSON blocks may be different. They are described in the relevant endpoint results sections below.
This page describes the technical blocks of JSON.
JSON Structure
The JSON object consists of several parts, including request info, search parameters, search metadata, search information and pagination. The request info provides details about the status of the request, including whether the request was successful, the remaining credits, and the number of credits used for the current request.
The JSON structure returned by the ScrapeIN SERP Google API contains the following elements:
request_info
- contains information about the request, including the number of credits used, remaining credits, and whether the request was successful.
success
- boolean value indicating whether the request was successful.topup_credits_remaining
- integer indicating the number of credits remaining in the user's account after the request.credits_used_this_request
- integer indicating the number of credits used for the current request.
request_parameters
- contains the search parameters used in the request. All possible search parameters described at this page.request_metadata
- contains metadata about the search, including the time it was created, processed, and the total time taken.
created_at
- the time the search was created.processed_at
- the time the search was processed.total_time_taken
- the total time taken to process the search.engine_url
- the URL used to perform the search.html_url
- the URL of the search results page in HTML format.json_url
- the URL of the search results page in JSON format.location_auto_message
- a message indicating whether the location used for the search was automatically set.
search_information
- contains information about the search, including the number of results, time taken, and the query displayed.
original_query_yields_zero_results
- boolean value indicating whether the original query returned any results.showing_results_for
- the query used to display the search results.total_results
- the total number of search results.time_taken_displayed
- the time taken to display the search results.query_displayed
- the query used to display the search results.
pagination
- contains information about the pagination of the search results.
current
- the current page number.next
- the URL of the next page of search results.other_pages
- contains details about other pages shown on the results page. The object is organized by page number with the Google URL as the value.api_pagination
- provides API links to request subsequent pages of results. It includes anext
property and another_pages
property for convenience.
JSON Example
{
"request_info": {
"success": true,
"topup_credits_remaining": 34279,
"credits_used_this_request": 1
},
"search_parameters": {
"q": "elon Musk",
"location": "United States",
"num": "10",
"output": "json",
"search_type": "news",
"engine": "google"
},
"search_metadata": {
"created_at": "2023-03-30T15:32:19.441Z",
"processed_at": "2023-03-30T15:33:35.085Z",
"total_time_taken": 75.64,
"engine_url": "https://www.google.com/search?q=elon+Musk&uule=w+CAIQICINVW5pdGVkIFN0YXRlcw&gl=us&hl=en&tbm=nws&num=10",
"html_url": "https://app.scrapein.app/api/v1/google/news/?q=elon+Musk&location=United+States&num=10&output=html&api_key={API-KEY}&search_type=news&engine=google",
"json_url": "https://app.scrapein.app/api/v1/google/news/?q=elon+Musk&location=United+States&num=10&output=json&api_key={API-KEY}&search_type=news&engine=google",
"location_auto_message": "We have automatically set the 'google_domain', 'gl' and 'hl' parameters to match the supplied location of 'United States'. You can stop this behaviour by setting the 'location_auto' parameter to 'false'."
},
"search_information": {
"original_query_yields_zero_results": false,
"total_results": 267000,
"time_taken_displayed": 0.55,
"query_displayed": "elon Musk"
},
{...},
"pagination": {
"current": 1,
"next": "https://www.google.com/search?q=elon+Musk&gl=us&hl=en&tbm=nws&ei=zaslZMK1Oc_DgQahxbvYBw&start=10&sa=N&ved=2ahUKEwiC0JyG_YP-AhXPYcAKHaHiDnsQ8NMDegQIBBAY",
"other_pages": [
{
"page": 2,
"link": "https://www.google.com/search?q=elon+Musk&gl=us&hl=en&tbm=nws&ei=zaslZMK1Oc_DgQahxbvYBw&start=10&sa=N&ved=2ahUKEwiC0JyG_YP-AhXPYcAKHaHiDnsQ8tMDegQIBBAG"
}
...
{
"page": 10,
"link": "https://www.google.com/search?q=elon+Musk&gl=us&hl=en&tbm=nws&ei=zaslZMK1Oc_DgQahxbvYBw&start=20&sa=N&ved=2ahUKEwiC0JyG_YP-AhXPYcAKHaHiDnsQ8tMDegQIBBAI"
}
],
"api_pagination": {
"next": "https://app.scrapein.app/api/v1/google/news/?q=elon%20Musk&location=United%20States&output=json&api_key={API-KEY}&search_type=news&id=req0&page=2",
"other_pages": [
{
"page": 2,
"link": "https://app.scrapein.app/api/v1/google/news/?q=elon%20Musk&location=United%20States&output=json&api_key={API-KEY}&search_type=news&id=req0&page=2"
}
...
{
"page": 10,
"link": "https://app.scrapein.app/api/v1/google/news/?q=elon%20Musk&location=United%20States&output=json&api_key={API-KEY}&search_type=news&id=req0&page=10"
}
]
}
}
}