DataForSEO On Page Content Parsing

From 0.2 credits/call
ae_dataforseo_on_page_content_parsing

Extract structured text, headings, and links from any webpage URL using DataForSEO.

Productivity
From 0.2 credits/call

Pricing

From 0.2 credits/call
ConditionCharge
JavaScript rendering disabled (default)0.2 credits/call
JavaScript rendering enabled1.8 credits/call

Charges depend on whether JavaScript rendering is enabled.

The starting price applies when JavaScript rendering is disabled.

Parameters

Optional parameters use the platform defaults when omitted.

ParameterTypeRequiredDescriptionDefault
tasksarrayYesNo parameter description.—
tasks[].urlstringNo<em>URL of the content to parse</em><br><strong>required field</strong><br>URL of the page to parse<br>example:<br>`https://www.fujielectric.com/`—
tasks[].enable_xhrboolean | nullNoNo parameter description.—
tasks[].switch_poolboolean | nullNoNo parameter description.—
tasks[].markdown_viewboolean | nullNoNo parameter description.—
tasks[].browser_presetstring | nullNoNo parameter description.—
tasks[].store_raw_htmlboolean | nullNoNo parameter description.—
tasks[].accept_languagestring | nullNoNo parameter description.—
tasks[].ip_pool_for_scanstring | nullNoNo parameter description.—
tasks[].custom_user_agentstring | nullNoNo parameter description.—
tasks[].enable_javascriptboolean | nullNoNo parameter description.—
tasks[].browser_screen_widthinteger | nullNoNo parameter description.—
tasks[].disable_cookie_popupboolean | nullNoNo parameter description.—
tasks[].browser_screen_heightinteger | nullNoNo parameter description.—
tasks[].enable_browser_renderingboolean | nullNoNo parameter description.—
tasks[].browser_screen_scale_factornumber | nullNoNo parameter description.—

Invocation example

Copy the request and explore its response example.

POST/agent-api/v1/tool/executeX-Api-Key
Request coderequest.sh
curl --request POST \
  --url 'https://agentearth.ai/agent-api/v1/tool/execute?tool_name=ae_dataforseo_on_page_content_parsing' \
  --header "X-Api-Key: $AGENTEARTH_API_KEY" \
  --header 'Content-Type: application/json' \
  --data-raw '{
  "params": {
    "tasks": [
      {
        "accept_language": "en",
        "markdown_view": true,
        "url": "https://www.siemens.com/en-gb/products/medium-voltage-power-distribution/gm-sg-switchgear/"
      }
    ]
  }
}'
Response exampleresponse.json
JSONPartial content
{
  "cost": 0.00015,
  "status_code": 20000,
  "status_message": "Ok.",
  "tasks": [
    {
      "cost": 0.00015,
      "data": {
        "accept_language": "en",
        "api": "on_page",
        "function": "content_parsing",
        "markdown_view": true,
        "url": "https://www.siemens.com/en-gb/products/medium-voltage-power-distribution/gm-sg-switchgear/"
      },
      "id": "11110853-2802-0495-0000-72e2abded1a2",
      "path": [
        "v3"
      ],
      "result": [
        {
          "crawl_progress": "finished",
          "crawl_status": null,
          "items": [
            {}
          ],
          "items_count": 1
        }
      ],
      "result_count": 1
    }
  ],
  "tasks_count": 1,
  "tasks_error": 0
}

This example shows part of the response. Copied content is valid JSON.