Skip to main content

Web Reader

Enter a valid URL and the node will retrieve the data from this URL.

Retrieve textual content from an URL.

Web Reader
Url*Text
Loading ModeSelect
With Html TagsToggle
With Html AttributesToggle
SelectorsList
Selectors To RemoveList
Wait For Idle NetworkToggle
Fields marked * are required. Dots are connection handles.

Inputs

Each input can be typed in directly or connected to another node's output.

InputTypeRequiredDescription
UrlTextRequiredInput a URL

Settings

SettingTypeDefaultDescriptionAvailable when
Loading ModeSelectautoChoose to load the website in a browser, or just using an HTTP GET request. Auto mode tries with a GET first, and if the results are not satisfactory, it will load in a browser.
With Html TagsToggle
With Html AttributesToggleWith Html Tags is on
SelectorsListSpecifies that the process will wait for the provided selectors to appear on the page and extract their content. This ensures the required elements are available before proceeding.
Selectors To RemoveListdiv .article #id
Wait For Idle NetworkToggleOffWaits for up to 5 seconds to ensure the page has finished loading all necessary content. If the page is still busy after this time, the process will continue anyway. This can be helpful for pages that show a cookie consent popup or reload themselves after you interact with them.Loading Mode is “Browser”

Loading Mode options

OptionDefault
Auto
Browser
HTTP Get

Output

Type: Text (text)