JavaScript Links

The darc.sites.script module is customised to handle JavaScript links.

class darc.sites.script.Script

Bases: darc.sites._abc.BaseSite

JavaScript links.

static crawler(timestamp, session, link)

Crawler hook for JavaScript links.

Parameters

• timestamp (datetime) – Timestamp of the worker node reference.

• session (requests.Session) – Session object with proxy settings.

• link (Link) – Link object to be crawled.

Raises

LinkNoReturn – This link has no return response.

Return type

NoReturn

static loader(timestamp, driver, link)

Not implemented.

Raises

LinkNoReturn – This hook is not implemented.

Return type

NoReturn

Parameters

• timestamp (datetime.datetime) –

• driver (selenium.webdriver.chrome.webdriver.WebDriver) –

• link (darc.link.Link) –