JavaScript Links¶

The darc.sites.script module is customised to handle JavaScript links.

darc.sites.script.crawler(session, link)[source]¶

Crawler hook for JavaScript links.

Parameters
  • session (requests.Session) – Session object with proxy settings.

  • link (darc.link.Link) – Link object to be crawled.

Raises

LinkNoReturn – This link has no return response.

Return type

NoReturn

darc.sites.script.loader(driver, link)[source]¶

Not implemented.

Raises

LinkNoReturn – This hook is not implemented.

Parameters
  • driver (selenium.webdriver.chrome.webdriver.WebDriver) –

  • link (darc.link.Link) –

Return type

NoReturn

darc

Navigation

  • Darkweb Crawler Project
    • Main Processing
    • Web Crawlers
    • URL Utilities
    • Source Parsing
    • Source Saving
    • Link Database
    • Data Submission
    • Requests Wrapper
    • Selenium Wrapper
    • Proxy Utilities
    • Sites Customisation
    • Module Constants
    • Custom Exceptions
    • Data Models
  • Docker Integration
  • Web Backend Demo
  • Data Models Demo
  • Submission Data Schema
  • Auxiliary Scripts

Related Topics

  • Documentation overview
    • Darkweb Crawler Project
      • Sites Customisation
        • Previous: Email Addresses
        • Next: Telephone Numbers

Quick search

©2019-2020, Jarry Shaw. | Powered by Sphinx 3.2.1 & Alabaster 0.7.12 | Page source