Magnet Links¶

The darc.sites.magnet module is customised to handle magnet links.

class darc.sites.magnet.Magnet[source]¶

Bases: darc.sites._abc.BaseSite

Magnet links.

static crawler(timestamp, session, link)[source]¶

Crawler hook for magnet links.

Parameters
  • timestamp (datetime) – Timestamp of the worker node reference.

  • session (requests.Session) – Session object with proxy settings.

  • link (Link) – Link object to be crawled.

Raises

LinkNoReturn – This link has no return response.

Return type

NoReturn

static loader(timestamp, driver, link)[source]¶

Not implemented.

Raises

LinkNoReturn – This hook is not implemented.

Return type

NoReturn

Parameters
  • timestamp (datetime.datetime) –

  • driver (selenium.webdriver.chrome.webdriver.WebDriver) –

  • link (darc.link.Link) –

darc

Navigation

  • How to …
  • Technical Documentation
    • Main Processing
    • Web Crawlers
    • URL Utilities
    • Source Parsing
    • Source Saving
    • Link Database
    • Data Submission
    • Requests Wrapper
    • Selenium Wrapper
    • Proxy Utilities
    • Sites Customisation
    • Module Constants
    • Custom Exceptions
    • Data Models
  • Configuration
  • Customisations
  • Docker Integration
  • Web Backend Demo
  • Data Models Demo
  • Submission Data Schema
  • Auxiliary Scripts

Related Topics

  • Documentation overview
    • Technical Documentation
      • Sites Customisation
        • Previous: IRC Addresses
        • Next: Email Addresses

Quick search

©2019-2021, Jarry Shaw. | Page source
Fork me on GitHub