core_utils package

Submodules

ConfigDTO class implementation: stores the configuration information.

class core_utils.ctlr.config_dto.ConfigDTO(seed_urls: list[str], total_articles_to_find_and_parse: int, headers: dict[str, str], encoding: str, timeout: int, should_verify_certificate: bool, headless_mode: bool)

Bases: object

Type annotations for configurations.

__init__(seed_urls: list[str], total_articles_to_find_and_parse: int, headers: dict[str, str], encoding: str, timeout: int, should_verify_certificate: bool, headless_mode: bool) → None

Initializes an instance of the ConfigDTO class.

Parameters:

• seed_urls (list[str]) – Seed urls

• total_articles_to_find_and_parse (int) – Number of total articles

• headers (dict[str, str]) – Headers

• encoding (str) – Encoding

• timeout (int) – Number of seconds to wait for response

• should_verify_certificate (bool) – Should verify certificate or not

• headless_mode (bool) – Require headless mode or not

encoding: str

Encoding

headers: dict[str, str]

Headers

headless_mode: bool

Require headless mode or not

seed_urls: list[str]

List of seed urls

should_verify_certificate: bool

Should verify certificate or not

timeout: int

Number of seconds to wait for response

total_articles: int

Number of total articles