Skip to content

Abstraction layer in Spider #57

Description

@ManiMozaffar
  • Define new abstraction, so the process would be unaware of what component is Spider
  • In result, we should be able to add Parser, Saver and etc
  • The abstraction layer, may cache data

Final Result
Process(Spider() >> Parse(model=ParsingModel) >> Save(to=PostgreSQL)

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions