Skip to content

Upgrade to flash attention 3 and potentially torch 2.13 #2689

Description

@florianscheidl

Describe the task. It can be a feature, documentation, etc.

Related to #2185. We want to build flash attention 3 with torch 2.13+cu130 for x_86 architectures.

Hedgedoc URL, if you are keeping notes, plots, logs in hedgedoc.

No response

Area

  • datasets, data readers, data preparation and transfer
  • model
  • science
  • infrastructure and engineering
  • evaluation, export and visualization
  • documentation
  • performance

Metadata

Metadata

Assignees

No one assigned

    Labels

    infraIssues related to infrastructureperformanceWork related to performance improvements

    Type

    No type

    Projects

    Status
    No status

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions