chore: apply fixes for UP ruff rule

[emdneto]

Description

• Replaced deprecated typing.X generics (Dict, List, Set, Tuple, Type, Deque) with their built-in equivalents
• Replaced typing.Union[X, Y] annotations with X | Y syntax (UP007)
• Replaced typing.Optional[X] annotations with X | None syntax (UP045)
• Removed redundant pages from docs (https://opentelemetry-python.readthedocs.io/en/latest/api/context.context.html, https://opentelemetry-python.readthedocs.io/en/latest/api/trace.status.html and https://opentelemetry-python.readthedocs.io/en/latest/api/trace.span.html) since it was causing docs CI to fail e.g.,

opentelemetry._logs._internal.LogRecord:1:more than one target located for cross-referencing 'Context': opentelemetry.context.Context, opentelemetry.context.context.Context

99% of the changes were made by ruff with ruff check --fix. The agent removed the unused imports and fixed minor issues.

Fixes #4227

This is important to make our codebase updated with the most recent supported syntax.

Assisted-by: Copilot

[DylanRussell]

nice. couple failed CI checks but otherwise LGTM

[emdneto]

Note for manual changes i've done in 6051e44 and 874317d to make CI pass

[MikeGoldsmith]

Looks good. Some linter checks failed that will need to be cleaned up.

[DylanRussell]

If you have time I think we could do the same thing in the contrib repo: https://github.com/open-telemetry/opentelemetry-python-contrib/blob/main/pyproject.toml#L162

[emdneto]

If you have time I think we could do the same thing in the contrib repo: https://github.com/open-telemetry/opentelemetry-python-contrib/blob/main/pyproject.toml#L162

That's the plan after getting this merged

[emdneto]

Answering the question from today's SIG: is it safe for downstream typecheckers? E.g. Typing -> collections.abc

I wrote this PoC:

//lib_sdk.py

from collections.abc import Callable


def parse_value(v: str | int) -> str: return str(v)
def run_callback(cb: Callable[[str], int]) -> int: return cb("hi")

//downstream.py

from typing import Callable, Union

from lib_sdk import parse_value, run_callback

value: Union[str, int] = parse_value("abc")

def cb(s: str) -> int: return len(s)
old_cb: Callable[[str], int] = cb
run_callback(old_cb)

And later:

pyright --pythonversion 3.10 downstream.py
0 errors, 0 warnings, 0 informations

cc @xrmx