Sync media from GoPro cloud into Google Photos for a capture date range with resumable session state.
- Python 3.12 or 3.13 (3.14 is excluded until dependent wheels catch up)
GP_ACCESS_TOKENorQ2GOOGLE_GOPRO_ACCESS_TOKEN— GoPro cloud access token (loaded byQ2GoogleSettingsand passed toAsyncGoProClient)- Google OAuth installed app credentials (
client_secret.jsonfrom Google Cloud Console) - A writable path for the user token (
token.jsonby default)
pip install q2googleOr with uv:
uv add q2googleOr with uv:
uv add q2googleimport asyncio
from datetime import datetime
from gopro_api import AsyncGoProClient
from q2google import (
GoProToPhotosSync,
GooglePhotosClient,
GooglePhotosOAuth,
JsonFileBackend,
get_settings,
)
from q2google.gphotos.api import GooglePhotosAPI
from q2google.gphotos.models import PhotosScopes
async def main() -> None:
oauth = GooglePhotosOAuth(
client_secrets_file="client_secret.json",
scopes=[PhotosScopes.READ_AND_APPEND],
token_file="token.json",
)
cfg = get_settings()
async with (
AsyncGoProClient(access_token=cfg.gopro_access_token) as gopro,
GooglePhotosAPI(credentials=oauth) as api,
):
photos = GooglePhotosClient(api=api)
backend = JsonFileBackend(root_dir=".q2google_sessions")
syncer = GoProToPhotosSync(
gopro=gopro,
photos=photos,
state_backend=backend,
)
responses = await syncer.sync_date_range(
start_date=datetime(2026, 1, 8),
end_date=datetime(2026, 1, 9),
session_id="my-session",
)
print(f"Created {len(responses)} batch(es).")
asyncio.run(main())Pass the same session_id on subsequent runs. GoProToPhotosSync loads the persisted SessionState and skips already-completed items:
responses = await syncer.sync_date_range(
start_date=datetime(2026, 1, 8), # ignored when resuming
end_date=datetime(2026, 1, 9), # ignored when resuming
session_id="my-session", # same key → resumes from checkpoint
)Implement SyncStateBackend to persist sessions in any storage layer (database, object store, etc.):
from q2google import SessionState, SyncStateBackend
class RedisBackend:
def load(self, session_id: str) -> SessionState | None:
raw = redis_client.get(session_id)
return SessionState.from_dict(json.loads(raw)) if raw else None
def save(self, state: SessionState) -> None:
redis_client.set(state.session_id, json.dumps(state.to_dict()))Pass it directly to GoProToPhotosSync(state_backend=RedisBackend()). No other changes required.
on_stage_complete is called after each of the three pipeline stages (discovery, transfer, create). Use it to report progress, emit metrics, or trigger side-effects:
from q2google.state.base import SessionState, StageKey
from q2google.photos import MediaItemBatchCreateResponse
async def report(
stage: StageKey,
state: SessionState,
responses: list[MediaItemBatchCreateResponse] | None,
) -> None:
print(f"[{stage}] items={len(state.items)} stage_states={state.stages}")
responses = await syncer.sync_date_range(
start_date=datetime(2026, 1, 8),
end_date=datetime(2026, 1, 9),
session_id="my-session",
on_stage_complete=report,
)All public symbols are importable directly from q2google:
| Symbol | Description |
|---|---|
GoProToPhotosSync |
Main orchestrator; runs discovery → transfer → create. |
GooglePhotosClient |
Resumable upload facade (upload_file_path, create_media_items). |
GooglePhotosOAuth |
Load, refresh, or obtain Google OAuth credentials. |
JsonFileBackend |
File-based SyncStateBackend; stores each session as a directory of JSON files (meta.json, items/, batches/). |
SessionState |
Full persisted session document (to_dict / from_dict for custom stores). |
SyncStateBackend |
Protocol — implement load / save to plug in any storage layer. |
Q2GoogleSettings |
Pydantic settings; batch sizes, timeouts, and paths with env-var overrides. |
get_settings |
Return a singleton Q2GoogleSettings from environment / .env. |
Lower-level symbols in q2google.gphotos:
| Symbol | Description |
|---|---|
GooglePhotosAPI |
Thin aiohttp wrapper for Library v1 — use as async with GooglePhotosAPI(...) as api. |
GooglePhotoLibraryPort |
Protocol matching GooglePhotosAPI; implement for testing or alternative HTTP clients. |
PhotosScopes |
Enum of OAuth scopes (READ_AND_APPEND, READ_ONLY, APPEND_ONLY). |
The package ships a CLI for one-off or scripted use:
q2google sync \
--start-date 2026-01-08 \
--end-date 2026-01-09 \
--credentials client_secret.json \
--token token.jsonUseful options:
| Option | Description |
|---|---|
--state-dir |
JSON session root (default: .q2google_sessions or Q2GOOGLE_STATE_DIR) |
--session-id |
Stable id to resume a run (Q2GOOGLE_SESSION_ID if unset) |
--batch-size |
Files per cycle for new sessions; ignored when resuming (persisted session wins) |
--fail-fast |
Stop on first error after persisting state |
--log-level DEBUG |
Verbose logging |
import asyncio
from datetime import datetime
from gopro_api import AsyncGoProClient
from q2google import (
GoProToPhotosSync,
GooglePhotosClient,
GooglePhotosOAuth,
JsonFileBackend,
get_settings,
)
from q2google.gphotos.api import GooglePhotosAPI
from q2google.gphotos.models import PhotosScopes
async def main() -> None:
oauth = GooglePhotosOAuth(
client_secrets_file="client_secret.json",
scopes=[PhotosScopes.READ_AND_APPEND],
token_file="token.json",
)
cfg = get_settings()
async with (
AsyncGoProClient(access_token=cfg.gopro_access_token) as gopro,
GooglePhotosAPI(credentials=oauth) as api,
):
photos = GooglePhotosClient(api=api)
backend = JsonFileBackend(root_dir=".q2google_sessions")
syncer = GoProToPhotosSync(
gopro=gopro,
photos=photos,
state_backend=backend,
)
responses = await syncer.sync_date_range(
start_date=datetime(2026, 1, 8),
end_date=datetime(2026, 1, 9),
session_id="my-session",
)
print(f"Created {len(responses)} batch(es).")
asyncio.run(main())Pass the same session_id on subsequent runs. GoProToPhotosSync loads the persisted SessionState and skips already-completed items:
responses = await syncer.sync_date_range(
start_date=datetime(2026, 1, 8), # ignored when resuming
end_date=datetime(2026, 1, 9), # ignored when resuming
session_id="my-session", # same key → resumes from checkpoint
)Implement SyncStateBackend to persist sessions in any storage layer (database, object store, etc.):
from q2google import SessionState, SyncStateBackend
class RedisBackend:
def load(self, session_id: str) -> SessionState | None:
raw = redis_client.get(session_id)
return SessionState.from_dict(json.loads(raw)) if raw else None
def save(self, state: SessionState) -> None:
redis_client.set(state.session_id, json.dumps(state.to_dict()))Pass it directly to GoProToPhotosSync(state_backend=RedisBackend()). No other changes required.
on_stage_complete is called after each of the three pipeline stages (discovery, transfer, create). Use it to report progress, emit metrics, or trigger side-effects:
from q2google.state.base import SessionState, StageKey
from q2google.photos import MediaItemBatchCreateResponse
async def report(
stage: StageKey,
state: SessionState,
responses: list[MediaItemBatchCreateResponse] | None,
) -> None:
print(f"[{stage}] items={len(state.items)} stage_states={state.stages}")
responses = await syncer.sync_date_range(
start_date=datetime(2026, 1, 8),
end_date=datetime(2026, 1, 9),
session_id="my-session",
on_stage_complete=report,
)All public symbols are importable directly from q2google:
| Symbol | Description |
|---|---|
GoProToPhotosSync |
Main orchestrator; runs discovery → transfer → create. |
GooglePhotosClient |
Resumable upload facade (upload_file_path, create_media_items). |
GooglePhotosOAuth |
Load, refresh, or obtain Google OAuth credentials. |
JsonFileBackend |
File-based SyncStateBackend; stores each session as a directory of JSON files (meta.json, items/, batches/). |
SessionState |
Full persisted session document (to_dict / from_dict for custom stores). |
SyncStateBackend |
Protocol — implement load / save to plug in any storage layer. |
Q2GoogleSettings |
Pydantic settings; batch sizes, timeouts, and paths with env-var overrides. |
get_settings |
Return a singleton Q2GoogleSettings from environment / .env. |
Lower-level symbols in q2google.gphotos:
| Symbol | Description |
|---|---|
GooglePhotosAPI |
Thin aiohttp wrapper for Library v1 — use as async with GooglePhotosAPI(...) as api. |
GooglePhotoLibraryPort |
Protocol matching GooglePhotosAPI; implement for testing or alternative HTTP clients. |
PhotosScopes |
Enum of OAuth scopes (READ_AND_APPEND, READ_ONLY, APPEND_ONLY). |
All CLI options have environment-variable equivalents. Q2GoogleSettings (Pydantic BaseSettings) loads them with the Q2GOOGLE_ prefix and also reads a .env file in the working directory.
| Variable | Purpose |
|---|---|
GP_ACCESS_TOKEN |
GoPro cloud access token — alias accepted by Q2GoogleSettings; passed to AsyncGoProClient |
Q2GOOGLE_GOPRO_ACCESS_TOKEN |
GoPro cloud access token — prefixed alternative to GP_ACCESS_TOKEN |
Q2GOOGLE_CREDENTIALS_PATH |
Google OAuth client secrets JSON path |
Q2GOOGLE_TOKEN_PATH |
Authorized user token path |
Q2GOOGLE_STATE_DIR |
JSON session state directory |
Q2GOOGLE_SESSION_ID |
Default session id when --session-id is omitted |
Q2GOOGLE_SYNC_BATCH_SIZE |
Transfer batch size for new sessions |
Q2GOOGLE_PHOTOS_LIBRARY_BATCH_SIZE |
Items per batchCreate (1–50) |
Q2GOOGLE_FAIL_FAST |
true / false |
Q2GOOGLE_LOG_LEVEL |
e.g. INFO, DEBUG |
Q2GOOGLE_GOOGLE_PHOTOS_TIMEOUT_SECONDS |
Library API request timeout |
Q2GOOGLE_DOWNLOAD_CHUNK_SIZE_BYTES |
CDN stream chunk size |
See q2google.config.Q2GoogleSettings for the full list and defaults.
sync_date_range splits every run into three sequential stages. State is persisted through SyncStateBackend after each stage, so interrupted runs can resume from the last checkpoint.
sequenceDiagram
participant Caller
participant Sync as GoProToPhotosSync
participant GoPro as AsyncGoProClient
participant Photos as GooglePhotosClient
participant Store as SyncStateBackend
Caller->>Sync: sync_date_range(start, end, session_id)
Sync->>Store: load(session_id)
Store-->>Sync: SessionState or new
Note over Sync: discovery
Sync->>GoPro: list_media_items, get_download_url
Sync->>Store: save(state)
Note over Sync: transfer
Sync->>Photos: upload_file_path per item
Sync->>Store: save(state)
Note over Sync: create
Sync->>Photos: create_media_items_from_upload_sessions
Sync->>Store: save(state)
Sync-->>Caller: list of batch create responses
See docs/ARCHITECTURE.md for module layout and extension points.
uv sync
task format # Ruff import fix + format
task lint # Ruff check + format check (no writes)
task test # Pytest with coverage on `q2google`See repository metadata (add a LICENSE file if needed).