Releases: lncrawl/lightnovel-crawler
Releases · lncrawl/lightnovel-crawler
v4.2.1
v4.1.1
Update version to 4.1.1
v4.0.1
Full Changelog: v4.0.0...v4.0.1
Added
- Admin API: soft restart endpoint for controlled application restarts.
- Docker: Compose configuration for running the
lncrawlservice. - Output formats: JSON export enabled for basic tier users (aligned with tier-based format rules).
- Docs / PyPI:
README.rsttrimmed for the PyPI project page (install-focused) with a link to the full GitHub README; mainREADMEupdates including web UI screenshots, supported-formats section refresh, DeepWiki and lint badges.
Changed
- Enabled formats:
get_enabled_formatsnow returns formats sorted by user tier for stable, predictable ordering in the UI. - Source index generation: timezone-aware “last update” timestamps and clearer handling when language codes are missing from the known set.
- Docker: Dockerfile layout refactored and base image setup improved.
- Dependencies:
pyproject.toml/uv.lockrefined (including removal ofnodriverand related entries). - Application context / config: refactored for clearer configuration management.
- CI: GitHub Actions updated to current Docker actions; submodule update steps removed from workflows where no longer needed.
- Linting: extra rules in
lint.ymland related formatting cleanups.
Maintenance
- Submodules and supported-sources index regenerated multiple times to match current sources and metadata.
v4.0.0
Highlights
- Desktop: Running
lncrawlwith no subcommand starts the GUI (webview) and local server by default. - Libraries: Library management: create, edit, search, and browse libraries with improved UI and API support.
- Accounts & security: User model and verification flow simplified; API tokens for automation; stricter user listing and inactive-user handling.
- Jobs & downloads: Artifact file sizes tracked; job cleanup and feedback tooling; content-disposition fixes for downloads.
- Crawling: Login support on the crawl command; list sources output format options; site availability checks; cloudscraper integration refactored and updated to track upstream via a git dependency.
- Sources: Many sources updated, new indexes, and fixes across languages and templates.
Packaging & platform
- Python: Project and CI target newer Python (3.12+; tooling also tracks 3.14 where applicable).
- Dependencies:
uvis the supported way to install and sync the project (uv.lock). - Docker & CI: Smaller images, workflow updates (e.g. Astral uv setup), improved release and PyPI publish flows; PyInstaller builds refined (including Windows no-console option).
- License: GPLv3 (see repository license and terms/privacy docs where applicable).
Breaking or notable changes
- License changed from MIT to GPLv3 — review if you redistribute or embed the app.
- CLI default: No subcommand no longer “does nothing”; it opens the GUI — use explicit subcommands (
crawl,server,config, etc.) for scripting. - Tooling: Expect
uvand updated Makefile/pyprojectworkflows instead of legacypip install -r requirements.txtflows. - Scraper: Built-in proxy management was removed; adjust any custom proxy setup accordingly.
For contributors
- Linting uses black, isort, and flake8;
make lintand CI align with the new layout. - Alembic migrations and artifact schema changes (e.g. file size column) — run migrations when upgrading existing databases.
New Contributors
- @rdrgmnzs made their first contribution in #2683
- @wildangelcult made their first contribution in #2689
- @dr-dao made their first contribution in #2760
- @almang45 made their first contribution in #2765
- @RlmUwU made their first contribution in #2800
- @dvpagawak made their first contribution in #2811
- @FreeER made their first contribution in #2832
- @VibrantClouds made their first contribution in #2838
- @Ricardoyesc made their first contribution in #2895
Thanks to everyone who contributed issues, PRs, and source fixes.
Full Changelog: v3.10.1...v4.0.0
v3.10.1
What's Changed
- fix: allow downloads of all free chapters by @josegonzalez in #2667
New Contributors
- @josegonzalez made their first contribution in #2667
Full Changelog: v3.10.0...v3.10.1
v3.10.0
Full Changelog: v3.9.4...v3.10.0
v3.9.4
Full Changelog: v3.9.3...v3.9.4
v3.9.3
v3.9.2
Generate source index
v3.9.1
Merge branch 'dev'