benvin/path-based-storage #6

unkinben · 2026-01-25T00:00:49+11:00

unkinben commented

2026-01-25 00:00:49 +11:00

No description provided.

unkinben added 6 commits 2026-01-25 00:00:49 +11:00

feat: implement hierarchical S3 keys and automated version management 5a0e8b4e0b

This commit introduces two major improvements:

1. **Hierarchical S3 Key Structure**:
   - Replace URL-based hashing with remote-name/hash(directory_path)/filename format
   - Enables remote-specific cache operations and intuitive S3 organization
   - Cache keys now independent of mirror URL changes
   - Example: fedora/886d215f6d1a0108/eccodes-2.44.0-1.fc42.x86_64.rpm

2. **Automated Version Management**:
   - Add bumpver for semantic version bumping
   - Single source of truth in pyproject.toml
   - FastAPI dynamically reads version from package metadata
   - Eliminates manual version synchronization between files

Changes:
- storage.py: New get_object_key(remote_name, path) method with directory hashing
- main.py: Dynamic version import and updated cache key generation calls
- cache.py: Updated to use new hierarchical key structure
- pyproject.toml: Added bumpver config and dev dependency

Breaking change: S3 key format changed, existing cache will need regeneration

chore: ignore local config overrides (docker-compose.yml, ca-bundle.pem) 6e8912eed1

Bump version 2.0.2 → 2.0.3 3f54874421

fix: sync package version with bumpver version (2.0.3) 424de5cc13

chore: migrate from bumpver to bump-my-version for better reliability d39550c4e8

Bump version: 2.0.3 → 2.0.4 16c8bd60eb

unkinben merged commit de04e4d2b2 into master

2026-01-25 00:00:54 +11:00

unkinben referenced this issue from a commit

2026-01-25 00:00:57 +11:00

Merge pull request 'benvin/path-based-storage' (#6) from benvin/path-based-storage into master

Sign in to join this conversation.

No reviewers