unkin/artifactapi
2
0
Fork 0
Code Issues 5 Pull Requests 2 Actions Packages Projects Releases 1 Wiki Activity

Feat/v3 go rewrite #47

Merged
benvin merged 4 commits from feat/v3-go-rewrite into master 2026-06-07 19:30:35 +10:00
Conversation 0 Commits 4 Files Changed 160
+11448 -7907
benvin commented 2026-06-07 19:26:15 +10:00
Owner
Copy Link
Copy Source

Complete rewrite of ArtifactAPI from Python/FastAPI to Go as a single binary.

Core engine:

  • 10 package providers: generic, docker, helm, pypi, npm, rpm, alpine,
    puppet, terraform, goproxy — each with built-in mutable patterns
  • Content-addressable storage (SHA256 dedup across all remotes)
  • Three-tier caching: Redis (TTL/locks) → S3/MinIO (blobs) → upstream
  • Classifier with allowlist/blocklist per-remote (empty = allow all)
  • Circuit breaker, conditional revalidation, stale-on-error
  • Background garbage collection for orphaned blobs
  • Access logging to PostgreSQL

API:

  • v1 proxy endpoints (backwards compatible)
  • v2 management API: CRUD remotes/virtuals, object browser, stats,
    health, SSE events, probe/test endpoint
  • Virtual repos with index merging (Helm YAML + PyPI HTML)

Frontend (React + Vite, separate Dockerfile):

  • Dashboard with stats, health indicators, top remotes
  • Remotes list with type filter, remote detail with config/patterns
  • Object browser with pagination and evict
  • Test Remote page: probe any remote path, see headers/size/timing
  • Virtuals page with expandable member lists

TUI (Bubble Tea):

  • Dashboard, remotes list/detail, object browser, virtuals
  • Vim-style navigation, artifactapi tui --endpoint

Infrastructure:

  • S3 client supports MinIO, Ceph RGW, AWS S3 (minio-go)
  • PostgreSQL schema with migrations
  • Docker Compose: API + UI + Postgres 17 + Redis 7 + MinIO
  • Makefile with Go version check, build/test/lint/fmt/e2e targets
  • Distroless Docker image (~15MB)

Testing:

  • Unit tests for models, classifier, providers, mergers
  • E2E tests with testcontainers-go (real Postgres/Redis/MinIO)

Terraform config:

  • All 40 production remotes + helm virtual as HCL
  • Provider repo: terraform-provider-artifactapi v0.0.1 (separate)
Complete rewrite of ArtifactAPI from Python/FastAPI to Go as a single binary. Core engine: - 10 package providers: generic, docker, helm, pypi, npm, rpm, alpine, puppet, terraform, goproxy — each with built-in mutable patterns - Content-addressable storage (SHA256 dedup across all remotes) - Three-tier caching: Redis (TTL/locks) → S3/MinIO (blobs) → upstream - Classifier with allowlist/blocklist per-remote (empty = allow all) - Circuit breaker, conditional revalidation, stale-on-error - Background garbage collection for orphaned blobs - Access logging to PostgreSQL API: - v1 proxy endpoints (backwards compatible) - v2 management API: CRUD remotes/virtuals, object browser, stats, health, SSE events, probe/test endpoint - Virtual repos with index merging (Helm YAML + PyPI HTML) Frontend (React + Vite, separate Dockerfile): - Dashboard with stats, health indicators, top remotes - Remotes list with type filter, remote detail with config/patterns - Object browser with pagination and evict - Test Remote page: probe any remote path, see headers/size/timing - Virtuals page with expandable member lists TUI (Bubble Tea): - Dashboard, remotes list/detail, object browser, virtuals - Vim-style navigation, artifactapi tui --endpoint <url> Infrastructure: - S3 client supports MinIO, Ceph RGW, AWS S3 (minio-go) - PostgreSQL schema with migrations - Docker Compose: API + UI + Postgres 17 + Redis 7 + MinIO - Makefile with Go version check, build/test/lint/fmt/e2e targets - Distroless Docker image (~15MB) Testing: - Unit tests for models, classifier, providers, mergers - E2E tests with testcontainers-go (real Postgres/Redis/MinIO) Terraform config: - All 40 production remotes + helm virtual as HCL - Provider repo: terraform-provider-artifactapi v0.0.1 (separate)
benvin added 3 commits 2026-06-07 19:26:15 +10:00
feat: v3 Go rewrite — full artifact proxy with web UI, TUI, and Terraform provider deabda9895 
Complete rewrite of ArtifactAPI from Python/FastAPI to Go as a single binary.

Core engine:
- 10 package providers: generic, docker, helm, pypi, npm, rpm, alpine,
  puppet, terraform, goproxy — each with built-in mutable patterns
- Content-addressable storage (SHA256 dedup across all remotes)
- Three-tier caching: Redis (TTL/locks) → S3/MinIO (blobs) → upstream
- Classifier with allowlist/blocklist per-remote (empty = allow all)
- Circuit breaker, conditional revalidation, stale-on-error
- Background garbage collection for orphaned blobs
- Access logging to PostgreSQL

API:
- v1 proxy endpoints (backwards compatible)
- v2 management API: CRUD remotes/virtuals, object browser, stats,
  health, SSE events, probe/test endpoint
- Virtual repos with index merging (Helm YAML + PyPI HTML)

Frontend (React + Vite, separate Dockerfile):
- Dashboard with stats, health indicators, top remotes
- Remotes list with type filter, remote detail with config/patterns
- Object browser with pagination and evict
- Test Remote page: probe any remote path, see headers/size/timing
- Virtuals page with expandable member lists

TUI (Bubble Tea):
- Dashboard, remotes list/detail, object browser, virtuals
- Vim-style navigation, artifactapi tui --endpoint <url>

Infrastructure:
- S3 client supports MinIO, Ceph RGW, AWS S3 (minio-go)
- PostgreSQL schema with migrations
- Docker Compose: API + UI + Postgres 17 + Redis 7 + MinIO
- Makefile with Go version check, build/test/lint/fmt/e2e targets
- Distroless Docker image (~15MB)

Testing:
- Unit tests for models, classifier, providers, mergers
- E2E tests with testcontainers-go (real Postgres/Redis/MinIO)

Terraform config:
- All 40 production remotes + helm virtual as HCL
- Provider repo: terraform-provider-artifactapi v0.0.1 (separate)
chore: remove v2 Python codebase 14ac65e0a9 
Removes all Python source, tests, config examples, CI pipelines,
and build tooling. The Go rewrite replaces everything.
ci: add woodpecker pipelines for Go
ci/woodpecker/pr/test Pipeline failed
Details
ci/woodpecker/pr/pre-commit Pipeline was successful
Details
ci/woodpecker/pr/build Pipeline was canceled
Details
21d286c62a
unkinben added 1 commit 2026-06-07 19:27:37 +10:00
ci: use golang:1.25 (not alpine) for race detector support
ci/woodpecker/pr/build Pipeline was successful
Details
ci/woodpecker/pr/pre-commit Pipeline was successful
Details
ci/woodpecker/pr/test Pipeline was successful
Details
7433bbfdb6
benvin merged commit b46c116f6b into master 2026-06-07 19:30:35 +10:00
benvin deleted branch feat/v3-go-rewrite 2026-06-07 19:30:35 +10:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
No items
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
benvin (BenVincent) unkinben (Ben Vincent)
No Assignees
2 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: unkin/artifactapi#47
Delete Branch "feat/v3-go-rewrite"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?