Feat/v3 go rewrite (#47)
ci/woodpecker/tag/docker Pipeline was successful

Complete rewrite of ArtifactAPI from Python/FastAPI to Go as a single binary.

Core engine:
- 10 package providers: generic, docker, helm, pypi, npm, rpm, alpine,
  puppet, terraform, goproxy — each with built-in mutable patterns
- Content-addressable storage (SHA256 dedup across all remotes)
- Three-tier caching: Redis (TTL/locks) → S3/MinIO (blobs) → upstream
- Classifier with allowlist/blocklist per-remote (empty = allow all)
- Circuit breaker, conditional revalidation, stale-on-error
- Background garbage collection for orphaned blobs
- Access logging to PostgreSQL

API:
- v1 proxy endpoints (backwards compatible)
- v2 management API: CRUD remotes/virtuals, object browser, stats,
  health, SSE events, probe/test endpoint
- Virtual repos with index merging (Helm YAML + PyPI HTML)

Frontend (React + Vite, separate Dockerfile):
- Dashboard with stats, health indicators, top remotes
- Remotes list with type filter, remote detail with config/patterns
- Object browser with pagination and evict
- Test Remote page: probe any remote path, see headers/size/timing
- Virtuals page with expandable member lists

TUI (Bubble Tea):
- Dashboard, remotes list/detail, object browser, virtuals
- Vim-style navigation, artifactapi tui --endpoint <url>

Infrastructure:
- S3 client supports MinIO, Ceph RGW, AWS S3 (minio-go)
- PostgreSQL schema with migrations
- Docker Compose: API + UI + Postgres 17 + Redis 7 + MinIO
- Makefile with Go version check, build/test/lint/fmt/e2e targets
- Distroless Docker image (~15MB)

Testing:
- Unit tests for models, classifier, providers, mergers
- E2E tests with testcontainers-go (real Postgres/Redis/MinIO)

Terraform config:
- All 40 production remotes + helm virtual as HCL
- Provider repo: terraform-provider-artifactapi v0.0.1 (separate)

---------

Co-authored-by: Ben Vincent <ben@unkin.net>
Reviewed-on: #47
This commit was merged in pull request #47.
This commit is contained in:
2026-06-07 19:30:35 +10:00
parent f25bf6cb29
commit b46c116f6b
160 changed files with 11448 additions and 7907 deletions
+92
View File
@@ -0,0 +1,92 @@
import { useEffect, useState } from 'react';
import { Link } from 'react-router-dom';
import { api } from '../api/client';
import type { OverviewStats, RemoteStatRow, HealthStatus } from '../api/types';
import { StatsCard } from '../components/StatsCard';
import { Badge } from '../components/Badge';
import { DataTable } from '../components/DataTable';
import { formatBytes, formatNumber } from '../components/format';
import './Dashboard.css';
export function Dashboard() {
const [stats, setStats] = useState<OverviewStats | null>(null);
const [topRemotes, setTopRemotes] = useState<RemoteStatRow[]>([]);
const [health, setHealth] = useState<HealthStatus | null>(null);
const [error, setError] = useState<string | null>(null);
useEffect(() => {
Promise.all([api.stats(), api.topRemotes(), api.health()])
.then(([s, tr, h]) => {
setStats(s);
setTopRemotes(tr || []);
setHealth(h);
})
.catch(e => setError(e.message));
}, []);
if (error) return <div className="error-banner">{error}</div>;
if (!stats) return <div className="loading">Loading...</div>;
return (
<div>
<h1 className="page-title">Dashboard</h1>
<div className="stats-row">
<StatsCard label="Remotes" value={formatNumber(stats.total_remotes)} />
<StatsCard label="Cached Objects" value={formatNumber(stats.total_objects)} />
<StatsCard label="Storage Used" value={formatBytes(stats.total_bytes)} />
<StatsCard
label="Dedup Savings"
value={formatNumber(stats.total_blobs_deduped)}
sub="shared blobs"
/>
</div>
{health && (
<div className="health-row">
<span className="health-label">Services</span>
<Badge variant={health.postgres === 'ok' ? 'green' : 'red'}>
postgres: {health.postgres}
</Badge>
<Badge variant={health.redis === 'ok' ? 'green' : 'red'}>
redis: {health.redis}
</Badge>
<Badge variant={health.s3 === 'ok' ? 'green' : 'red'}>
s3: {health.s3}
</Badge>
</div>
)}
<h2 className="section-title">Top Remotes by Size</h2>
<DataTable
columns={[
{
key: 'name',
header: 'Name',
render: (r: RemoteStatRow) => <Link to={`/remotes/${r.name}`}>{r.name}</Link>,
},
{
key: 'objects',
header: 'Objects',
render: (r: RemoteStatRow) => formatNumber(r.object_count),
width: '120px',
},
{
key: 'size',
header: 'Size',
render: (r: RemoteStatRow) => formatBytes(r.total_bytes),
width: '120px',
},
{
key: 'requests',
header: 'Requests (30d)',
render: (r: RemoteStatRow) => formatNumber(r.requests_30d),
width: '140px',
},
]}
data={topRemotes}
emptyMessage="No remotes configured yet"
/>
</div>
);
}