Added

Manifest Files for S3/GCS Drops (Beta)

Manifest files are now being generated for all signal data drops, enabling event-driven data pipelines.

How It Works

After each data push to your S3/GCS bucket, we generate a manifest file in the /manifest folder:

/manifest/2026-01-14_success.json

This allows you to:

  • Trigger pipelines only when new data arrives
  • Avoid polling or scheduled jobs
  • Confirm successful delivery before processing

Schema

{
  "timestamp": "2026-01-14T00:00:00Z",
  "status": "success",
  "signals_delivered": ["10-k", "news", "hiring-velocity"],
  "record_counts": {
    "10-k": 1247,
    "news": 8934,
    "hiring-velocity": 3421
  }
}