Added
Manifest Files for S3/GCS Drops (Beta)
6 days ago by Daniel Wiener
Manifest files are now being generated for all signal data drops, enabling event-driven data pipelines.
How It Works
After each data push to your S3/GCS bucket, we generate a manifest file in the /manifest folder:
/manifest/2026-01-14_success.json
This allows you to:
- Trigger pipelines only when new data arrives
- Avoid polling or scheduled jobs
- Confirm successful delivery before processing
Schema
{
"timestamp": "2026-01-14T00:00:00Z",
"status": "success",
"signals_delivered": ["10-k", "news", "hiring-velocity"],
"record_counts": {
"10-k": 1247,
"news": 8934,
"hiring-velocity": 3421
}
}