By name: api-ingest-pipeline metadata: version: "0.0.1" author: "ShuangShu" description: Fetch upstream API payloads, normalize records, validate schema, and output ingestion-ready batches.
API Ingest Pipeline
Overview
Use this mid-layer skill to orchestrate API pull -> normalize -> validate workflow as a single ingestion pipeline.
Workflow
- Pull paginated payloads from upstream API.
- Normalize records to canonical schema.
- Validate normalized records.
- Emit accepted/rejected batches.
Output Contract
- Return accepted batch.
- Return rejected records with reasons.
- Include source request metadata for traceability.