Creating Ingestion Pages
When vulnerability data is imported into VRM—either via CSV or through a connector—the system automatically splits the data into multiple ingestion pages. These pages are designed to manage processing in batches, ensuring scalability and reliability even for large datasets.
Each ingestion page corresponds to a portion of the original dataset and is stored as a record in VRM - Ingestion Page.
Page Record Contents
Each ingestion page includes:
- Status: Tracks progress (e.g., Pending, Submitted, Completed)
- Page Type: Source of data (CSV or API)
- Source: Logical source name, used in mapping logic
- Timestamp: When the page was created/updated
- JSON File: Encoded subset of findings
- Finding Count: Number of findings in this batch
- Sample Data: Preview of the findings payload
Common Statuses:
- Pending Submission to Enrichment: Page is queued but not yet picked up
- Submitting to Enrichment: Page is actively being processed
- Successfully Submitted: All findings in the page have been sent for enrichment
Notes:
- Page size is defined in the import step (default: 1000). This controls how many findings go into each page.
- All ingestion pages are viewable in the VRM - Ingestion Page application.
- Errors or issues encountered during enrichment are reflected in page-level status and logs.