Skip to content
Task

Upload Tasks

Upload a CSV/TSV file containing multiple tasks for a squid

The v1 API, for batchesSquids, tasks and runs: many calls on a schedule, delivered where you work. For one call that answers in seconds, use the API v2.
POSThttps://api.lobstr.io/v1/tasks/upload

This endpoint allows you to upload a file (CSV/TSV) containing multiple tasks for a specific squid. The file should contain task parameters in columns matching the crawler's expected keys. This is ideal for bulk task creation.

Headers

Authorizationstringheaderrequired

Your API authentication token. Value: Token YOUR_API_KEY

Content-Typestringheaderrequired

Must be multipart/form-data for file upload. Value: multipart/form-data

Form Data Parameters

filefilerequired

CSV or TSV file containing task data. Column headers should match crawler parameter keys. Example: tasks.csv

squidstringrequired

The hash ID of the squid to add tasks to. Example: "a1b2c3d4e5f6g7h8i9j0"

Response Field Explanations

idstring

Upload task identifier for tracking progress. Example: "427a7bfc54cf4ce483d83ba23425164b"

objectstring

Always "task_upload". Example: "task_upload"

Use the returned task ID with Check Upload Status to monitor the upload progress.

CSV column headers must match the crawler's expected parameter keys (e.g., 'url', 'city', 'activity').

Large files may take time to process. Always check upload status before running the squid.

TSV (tab-separated) files are also supported and may be easier to work with for URLs containing commas.

Code Examples

curl -X POST "https://api.lobstr.io/v1/tasks/upload" \
  -H "Authorization: Token YOUR_API_KEY" \
  -F "file=@tasks.csv" \
  -F "squid=a1b2c3d4e5f6g7h8i9j0"

Response

200
{
  "id": "427a7bfc54cf4ce483d83ba23425164b",
  "object": "task_upload"
}