Upload Tasks
Upload a CSV/TSV file containing multiple tasks for a squid
https://api.lobstr.io/v1/tasks/uploadThis endpoint allows you to upload a file (CSV/TSV) containing multiple tasks for a specific squid. The file should contain task parameters in columns matching the crawler's expected keys. This is ideal for bulk task creation.
Headers
AuthorizationstringheaderrequiredYour API authentication token. Value: Token YOUR_API_KEY
Content-TypestringheaderrequiredMust be multipart/form-data for file upload. Value: multipart/form-data
Form Data Parameters
filefilerequiredCSV or TSV file containing task data. Column headers should match crawler parameter keys. Example: tasks.csv
squidstringrequiredThe hash ID of the squid to add tasks to. Example: "a1b2c3d4e5f6g7h8i9j0"
Response Field Explanations
idstringUpload task identifier for tracking progress. Example: "427a7bfc54cf4ce483d83ba23425164b"
objectstringAlways "task_upload". Example: "task_upload"
Use the returned task ID with Check Upload Status to monitor the upload progress.
CSV column headers must match the crawler's expected parameter keys (e.g., 'url', 'city', 'activity').
Large files may take time to process. Always check upload status before running the squid.
TSV (tab-separated) files are also supported and may be easier to work with for URLs containing commas.
Code Examples
curl -X POST "https://api.lobstr.io/v1/tasks/upload" \ -H "Authorization: Token YOUR_API_KEY" \ -F "file=@tasks.csv" \ -F "squid=a1b2c3d4e5f6g7h8i9j0"
Response
{ "id": "427a7bfc54cf4ce483d83ba23425164b", "object": "task_upload" }