Skip to content
Examples

Update Settings

Configure Twitter User Tweets Scraper settings

The v1 API, for batchesSquids, tasks and runs: many calls on a schedule, delivered where you work. For one call that answers in seconds, use the API v2.
POSThttps://api.lobstr.io/v1/squids/{squid_hash}

Configure your Twitter User Tweets Scraper squid settings. Control the number of tweets to fetch, time filtering, and whether to include retweets and pinned tweets.

Headers

Authorizationstringheaderrequired

Your API authentication token. Value: Token YOUR_API_KEY

Content-Typestringheaderrequired

Request body format. Value: application/json

Scraper Parameters

Set these parameters in the params object:

Parameter Type Default Description
json boolean false If true, returns the complete raw JSON payload for each tweet
max_results integer null Maximum number of tweets to scrape per user
fetch_since string null Stop scraping when items older than this threshold are reached (based on published_at). Use a relative duration (24h, 7d, 2w) or an absolute date (YYYY-MM-DD HH:MM:SS)
fetch_since_timezone string null Timezone for interpreting an absolute fetch_since date (e.g. Europe/Paris). Only applies when fetch_since is an absolute date — ignored for relative values like 24h or 7d. See supported timezones.
exclude_reposts boolean false If true, excludes retweets from results
collect_pinned_tweets boolean false If true, includes pinned tweets in results

Squid Settings

Configure general squid settings:

Setting Type Description
name string Display name for your squid configuration
concurrency integer Number of parallel scraping threads (default: 1)
export_unique_results boolean Export only unique results (deduplicated)
to_complete boolean Run until all tasks complete
no_line_breaks boolean Remove line breaks from results

Use fetch_since to monitor recent activity - set to 24 to only collect tweets from the last day.

Enable exclude_reposts to focus on original content only.

Pinned tweets are not collected by default - enable collect_pinned_tweets if you need them.

Code Examples

curl -X POST "https://api.lobstr.io/v1/squids/YOUR_SQUID_HASH" \
  -H "Authorization: Token YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "name": "Twitter User Tweets Scraper (2)",
    "concurrency": 1,
    "export_unique_results": true,
    "to_complete": false,
    "no_line_breaks": true,
    "params": {
      "json": true,
      "fetch_since": null,
      "max_results": 98,
      "exclude_reposts": true,
      "collect_pinned_tweets": true
    }
  }'

Response

201
{
  "name": "Twitter User Tweets Scraper (2)",
  "no_line_breaks": true,
  "params": {
    "json": true,
    "fetch_since": null,
    "max_results": 98,
    "exclude_reposts": true,
    "collect_pinned_tweets": true
  },
  "to_complete": false,
  "export_unique_results": true
}