> For the complete documentation index, see [llms.txt](https://evidano.gitbook.io/ailyze-docs/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://evidano.gitbook.io/ailyze-docs/reference/settings/web-data-extraction.md). # Web Data Extraction Settings Every control in the Get Social Media Web Data workflow: platform cards, URL input, advanced options, the review dialog, history, previews, and schedules. This page lists every control in the **Get Social Media Web Data** workflow and says what each one changes: the three steps of a new extraction, the advanced options, the review and charge dialogs, the **History** and **Scheduled** tabs, and the data preview. It is for anyone who has followed [Collect Social Media & Web Data](/ailyze-docs/collect-research-data/collect-social-media-and-web-data.md) and wants to know what a specific option does before running a batch. Extraction is free up to an allowance of URLs, then pay-as-you-go on the Pro plan; the Free plan stops at the allowance. Numbers are on [Plans, Limits & Credits](/ailyze-docs/reference/plans-limits-and-credits.md). Last verified against the staging app on 14 October 2026. ## The page and its tabs From your account page, click **Get Social Media Web Data** to open **Extract Data from URLs**. Three tabs run along the top: **New Extraction**, **History**, and **Scheduled**. Clicking **New Extraction** while you are on it resets the wizard. The step indicator (**Choose Extraction**, **Add URLs**, **Download Results**) shows progress and is not clickable. ## Step 1: Choose Extraction
Choose Extraction step with the Auto-detect Platform card, the Web pages card, and the platform grid

Auto-detect is selected by default; the grid below is only for forcing one platform and mode.

| Control | What it does | Notes | | -------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------- | -------------------------------------------------------------------------------------------------------------------------------------- | | **Auto-detect Platform** | Matches every pasted URL to its platform and best-supported export mode, expands short links, and saves ordinary pages as documents. | Marked **Recommended** and selected by default. **Continue with Auto-detect** moves on; **Preview sample output data** shows a sample. | | **Web pages (documents)** | Saves each URL, including a social-media link, as a Word document of the page content. | **Continue to Step 2** appears once the card is selected. | | Search box | Filters the platform grid by platform, mode, data field, or URL form. | | | Category buttons | **All platforms**, **Social**, **Video**, **Reviews & shopping**, **Apps & games**, **Community & news**. | | | Platform card | Shows the support badge, the **URL form** it expects, **Export mode** chips, and **Data fields you'll get**. Clicking a mode chip selects the platform and mode. | **Preview sample output** appears where a sample exists. **Continue to Step 2** uses the first mode if you chose none. | | **Show … unavailable platforms** | Reveals platforms that cannot be collected, with the reason. | | The badges mean: **Verified** completed at least one live test, **Conditional** worked for some URLs or modes only, **Try it** is recognized but not confirmed, and **Unavailable** cannot be collected.
Which platforms and modes exist * Social and community sources include YouTube, Facebook, Instagram, TikTok, X, Reddit, LinkedIn, Threads, Bluesky, Telegram, VK, Pinterest, Snapchat, Twitch, Bilibili, RuTube, Kuaishou, Douyin, Disqus, Yahoo, and Newsweek, mostly in **Comments** and **Posts** modes, with **Followers**, **Following**, **Search results**, **Videos**, or **Live chat** on some. * Review and shopping sources include Google Maps and Search, Etsy, Tripadvisor, Best Buy, Trustpilot, Expedia, Yelp, Walmart, Airbnb, Amazon, AliExpress, Flipkart, Lazada, eBay, and IMDb in **Reviews** mode. * App and game sources include the Apple App Store, Google Play Store, Chrome Web Store, Huawei AppGallery, and Steam. * Crowdfunding and product sources include Kickstarter, Indiegogo, Product Hunt, Change.org, Figma Community, and Vimeo. * The live list is served by the server and can differ from this one. The platform card and its **Data fields you'll get** are the authority for any given day.
## Step 2: Add URLs
Add URLs step with the paste box, the upload area, and the Advanced options panel expanded

The counter under the box turns red when a batch goes over the per-extraction cap.

| Control | What it does | Notes | | -------------------------------------------------- | -------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------- | | **Input Method**: **Paste URLs** / **Upload File** | Paste one URL per line, or upload a CSV or XLSX with the URLs in one column. | Switching clears the other input. | | URL box | The pasted list. A counter reads "N URL(s) detected"; chips count each platform and any invalid lines. | Only https links work; the scheme is added if you leave it out. Short links are expanded. | | "These lines will be skipped unless fixed:" | Lists lines that are not usable, with the reason. | Fix them or continue without them. | | Upload area | Drag a CSV or XLSX or browse. **Data Format Requirements** and an **Example file format** table sit beside it. | First row headers, one URL per row, any column name. | | **Advanced options** | Collapsible panel; a chip counts the options you set. | Hidden for **Web pages**. | | **Max items per URL** | Caps how many rows each URL returns. | Blank or 0 means all. Best effort: some platforms return fixed batches. You are charged per URL, not per row. | | **Include replies** | Adds replies under comments, reviews, discussions, and messages. | Shown only for those modes. | | **Advanced mode** | Switches on deeper collection where a platform offers it. | | | **From date**, **To date** | Limit the window. | Some platforms ignore date filters; the panel says so. | | **Review URLs to Extract** | Opens the **Review URLs** dialog. | Disabled while empty, over the cap, or during a rate-limit countdown. | ### The Review URLs dialog Each URL is checked with the server, then listed with its **Platform**, an **Export mode** menu you can change per row, and **You will receive**, the fields that mode delivers. Summary chips count verified, conditional, try-it, and web-page URLs, and anything that cannot be submitted. A row with no supported mode is skipped unless you switch it to **Web page (document)**; skipped URLs are not charged. **Start Extraction** (or **Extract N of M URLs**) submits the batch. {% hint style="warning" %} **Costs money:** On the Pro plan, a batch beyond your remaining free URLs opens a **Confirm charge** dialog with the amount, your balance before and after, and **Top up** presets if the balance is short; after a declined card it also shows the reason and **Update payment method**. **Extract Data** confirms. Only URLs that return data are billed; failed and empty URLs are not. On the Free plan, a batch beyond the allowance is refused with a note to reduce the list or upgrade. See [Plans, Limits & Credits](/ailyze-docs/reference/plans-limits-and-credits.md). {% endhint %} ## Step 3: Processing & Download Small batches finish on the page; large ones run in the background and email you. The step shows the extraction summary, a progress bar, and per-URL rows. | Control | What it does | | ------------------------------------------------------ | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | **Extraction Complete!** card | **Total URLs**, **Completed**, **Failed**, and **No data** counts. Failed and empty URLs are not charged. | | **Download ZIP file** / **Download All Results (ZIP)** | Saves `extracted_data.zip`: an XLSX, JSON, and CSV per social URL, and a Word document per web page. | | **Preview data** | Opens the data preview (below). It also opens on its own once the first URL finishes. | | **View in History** | Jumps to the batch in **History**. | | **Extract New** | Starts another batch. | | Per-URL row actions | **Preview data** or **Preview document**, **Download results**, **Download CSV**, **Download raw data (JSON)**, **Analyze now**, **Retry this URL** on a failed row, and **Stop this URL** while it runs. | After a download, the **Select Analysis** dialog offers **Analyze docx/pdf files** or **Analyze xlsx/csv files** for the file kinds in the batch, and carries the data across without a re-upload. ## The History tab
History tab listing past extractions with their status and the download, preview, and analyze actions

Expand a row to see every URL in the batch with its own actions.

| Control | What it does | | ------------------------ | ----------------------------------------------------------------------- | | **Refresh** | Reloads the list. | | **Status** | **Completed**, **In Progress**, **Error**, **Stopped**, or **No data**. | | **Source** | **Web** for a manual batch, **Scheduled** for a schedule's run. | | **Download all results** | The ZIP for the batch. | | **Preview data** | The data preview. | | **Analyze** | Opens **Select Analysis** for this batch. | | **Cancel extraction** | Stops the remaining URLs of a running batch. | | **Delete extraction** | Removes the batch after a confirmation. | ## The data preview | Control | What it does | | ------------------------------------------ | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | **Data source** tiles | **All sources** or one URL at a time, each with an **Open** link. | | Search, **All Authors**, **Clear filters** | Narrow the records. Click an author to show only that author. | | Date-range button | **All time**, **Today**, **Last 7 days**, **Last 30 days**, **This month**, and other presets, or a custom range. | | Stat cards | Total records, **Unique Authors**, total engagement, and **Average Rating** where reviews were collected, with change against the previous period when a range is set. | | **Volume over time** | A chart you can click to filter to a period; **Show full range** widens a zoomed view. | | **Export filtered** | An Excel file of the rows you are looking at. | | **Download ZIP**, **Analyze** | The full bundle; the analysis handoff. | | **Analyze using AI** | For a single spreadsheet: **Use AI to generate themes** or **Enter themes manually**, edit the result, then **Create project and start analysis**. Spreadsheet word limits apply. | ## The Scheduled tab | Control | What it does | | ---------------------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | **New schedule** | Opens **New Scheduled Extraction**: a **Name**, up to ten URLs (one per line), a **Frequency** of **Hourly**, **Daily**, **Weekly**, or **Monthly**, a **Preferred time** and **Timezone**, and the same advanced options. **Create schedule** saves it. | | **Status** | **Active**, **Paused**, or **Paused — insufficient funds**. | | **Pause schedule** / **Resume schedule** | Stops or restarts the runs. | | **Run now** | Runs the schedule immediately after a confirmation. | | **Preview latest run** | Opens the data preview of the last run. | | **Edit schedule**, **Delete schedule** | Change or remove it. | Every run consumes URL extractions like a normal batch, so keep the wallet topped up for long-running schedules; the number of schedules per account is capped. ## Next steps * [Collect Social Media & Web Data](/ailyze-docs/collect-research-data/collect-social-media-and-web-data.md) — the walkthrough these controls belong to. * [Social Media & Web Data Issues](/ailyze-docs/troubleshooting/social-media-web-data-issues.md) — rejected links, empty results, and charges. * [Spreadsheet Analysis Settings](/ailyze-docs/reference/settings/spreadsheet-analysis.md) — what happens after **Analyze now**.