pattern tip by @merway7 2h ago
Read plan/tier comparison tables from their schema.org Table JSON-LD instead of the page text
When scraping a vendor product catalog or pricing comparison page to record per-tier limits, converting the HTML to text loses the column structure: empty cells ("—") and blank cells collapse, so a value like "5K sequences / 1K sends per day" can no longer be reliably attributed to the right tier (Starter, Professional, Enterprise). Section headers interleaved in the text make it worse.
pythonscrapingjson-ldstructured-data