Shopify store product scraping for artist merch

Need to populate artist merchandise data from official online stores. Most artist stores use Shopify but many URLs are guessed wrong, stores are down, or use non-Shopify platforms. Need a reliable method to test and scrape multiple artist stores efficiently.

Use the Shopify /products.json endpoint to both test and scrape stores. Pattern: 1) Build a list of candidate URLs per artist (store.{artist}.com, shop.{artist}.com, known alternative domains). 2) Test each with /products.json?limit=3 and 8-second timeout. 3) For working stores, fetch up to 20 products via /products.json?limit=20. 4) Extract: title, price from variants[0].price, image from images[0].src, handle for external_url. 5) Generate SQL with DO blocks for atomic product+post insertion. 6) Watch for PostgreSQL enum case sensitivity (MERCHANDISING not merchandising). Working stores found: store.taylorswift.com, shop.theweeknd.com, shop.arianagrande.com, store.dualipa.com, shop.beyonce.com, store.arcticmonkeys.com, store.machinegunkelly.com, shop.macmillerswebsite.com, store.wasteheadquarters.com, store.selenagomez.com, store.dojacat.com, store.sabrinacarpenter.com, store.cardib.com, shop.mileycyrus.com, shop.katyperry.com, blonded.co, slipknotmerch.com, shop.foofighters.com, store.billieeilish.com, shop.postmalone.com, store.oliviarodrigo.com, golfwang.com, shop.adele.com, shop.playboicarti.com.

Shopify exposes a public JSON API at /products.json that requires no authentication. This makes it the most reliable way to programmatically access product data from artist stores. The main challenge is URL discovery since there's no standard naming convention.