I need to capture details from all product detail pages that are linked pages linked to in this site map - https://www.selectcarleasing.co.uk/sitemap-vehicles
The top level sitemap links down to 82 lower level sitemaps which then each link to product description pages.
Examples:
Top level sitemap: /sitemap-vehicles Sub-sitemap: /sitemap-derivative-groups?channel_id=car-leasing&page=1 Product Description Page: /car-leasing/hyundai/bayon/suv/10-tgdi-premium-5dr-dct
For each product description page I need the following fields pulled from the URL:
Manufacturer:text Model:text Bodytype: text Derivative: text MIleage: number Term: number
In addition, for each product description I need the following fields scraped from the page:
Initial Payment: number Monthly Payment: number Delivery Status: text
The attached PDF shows where each field can be found.
Data should be output in an excel friendly CSV with URL followed by the fields for that URL.
