1001 Freelance Projects -- Scraping mobile app leboncoin API (datadome protection)

Latest Projects from Freelance Marketplaces

Today is: 25-Apr-2024 20:24 GMT

View this project in detail (Note: you will be redirected to external marketplace)
Project title:	Scraping mobile app leboncoin API (datadome protection)
Posted by:	External project from Upwork
Started:	18-Dec-2022 23:55 GMT
Description:	I would like to scrape all the real estate data from the mobile App / Website Leboncoin.fr. This app/website use an API https://api.leboncoin.fr to return the results. I previously did a working scraper in ruby that imitated the API requests from the mobile APP, but since few weeks it doesn't work anymore. 1. Milestone 1: 100$ (30 mins) downloading Leboncoin mobile app (https://www.leboncoin.fr/) , monitoring the https network activity for fetching results via the API (using charles proxy or ) and saving the HTTPS requests & responses into a file so I can see and reproduce the sequencce (via curl for instance). The goal is to see all the sequences from the start , when the user search all the sellings in Paris from 50K to 500K ( cateory "real estate selling" as category , "Paris" as city, " price between 50K to 500K) and the results. The delivery is a charles proxy session when I can get all the sequence between the mobile phone app and the leboncoin API service. 2; Milestone 2 (900$) : Finding a robust way to bypass the protection. the script should be run on ruby or nodejs. Tips: previously I used ip rotation and a bit of JA3 fingerprint (using the npm cycletls module) but quickly got capchas. I checked the website leboncoin.fr , it is protected by datadome (= get a preliminar request to https://dd.leboncoin.fr/js to get valid datadome cookie for the next requests of the api.leboncoin.fr). (maybe it is the same way for the mobile app) find a discussion talking about that https://github.com/RSS-Bridge/rss-bridge/issues/1820 for milestone2 , you can search a bit on github to see the previous works/attempts e.g; "leboncoin datadome" - https://github.com/RSS-Bridge/rss-bridge/issues/1820 or "datadome jsdata") . Actually mobile app of website I dont care which request to imitate but I want something that's work . If the only reliable way is solving the captcha (by 3rd workers), I am ok that you test such solution in the last case. (https://github.com/MoterHaker/bypass-captcha-examples/blob/main/geo.captcha-delivery.com.js). if this solution reliably work let me know Delivering for Milestone 2. - The wrapper script should be able to take a API request and send the results in json a scripts - a short video/text about explaining how you did it. Please check the gist https://gist.github.com/nmaisonneuve/25c2ccdafeceab4ff13f841d96032860 You will find more detailed delivery instruction for Milestone 2 and maybe a starting point. Budget: $1,000 Posted On: December 18, 2022 23:55 UTC Category: Data Extraction Skills:Data Scraping, Node.js Skills: Data Scraping, Node.js Country: France click to apply
Project ID:	3300572
Project category:	Data Scraping, Node.js
Project budget:	$1,000
View this project in detail (Note: you will be redirected to external marketplace)

Project	Started
I.T. Assistance Required - Wordpress, Elementor Pro, WooCommerce	25-Apr-2024 15:23 GMT
Create photo realistic images of new house build	25-Apr-2024 15:13 GMT
Looking for someone near Liverpool to support with video work	25-Apr-2024 15:08 GMT
NATIVE FRENCH VIDEO EDITOR & CAPTIONIST	25-Apr-2024 15:05 GMT
PPC Paid Ads Manager for Tradesman Software	25-Apr-2024 15:04 GMT
i need a figma designer	25-Apr-2024 15:04 GMT
Recreate Website from Website Builder to WordPress	25-Apr-2024 15:04 GMT
Create a bot that sends my trades as signals to telegram	25-Apr-2024 15:02 GMT
Social Media Expert	25-Apr-2024 14:59 GMT
CAD person 4 drawings 4 extension at home - PSE READ THE ADVERT	25-Apr-2024 14:59 GMT
UK based PR - sustainability , game, edutainment	25-Apr-2024 14:59 GMT
Packaging Design for a Frozen Food Brand	25-Apr-2024 14:31 GMT
A4 poster for dental whitening	25-Apr-2024 14:31 GMT
Website on Wordpress	25-Apr-2024 14:29 GMT
Brand Logo	25-Apr-2024 14:29 GMT

Browse All Projects

Projects by Skills ...
Projects for 'android' Projects for 'ajax' Projects for 'asp' Projects for 'aspnet' Projects for 'cms' Projects for 'cpp' Projects for 'csharp' Projects for 'css' Projects for 'delphi' Projects for 'design' Projects for 'drupal'	Projects for 'excel' Projects for 'facebook' Projects for 'flash' Projects for 'html' Projects for 'java' Projects for 'javascript' Projects for 'joomla' Projects for 'iphone' Projects for 'mysql' Projects for 'photoshop' Projects for 'php' Projects for 'python'	Projects for 'ruby' Projects for 'seo' Projects for 'sql' Projects for 'sysadm' Projects for 'translate' Projects for 'typing' Projects for 'twitter' Projects for 'vbnet' Projects for 'xml' Projects for 'wordpress' Projects for 'writing'
Read RSS feeds ... New!
RSS feed for 'android' RSS feed for 'ajax' RSS feed for 'asp' RSS feed for 'aspnet' RSS feed for 'cms' RSS feed for 'cpp' RSS feed for 'csharp' RSS feed for 'css' RSS feed for 'delphi' RSS feed for 'design' RSS feed for 'drupal'	RSS feed for 'excel' RSS feed for 'facebook' RSS feed for 'flash' RSS feed for 'html' RSS feed for 'java' RSS feed for 'javascript' RSS feed for 'joomla' RSS feed for 'iphone' RSS feed for 'mysql' RSS feed for 'photoshop' RSS feed for 'php' RSS feed for 'python'	RSS feed for 'ruby' RSS feed for 'seo' RSS feed for 'sql' RSS feed for 'sysadm' RSS feed for 'translate' RSS feed for 'typing' RSS feed for 'twitter' RSS feed for 'vbnet' RSS feed for 'xml' RSS feed for 'wordpress' RSS feed for 'writing'

New!
Проекты на русском (Projects in Russian)	Long URL: www.1001freelanceprojects.com	Mobile version: m.1001fp.com