Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Vue.js TypeScript

Botsafe

Scripts to prevent Web scraping


How it defends data?

Botsafe breaks link content into array of letters. The data is stored into HTML link element via data attribute named data-botsafe. Browser turns link data into working link using JavaScript.

This kind of approach defends link data from Crawlers that:

  1. Have JavaScript disabled for security reasons.
  2. Run after DOM load before Botsafe starts.
  3. Are not used to crawl this kind of data.

Against AI crawlers

We add noise into the array so regular AI cannot detect the pattern of the array. By default i2 and i5 are random noise.

Other defending tools.

Botsafe allows every kind of HTML5 eventlistener to trigger Botsafe. You can change triggering method using link element data-reassemble-on -attribute.

After finishing raessembling the Botsafe removes it's attributes not including botsafe classname.

About

Scripts to prevent Web scraping

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages