Help with robots.txt to block URL patterns

1

I need help writing a robots.txt to block the following URL patterns:

http://www.server.com/1234/12/
http://www.server.com/5645/22/

The first set of numbers may vary but they are always 4 digits, the second are any two digits.

There may be some URLs similar to these:

http://www.server.com/1234/12/page.html
http://www.server.com/1234/1212/page.html
http://www.server.com/1234/12/img/page.html

These should not be blocked.

For now something like this is tried, but I'm not sure if it works:

Disallow: /*/*/$
Disallow: /1234/*/$
    
asked by nullptr 21.01.2018 в 23:45
source

0 answers