File tree Expand file tree Collapse file tree 1 file changed +2
-50
lines changed Expand file tree Collapse file tree 1 file changed +2
-50
lines changed Original file line number Diff line number Diff line change 1
- User-agent: GPTBot
2
- Disallow: /
3
-
4
- User-agent: Google-Extended
5
- Disallow: /
6
-
7
- User-agent: Amazonbot
8
- Disallow: /
9
-
10
- User-agent: Applebot
11
- Disallow: /
12
-
13
- User-agent: anthropic-ai
14
- Disallow: /
15
-
16
- User-agent: Bytespider
17
- Disallow: /
18
-
19
- User-agent: CCBot
20
- Disallow: /
21
-
22
- User-agent: ChatGPT-User
23
- Disallow: /
24
-
25
- User-agent: ClaudeBot
26
- Disallow: /
27
-
28
- User-agent: Claude-Web
29
- Disallow: /
30
-
31
- User-agent: Diffbot
32
- Disallow: /
33
-
34
- User-agent: FacebookBot
35
- Disallow: /
36
-
37
- User-agent: ImagesiftBot
38
- Disallow: /
39
-
40
- User-agent: Omgilibot
41
- Disallow: /
42
-
43
- User-agent: Omgili
44
- Disallow: /
45
-
46
- User-agent: PerplexityBot
47
- Disallow: /
48
-
49
- User-agent: YouBot
50
- Disallow: /
1
+ User-agent: *
2
+ Allow: /
You can’t perform that action at this time.
0 commit comments