-
Notifications
You must be signed in to change notification settings - Fork 0
/
crawlers.html
80 lines (77 loc) · 3.04 KB
/
crawlers.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="UTF-8">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<title>crawlers</title>
<link rel="stylesheet" href="styles/sommaire.css">
</head>
<body>
<br>
<h2><a href="https://www.youtube.com/watch?v=h_HdKzsfxmg&t=257s" target="_blank" class="bg1">Legitimate Robots</a></h2>
<div class="blue">
<ul>
<li>
<a href="domxss/overview.html" target="_blank">Content Analysis</a> |
<a href="domxss/webmessaging.html">indexing for search systems</a> |
<a href="domxss/pwa.html" target="_blank">robots.txt</a> |
<a href="https://www.youtube.com/playlist?list=PLxeJU39M7tLG_oL4BUfbsTSZkj9J755oO" target="_blank"> Client-side Redirections</a> |
</li>
</ul>
</div>
<h2><a href="https://youtu.be/GY7MWbdkdas?t=650">Malicious Robots</a></h2>
<div class="red">
<ul>
<li><a href="domxss/papers.html"> Amateur web-robots</a> |
<a href="headers.html">Advanced web-robots</a> |
<a href="domxss/definition.html">Professional web-robots</a> |
<a href="domxss/slides.html">Slides</a> |
<a href="methodology/frameworks.html" target="_blank">Frameworks</a>
</li>
</ul>
</div>
<h2><a href="https://github.com/arkadiyt/bounty-targets-data/blob/master/data/domains.txt">Web-robot detection</a></h2>
<div class="green">
<ul>
<li><a href="twitter.html" target="_blank">Signature Analysis</a> |
<a href="twitter.html" target="_blank">Machine Learning</a> |
<a href="twitter.html" target="_blank">Server Log Analysis</a> |
<a href="twitter.html" target="_blank">Software Approaches</a>
</li>
</ul>
</div>
<h2>Languages</h2>
<div class="violet">
<ul>
<li><a href="languages/javascript.html">JavaScript</a> | <a href="python/python.html" target="_blank">Python</a> | Go</li>
</ul>
</div>
<h2>Entrepreneurship</h2>
<div class="orange">
<ul>
<li><a href="entrepreneurship/projects.html">Projects</a></li>
</ul>
</div>
<h2>Science</h2>
<div class="yellow">
<ul>
<li><a href="science/biology.html" target="_blank"> Biology </a> |
<a href="science/physics.html">Physics</a> |
<a href="science/technoscience.html">Technology</a></li>
</ul>
</div>
<h2>Literature</h2>
<div class="cyan">
<ul>
<li><a href="methodology/frameworks.html" target="_blank">Essays</a> |
<a href="https://www.youtube.com/watch?v=ek-BHosM5us" target="_blank">Novel</a></li>
</ul>
</div>
<h2>History</h2>
<div class="magenta">
<ul>
<li><a href="https://kontrekulture.com/produit/un-millenaire-de-trois-siecles-livre-numerique/" target="_blank">Recentism</a> | Archeology</li>
</ul>
</div>
</body>
</html>