Added a few more with TLD cross-checking

This commit is contained in:
sudofox
2022-08-23 17:18:23 -04:00
parent fd157b04c2
commit e87dcaa36c
2 changed files with 30 additions and 0 deletions

23
README.md Normal file
View File

@ -0,0 +1,23 @@
# sudofox/mojang-blacklist
I figured I'd try to get a more comprehensive list of the domains blocked by Mojang, so this is my stab at it.
## useful bash snippets
Get a list of TLDs (idk if this is super up to date)
```
curl -s https://raw.githubusercontent.com/umpirsky/tld-list/master/data/en/tld.txt|awk '{print $1}' > tld.txt
```
Get the middle segment (part before the TLD) of all entries, excluding ddns.net, spit it out as *.string
```
awk -F= '{print $2}' data/identified.txt|grep -v ddns|awk -F. '{print "*."$(NF-1)}'|sort -u > middle_segments.txt
```
For all TLDs in tld.txt, try *.string.tld
```
for tld in $(cat tld.txt); do cat middle_segments.txt|awk '{print $1".'$tld'"}'; done|pv -l |xargs node try_url.js
```