0
0
mirror of https://git.sdf.org/deCloudflare/deCloudflare/ synced 2024-06-27 11:49:18 +00:00
deCloudflare/instructions.md

165 lines
6.2 KiB
Markdown
Raw Normal View History

2019-02-25 02:09:59 +00:00
# Instructions
--------------
2018-10-11 13:00:30 +00:00
2019-02-25 02:09:59 +00:00
## Website is using Cloudflare
2018-10-11 13:00:30 +00:00
2019-05-07 09:49:47 +00:00
**Cloudflare users** | [**List Directory**](cloudflare_users/)
2019-05-06 12:13:39 +00:00
2018-10-11 13:00:30 +00:00
| List name | Description |
2018-10-11 13:04:44 +00:00
| -------- | -------- |
2019-08-11 14:18:35 +00:00
| **/domain/cloudflare_?.txt** | **Split files (base domain)** |
2019-02-25 02:20:36 +00:00
| ex_cloudflare_users.txt | Domains which used Cloudflare in the past, not anymore |
2019-05-10 05:07:38 +00:00
| cloudflare_supporter.txt | who is using Cloudflare or endorsing Cloudflare. (URL only) |
2019-05-06 12:13:39 +00:00
2019-05-07 09:49:47 +00:00
**Cloudflare Corporation** | [**List Directory**](cloudflare_inc/)
2019-05-06 12:13:39 +00:00
| List name | Description |
| -------- | -------- |
2019-02-25 02:20:36 +00:00
| cloudflare_CIDR_v4.txt | IPv4 CIDR owned by Cloudflare |
| cloudflare_CIDR_v6.txt | IPv6 CIDR owned by Cloudflare |
| cloudflare_range_v4.txt | IPv4 range owned by Cloudflare |
| cloudflare_owned_ASN.txt | AS network owned by Cloudflare |
2019-03-02 03:41:09 +00:00
| cloudflare_owned_NS.txt | Name Server owned by Cloudflare |
2018-10-11 13:17:40 +00:00
| cloudflare_owned_domains.txt | Domains owned by Cloudflare |
| cloudflare_owned_onions.txt | Tor .onions owned by Cloudflare |
2019-05-07 09:53:24 +00:00
| cloudflare_members.txt | Cloudflare employer & employee |
2018-10-11 13:00:30 +00:00
2018-10-11 13:12:11 +00:00
1) How to detect Cloudflare
2018-10-11 13:00:30 +00:00
2019-03-02 23:01:42 +00:00
There are many ways to detect it:
2018-10-11 13:12:11 +00:00
- [These add-ons](what-to-do.md) will help your Cloudflare collection.
- Visit a website via Tor or VPN, and you will be greeted by "Attention Required! Cloudflare" webpage.
2019-08-23 11:42:03 +00:00
- Use "[Is MITM?](https://searxes.eu.org/collab/sxes/tool_ismitm.php)" webpage.
2019-03-02 23:01:42 +00:00
- Dig "[NS record](https://www.digwebinterface.com/?hostnames=emsisoft.com&type=NS&ns=resolver&useresolver=8.8.4.4&nameservers=)" of the domain.
2019-03-02 23:02:09 +00:00
2019-03-02 23:01:42 +00:00
```
emsisoft.com. 21599 IN NS bella.ns.cloudflare.com.
emsisoft.com. 21599 IN NS dom.ns.cloudflare.com.
```
2019-03-02 23:02:09 +00:00
2019-03-02 23:01:42 +00:00
- Dig "[A record](https://www.digwebinterface.com/?hostnames=dev.qubes-os.org&type=A&ns=resolver&useresolver=8.8.4.4&nameservers=)" of the FQDN, then [check the IP's owner](https://ipinfo.io/104.18.228.122).
2019-03-02 23:02:09 +00:00
2019-03-02 23:01:42 +00:00
```
dev.qubes-os.org. 299 IN A 104.18.228.122
ASN AS13335 Cloudflare, Inc.
Organization Cloudflare, Inc.
Route 104.18.224.0/20
```
2018-10-11 13:00:30 +00:00
2019-04-02 02:11:43 +00:00
2019-04-01 23:11:34 +00:00
2) How to add your data (A or B)
2019-07-11 13:17:30 +00:00
Type A: Push to Codeberg.org
2018-10-11 13:00:30 +00:00
2019-07-11 13:17:30 +00:00
1. Log in to *Codeberg.org*.
2019-02-25 02:09:59 +00:00
2. Click "*Fork*" button. (top-left corner)
2018-10-11 13:12:11 +00:00
3. Edit text file.
2019-02-25 02:09:59 +00:00
4. Click *Double-arrow* button to create a *new pull request*.
2018-10-11 13:00:30 +00:00
2018-10-11 13:12:11 +00:00
```
2019-02-25 02:14:30 +00:00
IMPORTANT: Please add only "Base Domain"
2019-02-25 02:09:59 +00:00
if "community.example.com" is using Cloudflare
2019-02-25 02:14:30 +00:00
add "example.com"
if "www.example.co.uk" is using Cloudflare
add "example.co.uk"
2019-02-25 02:09:59 +00:00
if "example.net" is using Cloudflare
2019-02-25 02:14:30 +00:00
add "example.net"
... to /split/cloudflare_e.txt
2019-02-25 02:09:59 +00:00
```
2019-08-23 11:42:03 +00:00
Type B: Use "[Is MITM?](https://searxes.eu.org/collab/sxes/tool_ismitm.php)" webpage. Just scan the FQDN.
2019-04-01 23:11:34 +00:00
2019-05-08 00:16:56 +00:00
3) If the website *no longer using Cloudflare*, *remove* it from /split/ list and *add* to "[ex_cloudflare_users.txt](cloudflare_users/ex_cloudflare_users.txt)".
2018-04-18 16:27:14 +00:00
2019-02-25 02:09:59 +00:00
--------------
2018-04-18 16:25:19 +00:00
2019-02-25 02:09:59 +00:00
## Website is NOT using Cloudflare (& blocking you)
2018-04-18 16:25:19 +00:00
2019-05-07 09:49:47 +00:00
**Anti-Tor users** (formerly "*TorBlocker Hall of Shame Part I*") | [**List Directory**](not_cloudflare/)
2019-03-05 02:35:07 +00:00
| List name | Description |
| -------- | -------- |
2019-08-11 14:16:41 +00:00
| **/cidr_data/?.txt** | **other CDN IPv4 CIDR files** |
| **list_othercdn_domain.txt** | **domains behind these CDN (Not Cloudflare)** |
2019-08-09 15:54:09 +00:00
| list_http_error.txt | Websites that instantly and unconditionally deny service to Tor visitors by returning an HTTP error. HTTP 403 is the most common but this list catalogs all HTTP responses that entail DoS (i.e. not HTTP 200). File format is: <FQDN> <http error code> |
| list_customerror.txt | Custom error message renders for Tor visitors generally without HTTP error. |
| list_other.txt | Any other form of tor-hostility or mistreatment. This includes sites somewhat functional for Tor users to some extent but sneaky and unexpected adverse retalitory actions are taken against Tor visitors. |
2019-08-11 14:18:35 +00:00
| list_formerly_tor-hostile.txt | _was_ previously on one of the above tor-hostile lists |
2019-03-05 02:35:07 +00:00
2019-08-15 06:47:32 +00:00
![](image/siteground.jpg)
Above is how Siteground-hosted(INAP) sites often appear to Tor visitors when timeouts/tarpitting doesn't occur.
If you see this please update `list_othercdn_domain.txt`. (CDN ID: Z7)
2019-04-03 23:23:12 +00:00
2019-08-11 14:31:31 +00:00
```
list_othercdn_domain.txt
{domain} {CDN code}
{CDN code}:
'amazon.txt':'Z1'
'akamai.txt':'Z2'
'imperva.txt':'Z4'
'google.txt':'Z5'
'microsoft.txt':'Z6'
'inap.txt':'Z7'
2019-08-15 06:47:32 +00:00
'sucuri.txt':'Z8'
2019-08-11 14:31:31 +00:00
```
2019-03-05 02:37:27 +00:00
```
2019-05-08 22:48:08 +00:00
IMPORTANT: Please add only "FQDN" or "FQDN[space](comment here)"
2019-03-10 23:44:36 +00:00
if "community.example.com" is blocking Tor
2019-05-08 22:48:08 +00:00
add "community.example.com"
2019-03-10 23:44:36 +00:00
2019-05-08 22:48:08 +00:00
if "example.co.uk" is blocking Tor
2019-03-10 23:44:36 +00:00
add "example.co.uk Error message: Anonymous not allowed"
2019-03-05 02:37:27 +00:00
```
2019-03-05 02:35:07 +00:00
2019-02-25 02:09:59 +00:00
Some websites use other companies with the CloudFlare business model.
2018-04-18 16:25:19 +00:00
2019-02-25 02:09:59 +00:00
This is a collection of websites that ban Tor exits, other than through Cloudflare(e.g. showing access denied pages, systematic timing out connections, ...).
2019-03-05 02:38:30 +00:00
[Add-on "whyrejectme"](README.md#what-can-you-do) will help your `list_http_error.txt` collection.
2019-08-09 15:17:02 +00:00
2019-07-11 13:17:30 +00:00
---
Information:
- [How to setup git](instructions_git.md)
2019-08-24 03:54:25 +00:00
- About Cloudflare `base domain` list
Our mission is clear - `stay away from Cloudflare`.
2019-08-24 03:56:50 +00:00
If the `subdomain.example.com` is cloudflared, we add `example.com` to the database. (`subdomain.example.com` is the sub-domain of `example.com`. Only `the owner` of `example.com` can create sub-domain)
2019-08-24 03:54:25 +00:00
2019-08-24 03:56:50 +00:00
Even if `whatever.example.com` is _not_ behind cloudflare we _will_ raise a warning, because the base domain `example.com` is `cloudflare user`.
2019-08-24 03:54:25 +00:00
`The owner` of `example.com` can enable Cloudflare to `whatever.example.com` at any time without user's notice. It can be done from `dash.cloudflare.com` webpage or hitting `Cloudflare API`. `The owner` is supporting `Cloudflare` and this is severe `security risk`.
2019-08-24 03:56:50 +00:00
Until `the owner` completely stop using Cloudflare service for `example.com`, we _do not_ remove `example.com` from the database.
2019-08-24 03:54:25 +00:00
There is `no exception`.
2019-08-24 03:56:50 +00:00
If `the owner` moved away from `cloudflare` **completely**, you are welcome to add `example.com` to the "[ex_cloudflare_users.txt](cloudflare_users/ex_cloudflare_users.txt)" - after checking `example.com` with online tool below.
2019-08-24 03:54:25 +00:00
1. Open "[Is MITM?](https://searxes.eu.org/collab/sxes/tool_ismitm.php)" webpage.
3. Input `gitlab.com` and `mastodon.technology` and click `Skanu`.
4. Click `testo` for detailed scan.
`Only a few Cloudflare user leave Cloudflare. False positive is uncommon.`