Premium database | Specifications | DNS Database Download | WhoisXML API

Premium database

Samples

The premium database comes in five forms, which include A, AAAA, MX, NS, TXT, CNAME, SOA, and PTR records and can be downloaded in CSV.

Subscription type Description
Daily updates Include DNS records (A, AAAA, MX, NS, TXT, CNAME, SOA, PTR) that have been added during a previous day for a given date in unified and consistent CSV format. These files are located in the daily_datafeed subdirectory and are named in format:
- "daily_datafeed/premium_dns_database.%DATE%.daily.csv.gz"
- "daily_datafeed/premium_dns_aaaa_database.%DATE%.daily.csv.gz"
- "daily_datafeed/premium_dns_mx_database.%DATE%.daily.csv.gz"
- "daily_datafeed/premium_dns_ns_database.%DATE%.daily.csv.gz",
- "daily_datafeed/premium_dns_txt_database.%DATE%.daily.csv.gz",
- "daily_datafeed/premium_dns_cname_database.%DATE%.daily.csv.gz",
- "daily_datafeed/premium_dns_soa_database.%DATE%.daily.csv.gz",
- "daily_datafeed/premium_dns_ptr_database.%DATE%.daily.csv.gz",
e.g. "daily_datafeed/premium_dns_database.2021-12-01.daily.csv.gz".
Weekly updates Include changes in the full database of DNS records compared to the previous period. Includes added, dropped, and modified records since the previous week. These files are named in format:
- "premium_dns_database.%DATE%.weekly.diff.csv.gz"
- "premium_dns_aaaa_database.%DATE%.weekly.diff.csv.gz"
- "premium_dns_mx_database.%DATE%.weekly.diff.csv.gz",
- "premium_dns_ns_database.%DATE%.weekly.diff.csv.gz",
- "premium_dns_txt_database.%DATE%.weekly.diff.csv.gz",
- "premium_dns_cname_database.%DATE%.weekly.diff.csv.gz",
- "premium_dns_soa_database.%DATE%.weekly.diff.csv.gz",
- "premium_dns_ptr_database.%DATE%.weekly.diff.csv.gz",
e.g. "premium_dns_database.2021-12-01.weekly.diff.csv.gz".
Monthly updates Include changes in the full database of DNS records compared to the previous period. Includes added, dropped, and modified records since the previous month. These files are named in format:
- "premium_dns_database.%DATE%.monthly.diff.csv.gz"
- "premium_dns_aaaa_database.%DATE%.monthly.diff.csv.gz"
- "premium_dns_mx_database.%DATE%.monthly.diff.csv.gz",
- "premium_dns_ns_database.%DATE%.monthly.diff.csv.gz",
- "premium_dns_txt_database.%DATE%.monthly.diff.csv.gz",
- "premium_dns_cname_database.%DATE%.monthly.diff.csv.gz",
- "premium_dns_soa_database.%DATE%.monthly.diff.csv.gz",
- "premium_dns_ptr_database.%DATE%.monthly.diff.csv.gz",
e.g. "premium_dns_database.2021-12-01.monthly.diff.csv.gz".
Full database A full database of DNS records (A, AAAA, MX, NS, TXT, CNAME, SOA, PTR) collected for the previous 90 days before a given date in a unified and consistent CSV format. These files are named in format:
- "premium_dns_database.%DATE%.full.csv.gz"
- "premium_dns_aaaa_database.%DATE%.full.csv.gz"
- "premium_dns_mx_database.%DATE%.full.csv.gz"
- "premium_dns_ns_database.%DATE%.full.csv.gz",
- "premium_dns_txt_database.%DATE%.full.csv.gz",
- "premium_dns_cname_database.%DATE%.full.csv.gz",
- "premium_dns_soa_database.%DATE%.full.csv.gz",
- "premium_dns_ptr_database.%DATE%.full.csv.gz",
e.g. "premium_dns_database.2021-12-01.full.csv.gz".
Lite database A partial database of A DNS records for a given date made for academic purposes. It includes about 5% of a full database. These files are named in format:
- "premium_dns_database.%DATE%.academic.csv.gz"
e.g. "premium_dns_database.2021-12-01.academic.csv.gz".


Note that the weekly and monthly data are derived from the concatenation of the respective daily data and the addition of the first field, the date.

Downloading via HTTPS

Downloading via FTP

Downloading via FTPs

Read more about the FTPS connection: https://en.wikipedia.org/wiki/FTPS.

Our FTP server supports explicit FTP over TLS encryption. You may configure your FTP client to use explicit FTP over TLS encryption for secure communications.

Our FTPS server is accessed using the same paths and API keys as a regular FTP server, the instructions for which are described above. To connect via FTPS, select the "Require explicit FTP over TLS" encryption option in your FTP client, if it supports it. FileZilla configuration example:

explicit FTP over TLS encryption

Average file sizes

A files

File content Filename suffix Avg. gzipped file size Avg. unpacked file size Avg. number of records
Weekly full database export .full 30GB 164.5GB 2,200.6M
Weekly changes in the full database .weekly.diff 19GB 104.5GB 1,326.9M
Records added during the previous day .daily 1.9GB 9.5GB 134.3M

MX files

File content Filename suffix Avg. gzipped file size Avg. unpacked file size Avg. number of records
Weekly full database export .full 4.9GB 61.6GB 538.2M
Weekly changes in the full database .weekly.diff 418MB 8.2GB 44.2M
Records added during the previous day .daily 85MB 1.6GB 9.0M

NS files

File content Filename suffix Avg. gzipped file size Avg. unpacked file size Avg. number of records
Weekly full database export .full 8.7GB 115GB 1,173.5M
Weekly changes in the full database .weekly.diff 628MB 15GB 84.4M
Records added during the previous day .daily 147MB 3.3GB 19.6M

TXT files

File content Filename suffix Avg. gzipped file size Avg. unpacked file size Avg. number of records
Weekly full database export .full 4.4GB 20.9GB 238.8M
Weekly changes in the full database .weekly.diff 244MB 1.8GB 16.7M
Records added during the previous day .daily 55MB 249MB 2.9M

CNAME files

File content Filename suffix Avg. gzipped file size Avg. unpacked file size Avg. number of records
Weekly full database export .full 3.6GB 20GB 329.5M
Weekly changes in the full database .weekly.diff 586MB 3.8GB 51.3M
Records added during the previous day .daily 39MB 179MB 2.3M

SOA files

File content Filename suffix Avg. gzipped file size Avg. unpacked file size Avg. number of records
Weekly full database export .full 9.3GB 102GB 556.1M
Weekly changes in the full database .weekly.diff 968MB 15.7GB 69.6M
Records added during the previous day .daily 142MB 2.7GB 8.7M

AAAA files

File content Filename suffix Avg. gzipped file size Avg. unpacked file size Avg. number of records
Weekly full database export .full 3.3GB 16.5GB 174.6M
Weekly changes in the full database .weekly.diff 1.7GB 9.1GB 84M
Records added during the previous day .daily 167MB 901MB 8.2M

PTR files

File content Filename suffix Avg. gzipped file size Avg. unpacked file size Avg. number of records
Weekly full database export .full 249MB 1.7GB 27.0M
Weekly changes in the full database .weekly.diff 37MB 271MB 3.8M
Records added during the previous day .daily 23MB 163MB 2.5M

CSV output structure and fields' descriptions

The database files are comma-separated value-files without text delimiters. The files use DOS/Windows - style line terminators (CR+LF). The first line is a header line with the field names. Each line has four or five fields depending on the subscription type:

A files

  • Structure: <DOMAIN>,<LAST_UPDATE_TIMESTAMP>,<IP1> <IP2> ... <IPn>
  • Example: zs12p1.gotoip1.com.cname.yunjiasu-cdn.net,1530959456,162.159.210.99 162.159.211.99
DOMAIN
Domain or subdomain name.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record. If there is more than one IP address, the timestamp corresponds to all of them.
IP1, IP2, IPn
List of IPs associated with the domain, separated by space.

AAAA files

  • Structure: <DOMAIN>,<LAST_UPDATE_TIMESTAMP>,<IP1> <IP2> ... <IPn>
  • Example: 212120--jekyllrb.netlify.app,1647929159,2604:a880:400:d0::1738:6301 2604:a880:400:d0::1b6b:7051
DOMAIN
Domain or subdomain name.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record. If there is more than one IP address, the timestamp corresponds to all of them.
IP1, IP2, IPn
List of IPs associated with the domain, separated by space.

MX files

  • Structure:
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<PRIORITY>,<MX1>
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<PRIORITY>,<MX2>
    - <DOMAIN-B>,<LAST_UPDATE_TIMESTAMP>,<PRIORITY>,<MX1>
    - ...
  • Example:
    - 003vendor.com,1608996228,20,alt1.aspmx.l.google.com
    - 003vendor.com,1608996228,20,alt2.aspmx.l.google.com
DOMAIN
Domain or subdomain name.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record.
PRIORITY
Priority identifies which mailserver should be preferred.
MX
The MX record associated with the domain.

NS files

  • Structure:
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<NS1>
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<NS2>
    - <DOMAIN-B>,<LAST_UPDATE_TIMESTAMP>,<NS1>
    - ...
  • Example:
    - 0001.cn,1608996268,dns1.hichina.com
    - 0001.cn,1608996268,dns2.hichina.com
DOMAIN
Domain or subdomain name.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record.
NS
The NS record associated with the domain.

TXT files

  • Structure:
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<TXT1>
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<TXT2>
    - <DOMAIN-B>,<LAST_UPDATE_TIMESTAMP>,<TXT1>
    - ...
  • Example:
    - 0--00.holiest.science,1619741985,|v=spf1 ip4:67.225.166.63 +a +mx +ip4:67.225.166.41 ~all!
    - 0--00.holiest.science,1619741985,|v=spf1 ip4:67.225.166.63 +a +mx +ip4:67.225.166.41 ~alla
DOMAIN
Domain or subdomain name.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record.
TXT
The TXT record associated with the domain.

CNAME files

  • Structure:
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<CNAME1>
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<CNAME2>
    - <DOMAIN-B>,<LAST_UPDATE_TIMESTAMP>,<CNAME1>
    - ...
  • Example:
    - 0-131-3-149.rackcentre.redstation.net.uk,1619742251,redstation.com
    - 0-132-3-149.rackcentre.redstation.net.uk,1619741776,redstation.com
DOMAIN
Domain or subdomain name.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record.
CNAME
The CNAME record associated with the domain.

SOA files

  • Structure:
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<SOA1>
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<SOA2>
    - <DOMAIN-B>,<LAST_UPDATE_TIMESTAMP>,<SOA1>
    - ...
  • Example:
    - 0-rings.com,1619741730,NS25.DOMAINCONTROL.com dns.jomax.net 2018091300 28800 7200 604800 3600
    - 0-rings.com,1619741730,NS25.domaincontrol.com dns.jomax.net 2018091300 28800 7200 604800 3600
DOMAIN
Domain or subdomain name.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record.
SOA
The SOA record associated with the domain.

PTR files

  • Structure:
    - <IP-A>,<LAST_UPDATE_TIMESTAMP>,<PTR1>
    - <IP-A>,<LAST_UPDATE_TIMESTAMP>,<PTR2>
    - <IP-B>,<LAST_UPDATE_TIMESTAMP>,<PTR1>
    - ...
  • Example:
    - 1.0.135.155,1661516953,node-1i3.pool-1-0.dynamic.totinternet.net
    - 1.0.0.1,1661724824,one.one.one.one
IP
IP address.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record.
PTR
The PTR record associated with the IP.