Specifications | DNS Database Download | WhoisXML API

Specifications

This data feed subscription is licensed to you or your organization only, you may not resell or relicense the data without explicit written permission from Whois API LLC. Any violation will be prosecuted to the fullest extent of the law.

Please go to https://www.whoisxmlapi.com/support/WhoisAPIDatabaseSLA.pdf to view the complete license agreement.

FAQs

  • Data Dictionaries for Database Download Products: HTML, ODT, PDF
  • Learn what each type of DNS record can be used for here.

The database comes in three forms, which include A, AAAA, MX, NS, TXT, CNAME, SOA, and PTR records and can be downloaded in CSV.

  • Full databases — a full database of DNS records (A, AAAA, MX, NS, TXT, CNAME, SOA, PTR) for a given date in unified and consistent CSV format. These files are named in format:
    "dns_database.%DATE%.full.csv.gz"
    "dns_aaaa_database.%DATE%.full.csv.gz"
    "dns_mx_database.%DATE%.full.csv.gz"
    "dns_ns_database.%DATE%.full.csv.gz",
    "dns_txt_database.%DATE%.full.csv.gz",
    "dns_cname_database.%DATE%.full.csv.gz",
    "dns_soa_database.%DATE%.full.csv.gz",
    "dns_ptr_database.%DATE%.full.csv.gz",
    e.g. "dns_database.2021-12-01.full.csv.gz".
  • Incremental databases — changes in the full database of DNS records compared to the previous period. Includes added, dropped, and modified records since the previous week/month. These files are named in format:
    "dns_database.%DATE%.monthly.diff.csv.gz"
    "dns_database.%DATE%.weekly.diff.csv.gz"
    "dns_aaaa_database.%DATE%.monthly.diff.csv.gz"
    "dns_aaaa_database.%DATE%.weekly.diff.csv.gz"
    "dns_mx_database.%DATE%.monthly.diff.csv.gz",
    "dns_mx_database.%DATE%.weekly.diff.csv.gz",
    "dns_ns_database.%DATE%.monthly.diff.csv.gz",
    "dns_ns_database.%DATE%.weekly.diff.csv.gz",
    "dns_txt_database.%DATE%.monthly.diff.csv.gz",
    "dns_txt_database.%DATE%.weekly.diff.csv.gz",
    "dns_cname_database.%DATE%.monthly.diff.csv.gz",
    "dns_cname_database.%DATE%.weekly.diff.csv.gz",
    "dns_soa_database.%DATE%.monthly.diff.csv.gz",
    "dns_soa_database.%DATE%.weekly.diff.csv.gz",
    "dns_ptr_database.%DATE%.monthly.diff.csv.gz",
    "dns_ptr_database.%DATE%.weekly.diff.csv.gz",
    e.g. "dns_database.2021-12-01.weekly.diff.csv.gz".
  • Lite databases — a partial database of A DNS records for a given date made for academic purposes. It includes about 5% of a full database. These files are named in format:
    "dns_database.%DATE%.academic.csv.gz" e.g. "dns_database.2021-12-01.academic.csv.gz".
  • Daily updates — these updates include DNS records (A, AAAA, MX, NS, TXT, CNAME, SOA, PTR) that have been added during a previous day for a given date in unified and consistent CSV format. These files are located in the daily_datafeed subdirectory and are named in format:
    "daily_datafeed/dns_database.%DATE%.daily.csv.gz"
    "daily_datafeed/dns_aaaa_database.%DATE%.daily.csv.gz"
    "daily_datafeed/dns_mx_database.%DATE%.daily.csv.gz"
    "daily_datafeed/dns_ns_database.%DATE%.daily.csv.gz",
    "daily_datafeed/dns_txt_database.%DATE%.daily.csv.gz",
    "daily_datafeed/dns_cname_database.%DATE%.daily.csv.gz",
    "daily_datafeed/dns_soa_database.%DATE%.daily.csv.gz",
    "daily_datafeed/dns_ptr_database.%DATE%.daily.csv.gz",
    e.g. "daily_datafeed/dns_database.2021-12-01.daily.csv.gz".

Samples

Downloading via HTTPS

Downloading via FTP

Downloading via FTPS

Read more about the FTPS connection: https://en.wikipedia.org/wiki/FTPS.

Our FTP server supports explicit FTP over TLS encryption. You may configure your FTP client to use explicit FTP over TLS encryption for secure communications.

Our FTPS server is accessed using the same paths and API keys as a regular FTP server, the instructions for which are described above. To connect via FTPS, select the "Require explicit FTP over TLS" encryption option in your FTP client, if it supports it. FileZilla configuration example:

explicit FTP over TLS encryption

Average file sizes

A files

File content Filename suffix Avg. gzipped file size Avg. unpacked file size Avg. number of records
Partial database for academic purposes .academic 4.6GiB 17.0GiB 513.4M
Weekly full database export .weekly.full 8.9GiB 34.0GiB 1027.1M
Weekly changes in the full database .weekly.diff 1.0GiB 5.2GiB 190.8M
Monthly changes in the full database .monthly.diff 3.2GiB 15.4GiB 524.7M
Records added during the previous day .daily 305.1MiB 1.0GiB 20.6M

MX files

File content Filename suffix Avg. gzipped file size Avg. unpacked file size Avg. number of records
Weekly full database export .weekly.full 3.5GiB 20.9GiB 398.3M
Weekly changes in the full database .weekly.diff 64.3MiB 818.1MiB 6.7M
Monthly changes in the full database .monthly.diff 274.5MiB 3.3GiB 28.9M
Records added during the previous day .daily 112.1MiB 777.9MiB 13.0M

NS files

File content Filename suffix Avg. gzipped file size Avg. unpacked file size Avg. number of records
Weekly full database export .weekly.full 6.9GiB 42.5GiB 929.1M
Weekly changes in the full database .weekly.diff 175.4MiB 1.3GiB 22.3M
Monthly changes in the full database .monthly.diff 740.7MiB 5.3GiB 94.0M
Records added during the previous day .daily 189.3MiB 1.2GiB 23.9M

TXT files

File content Filename suffix Avg. gzipped file size Avg. unpacked file size Avg. number of records
Weekly full database export .weekly.full 4.2GiB 15.8GiB 228.9M
Weekly changes in the full database .weekly.diff 120.8MiB 547.3MiB 6.5M
Monthly changes in the full database .monthly.diff 496.7MiB 2.2GiB 27.4M
Records added during the previous day .daily 129.2MiB 555.8MiB 7.6M

CNAME files

File content Filename suffix Avg. gzipped file size Avg. unpacked file size Avg. number of records
Weekly full database export .weekly.full 904.1miB 3.7GiB 65.8M
Weekly changes in the full database .weekly.diff 25.2MiB 216.5MiB 2.4M
Monthly changes in the full database .monthly.diff 105.0MiB 857.8MiB 9.5M
Records added during the previous day .daily 49.1MiB 194.6MiB 3.2M

SOA files

File content Filename suffix Avg. gzipped file size Avg. unpacked file size Avg. number of records
Weekly full database export .weekly.full 8.8GiB 50.5GiB 512.1M
Weekly changes in the full database .weekly.diff 1.3GiB 8.5GiB 83.1M
Monthly changes in the full database .monthly.diff 4.0GiB 26.0GiB 257.0M
Records added during the previous day .daily 189.3MiB 1.0GiB 9.9M

AAAA files

File content Filename suffix Avg. gzipped file size Avg. unpacked file size Avg. number of records
Weekly full database export .weekly.full 1.7GiB 7.4GiB 183.5M
Weekly changes in the full database .weekly.diff 206.3MiB 1.2GiB 31.7M
Monthly changes in the full database .monthly.diff 621.7MiB 3.3GiB 87.5M
Records added during the previous day .daily 45.3MiB 174.0MiB 4.5M

PTR files

File content Filename suffix Avg. gzipped file size Avg. unpacked file size Avg. number of records
Weekly full database export .weekly.full 63.7MiB 354.4iB 6.3M
Weekly changes in the full database .weekly.diff 52.5MiB 302.7MiB 5.2M
Monthly changes in the full database .monthly.diff 120.3MiB 692.5MiB 12.0M
Records added during the previous day .daily 20.1MiB 105.1MiB 1.8M

Output structure and fields' descriptions

A files

  • Structure: <DOMAIN>,<LAST_UPDATE_TIMESTAMP>,<IP1> <IP2> ... <IPn>
  • Example: zs12p1.gotoip1.com.cname.yunjiasu-cdn.net,1530959456,162.159.210.99 162.159.211.99
DOMAIN
Domain or subdomain name.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record. If there is more than one IP address, the timestamp corresponds to all of them.
IP1, IP2, IPn
List of IPs associated with the domain, separated by space.

AAAA files

  • Structure: <DOMAIN>,<LAST_UPDATE_TIMESTAMP>,<IP1> <IP2> ... <IPn>
  • Example: 212120--jekyllrb.netlify.app,1647929159,2604:a880:400:d0::1738:6301 2604:a880:400:d0::1b6b:7051
DOMAIN
Domain or subdomain name.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record. If there is more than one IP address, the timestamp corresponds to all of them.
IP1, IP2, IPn
List of IPs associated with the domain, separated by space.

MX files

  • Structure:
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<PRIORITY>,<MX1>
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<PRIORITY>,<MX2>
    - <DOMAIN-B>,<LAST_UPDATE_TIMESTAMP>,<PRIORITY>,<MX1>
    - ...
  • Example:
    - 003vendor.com,1608996228,20,alt1.aspmx.l.google.com
    - 003vendor.com,1608996228,20,alt2.aspmx.l.google.com
DOMAIN
Domain or subdomain name.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record.
PRIORITY
Priority identifies which mailserver should be preferred.
MX
The MX record associated with the domain.

NS files

  • Structure:
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<NS1>
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<NS2>
    - <DOMAIN-B>,<LAST_UPDATE_TIMESTAMP>,<NS1>
    - ...
  • Example:
    - 0001.cn,1608996268,dns1.hichina.com
    - 0001.cn,1608996268,dns2.hichina.com
DOMAIN
Domain or subdomain name.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record.
NS
The NS record associated with the domain.

TXT files

  • Structure:
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<TXT1>
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<TXT2>
    - <DOMAIN-B>,<LAST_UPDATE_TIMESTAMP>,<TXT1>
    - ...
  • Example:
    - 0--00.holiest.science,1619741985,|v=spf1 ip4:67.225.166.63 +a +mx +ip4:67.225.166.41 ~all!
    - 0--00.holiest.science,1619741985,|v=spf1 ip4:67.225.166.63 +a +mx +ip4:67.225.166.41 ~alla
DOMAIN
Domain or subdomain name.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record.
TXT
The TXT record associated with the domain.

CNAME files

  • Structure:
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<CNAME1>
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<CNAME2>
    - <DOMAIN-B>,<LAST_UPDATE_TIMESTAMP>,<CNAME1>
    - ...
  • Example:
    - 0-131-3-149.rackcentre.redstation.net.uk,1619742251,redstation.com
    - 0-132-3-149.rackcentre.redstation.net.uk,1619741776,redstation.com
DOMAIN
Domain or subdomain name.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record.
CNAME
The CNAME record associated with the domain.

SOA files

  • Structure:
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<SOA1>
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<SOA2>
    - <DOMAIN-B>,<LAST_UPDATE_TIMESTAMP>,<SOA1>
    - ...
  • Example:
    - 0-rings.com,1619741730,NS25.DOMAINCONTROL.com dns.jomax.net 2018091300 28800 7200 604800 3600
    - 0-rings.com,1619741730,NS25.domaincontrol.com dns.jomax.net 2018091300 28800 7200 604800 3600
DOMAIN
Domain or subdomain name.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record.
SOA
The SOA record associated with the domain.

PTR files

  • Structure:
    - <IP-A>,<LAST_UPDATE_TIMESTAMP>,<PTR1>
    - <IP-A>,<LAST_UPDATE_TIMESTAMP>,<PTR2>
    - <IP-B>,<LAST_UPDATE_TIMESTAMP>,<PTR1>
    - ...
  • Example:
    - 1.0.135.155,1661516953,node-1i3.pool-1-0.dynamic.totinternet.net
    - 1.0.0.1,1661724824,one.one.one.one
IP
IP address.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record.
PTR
The PTR record associated with the IP.