Specifications | DNS Database Download | WhoisXML API

Specifications

This data feed subscription is licensed to you or your organization only, you may not resell or relicense the data without explicit written permission from Whois API LLC. Any violation will be prosecuted to the fullest extent of the law.

Please go to https://www.whoisxmlapi.com/support/WhoisAPIDatabaseSLA.pdf to view the complete license agreement.

FAQs

  • Data Dictionaries for Database Download Products: HTML, ODT, PDF

The database comes in three forms, which include A, MX, NS, TXT, CNAME, and SOA records and can be downloaded in CSV.

  • Full databases — a full database of DNS records (A, MX, NS, TXT, CNAME, SOA) for a given date in unified and consistent CSV format. These files are named in format:
    "dns_database.%DATE%.full.csv.gz"
    "dns_mx_database.%DATE%.full.csv.gz"
    "dns_ns_database.%DATE%.full.csv.gz",
    "dns_txt_database.%DATE%.full.csv.gz",
    "dns_cname_database.%DATE%.full.csv.gz",
    "dns_soa_database.%DATE%.full.csv.gz",
    e.g. "dns_database.2021-12-01.full.csv.gz".
  • Incremental databases — changes in the full database of DNS records compared to the previous period. Includes added, dropped, and modified records since the previous week/month. These files are named in format:
    "dns_database.%DATE%.monthly.diff.csv.gz"
    "dns_database.%DATE%.weekly.diff.csv.gz"
    "dns_mx_database.%DATE%.monthly.diff.csv.gz",
    "dns_mx_database.%DATE%.weekly.diff.csv.gz",
    "dns_ns_database.%DATE%.monthly.diff.csv.gz",
    "dns_ns_database.%DATE%.weekly.diff.csv.gz",
    "dns_txt_database.%DATE%.monthly.diff.csv.gz",
    "dns_txt_database.%DATE%.weekly.diff.csv.gz",
    "dns_cname_database.%DATE%.monthly.diff.csv.gz",
    "dns_cname_database.%DATE%.weekly.diff.csv.gz",
    "dns_soa_database.%DATE%.monthly.diff.csv.gz",
    "dns_soa_database.%DATE%.weekly.diff.csv.gz",
    e.g. "dns_database.2021-12-01.weekly.diff.csv.gz".
  • Lite databases — a partial database of A DNS records for a given date made for academic purposes. It includes about 5% of a full database. These files are named in format:
    "dns_database.%DATE%.academic.csv.gz" e.g. "dns_database.2021-12-01.academic.csv.gz".

Samples

Downloading via HTTPS

Downloading via FTP

Downloading via FTPS

Read more about the FTPS connection: https://en.wikipedia.org/wiki/FTPS.

Our FTP server supports explicit FTP over TLS encryption. You may configure your FTP client to use explicit FTP over TLS encryption for secure communications.

Our FTPS server is accessed using the same paths and API keys as a regular FTP server, the instructions for which are described above. To connect via FTPS, select the "Require explicit FTP over TLS" encryption option in your FTP client, if it supports it. FileZilla configuration example:

explicit FTP over TLS encryption

Average file sizes

A files

gzip unpacked records
.academic 8.5GiB 58.9GiB 1049.5M
.weekly.full 16.2GiB 117.9GiB 2100.3M
.weekly.diff 716.7MiB 6.4GiB 131.3M
.monthly.diff 2.9GiB 37.7GiB 541.0M

MX files

gzip unpacked records
.weekly.full 2.5GiB 15.8GiB 302.8M
.weekly.diff 62.8MiB 474.0MiB 7.8M
.monthly.diff 195.9MiB 1.3GiB 23.1M

NS files

gzip unpacked records
.weekly.full 8.4GiB 152.7GiB 1384.3M
.weekly.diff 584.0MiB 14.8GiB 100.8M
.monthly.diff 3.7GiB 105.3GiB 666.3M

TXT files

gzip unpacked records
.weekly.full 3.5GiB 18.8GiB 251.2M
.weekly.diff 2.8GiB 18.8GiB 240.9M

CNAME files

gzip unpacked records
.weekly.full 1.9GiB 9.2GiB 168.1M
.weekly.diff 53.1MiB 234.5MiB 4.4M

SOA files

gzip unpacked records
.weekly.full 3.9GiB 24.5GiB 244.2M
.weekly.diff 776.9MiB 8.0GiB 69.6M

Output structure and fields' descriptions

A files

  • Structure: <DOMAIN>,<LAST_UPDATE_TIMESTAMP>,<IP1> <IP2> ... <IPn>
  • Example: zs12p1.gotoip1.com.cname.yunjiasu-cdn.net,1530959456,162.159.210.99 162.159.211.99
DOMAIN
Domain or subdomain name.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record. If there is more than one IP address, the timestamp corresponds to all of them.
IP1, IP2, IPn
List of IPs associated with the domain, separated by space.

MX files

  • Structure:
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<PRIORITY>,<MX1>
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<PRIORITY>,<MX2>
    - <DOMAIN-B>,<LAST_UPDATE_TIMESTAMP>,<PRIORITY>,<MX1>
    - ...
  • Example:
    - 003vendor.com,1608996228,20,alt1.aspmx.l.google.com
    - 003vendor.com,1608996228,20,alt2.aspmx.l.google.com
DOMAIN
Domain or subdomain name.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record.
PRIORITY
Priority identifies which mailserver should be preferred.
MX
The MX record associated with the domain.

NS files

  • Structure:
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<NS1>
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<NS2>
    - <DOMAIN-B>,<LAST_UPDATE_TIMESTAMP>,<NS1>
    - ...
  • Example:
    - 0001.cn,1608996268,dns1.hichina.com
    - 0001.cn,1608996268,dns2.hichina.com
DOMAIN
Domain or subdomain name.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record.
NS
The NS record associated with the domain.

TXT files

  • Structure:
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<TXT1>
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<TXT2>
    - <DOMAIN-B>,<LAST_UPDATE_TIMESTAMP>,<TXT1>
    - ...
  • Example:
    - 0--00.holiest.science,1619741985,|v=spf1 ip4:67.225.166.63 +a +mx +ip4:67.225.166.41 ~all!
    - 0--00.holiest.science,1619741985,|v=spf1 ip4:67.225.166.63 +a +mx +ip4:67.225.166.41 ~alla
DOMAIN
Domain or subdomain name.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record.
TXT
The TXT record associated with the domain.

CNAME files

  • Structure:
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<CNAME1>
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<CNAME2>
    - <DOMAIN-B>,<LAST_UPDATE_TIMESTAMP>,<CNAME1>
    - ...
  • Example:
    - 0-131-3-149.rackcentre.redstation.net.uk,1619742251,redstation.com
    - 0-132-3-149.rackcentre.redstation.net.uk,1619741776,redstation.com
DOMAIN
Domain or subdomain name.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record.
CNAME
The CNAME record associated with the domain.

SOA files

  • Structure:
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<SOA1>
    - <DOMAIN-A>,<LAST_UPDATE_TIMESTAMP>,<SOA2>
    - <DOMAIN-B>,<LAST_UPDATE_TIMESTAMP>,<SOA1>
    - ...
  • Example:
    - 0-rings.com,1619741730,NS25.DOMAINCONTROL.com dns.jomax.net 2018091300 28800 7200 604800 3600
    - 0-rings.com,1619741730,NS25.domaincontrol.com dns.jomax.net 2018091300 28800 7200 604800 3600
DOMAIN
Domain or subdomain name.
LAST_UPDATE
UNIX timestamp of the last visit/update on current record.
SOA
The SOA record associated with the domain.