2023-04-27 15:02:47 +02:00
# nvd-json-data-feeds
2023-04-24 14:55:30 +02:00
2024-03-26 17:03:58 +00:00
[](https://github.com/fkie-cad/nvd-json-data-feeds/actions/workflows/monitor_release.yml)
[](https://github.com/fkie-cad/nvd-json-data-feeds/actions/workflows/monitor_sync.yml)
[](https://github.com/fkie-cad/nvd-json-data-feeds/actions/workflows/validate_schema.yml)
Community reconstruction of the deprecated JSON NVD Data Feeds.
2023-05-17 08:57:59 +00:00
[Releases ](https://github.com/fkie-cad/nvd-json-data-feeds/releases/latest ) each day at 00:00 AM UTC.
2023-04-27 16:00:24 +02:00
Repository synchronizes with the NVD every 2 hours.
2023-04-24 14:55:30 +02:00
2023-04-27 16:00:24 +02:00
## Repository at a Glance
2023-04-24 14:55:30 +02:00
2023-04-27 16:00:24 +02:00
### Last Repository Update
2023-04-24 14:55:30 +02:00
```plain
2025-01-07 23:03:44 +00:00
2025-01-07T23:00:22.280308+00:00
2023-04-24 14:55:30 +02:00
```
2023-04-27 16:00:24 +02:00
### Most recent CVE Modification Timestamp synchronized with NVD
2023-04-24 14:55:30 +02:00
```plain
2025-01-07 23:03:44 +00:00
2025-01-07T22:59:50.807000+00:00
2023-04-24 14:55:30 +02:00
```
2023-04-27 16:00:24 +02:00
### Last Data Feed Release
2023-04-24 14:55:30 +02:00
2023-05-17 08:57:59 +00:00
Download and Changelog: [Click ](https://github.com/fkie-cad/nvd-json-data-feeds/releases/latest )
2023-04-24 14:55:30 +02:00
```plain
2025-01-07 03:03:46 +00:00
2025-01-07T01:00:04.380562+00:00
2023-04-24 14:55:30 +02:00
```
2023-04-27 16:00:24 +02:00
### Total Number of included CVEs
2023-04-24 14:55:30 +02:00
2023-04-27 15:02:47 +02:00
```plain
2025-01-07 23:03:44 +00:00
276208
2023-04-24 14:55:30 +02:00
```
2023-04-27 16:00:24 +02:00
### CVEs added in the last Commit
2023-04-24 14:55:30 +02:00
2025-01-07 23:03:44 +00:00
Recently added CVEs: `3`
2025-01-07 21:03:46 +00:00
2025-01-07 23:03:44 +00:00
- [CVE-2024-10541 ](CVE-2024/CVE-2024-105xx/CVE-2024-10541.json ) (`2025-01-07T21:15:11.490` )
- [CVE-2025-22132 ](CVE-2025/CVE-2025-221xx/CVE-2025-22132.json ) (`2025-01-07T22:15:31.590` )
- [CVE-2025-22133 ](CVE-2025/CVE-2025-221xx/CVE-2025-22133.json ) (`2025-01-07T22:15:31.740` )
2024-12-31 23:03:42 +00:00
2025-01-05 05:03:43 +00:00
2025-01-07 15:04:02 +00:00
### CVEs modified in the last Commit
2025-01-07 00:58:45 +00:00
2025-01-07 23:03:44 +00:00
Recently modified CVEs: `72`
- [CVE-2024-53935 ](CVE-2024/CVE-2024-539xx/CVE-2024-53935.json ) (`2025-01-07T22:15:30.790` )
- [CVE-2024-54763 ](CVE-2024/CVE-2024-547xx/CVE-2024-54763.json ) (`2025-01-07T22:15:30.950` )
- [CVE-2024-54764 ](CVE-2024/CVE-2024-547xx/CVE-2024-54764.json ) (`2025-01-07T22:15:31.113` )
- [CVE-2024-54879 ](CVE-2024/CVE-2024-548xx/CVE-2024-54879.json ) (`2025-01-07T21:15:12.170` )
- [CVE-2024-54880 ](CVE-2024/CVE-2024-548xx/CVE-2024-54880.json ) (`2025-01-07T21:15:12.367` )
- [CVE-2024-55408 ](CVE-2024/CVE-2024-554xx/CVE-2024-55408.json ) (`2025-01-07T22:15:31.260` )
- [CVE-2024-55410 ](CVE-2024/CVE-2024-554xx/CVE-2024-55410.json ) (`2025-01-07T22:15:31.423` )
- [CVE-2024-56728 ](CVE-2024/CVE-2024-567xx/CVE-2024-56728.json ) (`2025-01-07T22:03:07.837` )
- [CVE-2024-56729 ](CVE-2024/CVE-2024-567xx/CVE-2024-56729.json ) (`2025-01-07T21:53:02.797` )
- [CVE-2024-56730 ](CVE-2024/CVE-2024-567xx/CVE-2024-56730.json ) (`2025-01-07T21:23:52.260` )
- [CVE-2024-56739 ](CVE-2024/CVE-2024-567xx/CVE-2024-56739.json ) (`2025-01-07T21:21:31.403` )
- [CVE-2024-56740 ](CVE-2024/CVE-2024-567xx/CVE-2024-56740.json ) (`2025-01-07T22:24:05.593` )
- [CVE-2024-56741 ](CVE-2024/CVE-2024-567xx/CVE-2024-56741.json ) (`2025-01-07T22:19:45.437` )
- [CVE-2024-56742 ](CVE-2024/CVE-2024-567xx/CVE-2024-56742.json ) (`2025-01-07T22:19:23.543` )
- [CVE-2024-56743 ](CVE-2024/CVE-2024-567xx/CVE-2024-56743.json ) (`2025-01-07T22:18:53.437` )
- [CVE-2024-56744 ](CVE-2024/CVE-2024-567xx/CVE-2024-56744.json ) (`2025-01-07T22:14:03.760` )
- [CVE-2024-56745 ](CVE-2024/CVE-2024-567xx/CVE-2024-56745.json ) (`2025-01-07T22:47:40.577` )
- [CVE-2024-56746 ](CVE-2024/CVE-2024-567xx/CVE-2024-56746.json ) (`2025-01-07T22:47:17.513` )
- [CVE-2024-56747 ](CVE-2024/CVE-2024-567xx/CVE-2024-56747.json ) (`2025-01-07T22:47:01.040` )
- [CVE-2024-56757 ](CVE-2024/CVE-2024-567xx/CVE-2024-56757.json ) (`2025-01-07T22:46:35.897` )
- [CVE-2024-56758 ](CVE-2024/CVE-2024-567xx/CVE-2024-56758.json ) (`2025-01-07T22:43:35.403` )
- [CVE-2024-56766 ](CVE-2024/CVE-2024-567xx/CVE-2024-56766.json ) (`2025-01-07T22:59:50.807` )
- [CVE-2024-56767 ](CVE-2024/CVE-2024-567xx/CVE-2024-56767.json ) (`2025-01-07T22:51:02.250` )
- [CVE-2024-56768 ](CVE-2024/CVE-2024-567xx/CVE-2024-56768.json ) (`2025-01-07T22:50:43.207` )
- [CVE-2024-56769 ](CVE-2024/CVE-2024-567xx/CVE-2024-56769.json ) (`2025-01-07T22:49:54.483` )
2023-04-24 14:55:30 +02:00
## Download and Usage
There are several ways you can work with the data in this repository:
### 1) Release Data Feed Packages
2023-05-24 12:00:30 +00:00
The most straightforward approach is to obtain the latest Data Feed release packages [here ](https://github.com/fkie-cad/nvd-json-data-feeds/releases/latest ).
2023-04-24 14:55:30 +02:00
2023-04-27 16:00:24 +02:00
Each day at 00:00 AM UTC we package and upload JSON files that aim to reconstruct the legacy NVD CVE Data Feeds.
2023-04-24 14:55:30 +02:00
Those are aggregated by the `year` part of the CVE identifier:
```
# CVE-<YEAR>.json
CVE-1999.json
CVE-2001.json
CVE-2002.json
CVE-2003.json
[...]
CVE-2023.json
2024-04-04 10:03:21 +00:00
CVE-2024.json
2023-04-24 14:55:30 +02:00
```
2023-04-27 15:02:47 +02:00
We also upload the well-known `Recent` and `Modified` feeds.
Furthermore, we provide the `All` feed, which contains a recent snapshot of all NVD records.
2023-04-27 16:00:24 +02:00
Once your local copy is synchronized and the last synchronization is no older than 8 days, you can rely on these to stay up to date:
2023-04-24 14:55:30 +02:00
```plain
CVE-Recent.json # CVEs that were added in the previous eight days
CVE-Modified.json # CVEs that were modified or added in the previous eight days
```
2023-04-27 16:00:24 +02:00
Note that all feeds are distributed in `xz` -compressed format to save storage and bandwidth.
2023-04-24 14:55:30 +02:00
For decompression execute:
```sh
xz -d -k < feed > .json.xz
```
#### Automation using Release Data Feed Packages
2023-04-27 16:00:24 +02:00
You can fetch the latest releases for each package with the following static link layout:
2023-04-24 14:55:30 +02:00
```sh
2023-04-27 15:02:47 +02:00
https://github.com/fkie-cad/nvd-json-data-feeds/releases/latest/download/CVE-< YEAR > .json.xz
2023-04-24 14:55:30 +02:00
```
Example:
```sh
2024-04-04 10:03:21 +00:00
wget https://github.com/fkie-cad/nvd-json-data-feeds/releases/latest/download/CVE-2024.json.xz
xz -d -k CVE-2024.json.xz
2023-04-24 14:55:30 +02:00
```
2023-04-27 16:00:24 +02:00
### 2) Clone the Repository (with Git History)
2023-04-24 14:55:30 +02:00
2023-04-27 16:00:24 +02:00
As you can see by browsing this repository, there is a slight difference between the release packages format and the repository folder structure.
2023-04-24 14:55:30 +02:00
This is because we want to maintain explorability of the dataset.
2023-04-27 16:00:24 +02:00
Each CVE gets its own JSON file, e.g., `CVE-1999-0001.json` .
2023-04-24 14:55:30 +02:00
Here, each file is put into a folder layout that first sorts by CVE `year` identifier part and then by `number` part.
2023-04-27 16:00:24 +02:00
We mask (`xx` ) the last two digits to create easily navigable folders that hold a maximum of 100 CVE JSON files:
2023-04-24 14:55:30 +02:00
```plain
.
├── CVE-1999
│ ├── CVE-1999-00xx
│ │ ├── CVE-1999-0001.json
│ │ ├── CVE-1999-0002.json
│ │ └── [...]
│ ├── CVE-1999-01xx
2023-04-25 17:08:25 +02:00
│ │ ├── CVE-1999-0101.json
│ │ └── [...]
2023-04-24 14:55:30 +02:00
│ └── [...]
├── CVE-2000
│ ├── CVE-2000-00xx
│ ├── CVE-2000-01xx
│ └── [...]
└── [...]
```
2023-04-27 16:00:24 +02:00
A byproduct of managing and continuously updating this dataset via Git is that we can track changes over time through the Git history.
2023-04-24 14:55:30 +02:00
2023-04-27 16:00:24 +02:00
If you are interested in having the NVD data as organized above, including the historical data of changes, just clone this repository (large!):
2023-04-24 14:55:30 +02:00
```sh
2023-04-27 15:02:47 +02:00
git clone https://github.com/fkie-cad/nvd-json-data-feeds.git
2023-04-24 14:55:30 +02:00
```
2023-12-21 15:00:28 +00:00
#### (Optional) Meta Files
Similar to the old official feeds, we provide meta files with each release. They can be fetched for each feed via:
```sh
https://github.com/fkie-cad/nvd-json-data-feeds/releases/latest/download/CVE-< YEAR > .meta
```
The structure is as follows:
```plain
lastModifiedDate:1970-01-01T00:00:00.000+00:00 # ISO 8601 timestamp of last CVE modification
size:1000 # size of uncompressed feed (bytes)
xzSize:100 # size of lzma-compressed feed (bytes)
sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 # sha256 hexdigest of uncompressed feed
```
2023-04-27 16:00:24 +02:00
### 3) Clone the Repository (without Git History)
2023-04-24 14:55:30 +02:00
Don't need the history? Then create a shallow copy:
```sh
2023-04-27 15:02:47 +02:00
git clone --depth 1 -b main https://github.com/fkie-cad/nvd-json-data-feeds.git
2023-04-24 14:55:30 +02:00
```
2024-04-04 10:03:21 +00:00
## Update Timetable
* NVD Synchronization: `Bi-Hourly` , starting with `00:00:00Z`
2024-04-04 12:03:25 +00:00
* Release Packages: `Daily` , at `00:00:00Z`
2024-04-04 10:03:21 +00:00
* NVD Rebuilds: `Weekly` , at `Sun, 02:30:00Z`
2023-04-24 14:55:30 +02:00
## Motivation
2023-12-15 13:00:27 +00:00
On 2023-12-15, the NIST deprecated all [JSON-based NVD Data Feeds ](https://nvd.nist.gov/vuln/data-feeds#divRetirementBanner-1 ).
2023-04-24 14:55:30 +02:00
The new [NVD CVE API 2.0 ](https://nvd.nist.gov/developers/vulnerabilities ) is, without a doubt, a great way to obtain CVE information.
However, we from [Fraunhofer FKIE - Cyber Analysis and Defense ](https://www.fkie.fraunhofer.de/en/departments/cad.html ) believe that the API does not cover a variety of use cases.
The legacy NVD Data Feeds provided a convenient way to quickly obtain a complete, file-based offline database snapshot; just download the `CVE-<YEAR>.tar.gz` , decompress it, and use it as you please, e.g.:
2024-03-26 17:03:58 +00:00
- Put the JSON feed into a document-based database and quickly leverage upon that data in your software project, ...
- Parse and analyze it using your favorite programming language, ...
- Put it on a USB stick and transfer it to a system without internet access, or ...
- Query the file using `jq` !
2023-04-24 14:55:30 +02:00
2023-04-27 16:00:24 +02:00
Unfortunately, the new NVD API 2.0 adds complexity to this process.
2023-04-24 14:55:30 +02:00
We want to preserve ease of use by reconstructing these data sources.
## Non-Endorsement Clause
This project uses and redistributes data from the NVD API but is not endorsed or certified by the NVD.