mirror of
https://github.com/fkie-cad/nvd-json-data-feeds.git
synced 2025-06-08 05:57:39 +00:00
240 lines
11 KiB
Markdown
240 lines
11 KiB
Markdown
# nvd-json-data-feeds
|
|
|
|
[](https://github.com/fkie-cad/nvd-json-data-feeds/actions/workflows/monitor_release.yml)
|
|
[](https://github.com/fkie-cad/nvd-json-data-feeds/actions/workflows/monitor_sync.yml)
|
|
[](https://github.com/fkie-cad/nvd-json-data-feeds/actions/workflows/validate_schema.yml)
|
|
|
|
Community reconstruction of the deprecated JSON NVD Data Feeds.
|
|
[Releases](https://github.com/fkie-cad/nvd-json-data-feeds/releases/latest) each day at 00:00 AM UTC.
|
|
Repository synchronizes with the NVD every 2 hours.
|
|
|
|
## Repository at a Glance
|
|
|
|
### Last Repository Update
|
|
|
|
```plain
|
|
2024-11-05T17:00:21.906678+00:00
|
|
```
|
|
|
|
### Most recent CVE Modification Timestamp synchronized with NVD
|
|
|
|
```plain
|
|
2024-11-05T16:52:44.937000+00:00
|
|
```
|
|
|
|
### Last Data Feed Release
|
|
|
|
Download and Changelog: [Click](https://github.com/fkie-cad/nvd-json-data-feeds/releases/latest)
|
|
|
|
```plain
|
|
2024-11-05T01:00:10.089545+00:00
|
|
```
|
|
|
|
### Total Number of included CVEs
|
|
|
|
```plain
|
|
268307
|
|
```
|
|
|
|
### CVEs added in the last Commit
|
|
|
|
Recently added CVEs: `62`
|
|
|
|
- [CVE-2024-51017](CVE-2024/CVE-2024-510xx/CVE-2024-51017.json) (`2024-11-05T15:15:25.460`)
|
|
- [CVE-2024-51018](CVE-2024/CVE-2024-510xx/CVE-2024-51018.json) (`2024-11-05T15:15:25.537`)
|
|
- [CVE-2024-51019](CVE-2024/CVE-2024-510xx/CVE-2024-51019.json) (`2024-11-05T15:15:25.627`)
|
|
- [CVE-2024-51020](CVE-2024/CVE-2024-510xx/CVE-2024-51020.json) (`2024-11-05T15:15:25.700`)
|
|
- [CVE-2024-51021](CVE-2024/CVE-2024-510xx/CVE-2024-51021.json) (`2024-11-05T15:15:25.780`)
|
|
- [CVE-2024-51022](CVE-2024/CVE-2024-510xx/CVE-2024-51022.json) (`2024-11-05T15:15:25.860`)
|
|
- [CVE-2024-51023](CVE-2024/CVE-2024-510xx/CVE-2024-51023.json) (`2024-11-05T15:15:25.943`)
|
|
- [CVE-2024-51024](CVE-2024/CVE-2024-510xx/CVE-2024-51024.json) (`2024-11-05T15:15:26.037`)
|
|
- [CVE-2024-52013](CVE-2024/CVE-2024-520xx/CVE-2024-52013.json) (`2024-11-05T15:15:26.347`)
|
|
- [CVE-2024-52014](CVE-2024/CVE-2024-520xx/CVE-2024-52014.json) (`2024-11-05T15:15:26.430`)
|
|
- [CVE-2024-52015](CVE-2024/CVE-2024-520xx/CVE-2024-52015.json) (`2024-11-05T15:15:26.520`)
|
|
- [CVE-2024-52016](CVE-2024/CVE-2024-520xx/CVE-2024-52016.json) (`2024-11-05T15:15:26.597`)
|
|
- [CVE-2024-52017](CVE-2024/CVE-2024-520xx/CVE-2024-52017.json) (`2024-11-05T15:15:26.680`)
|
|
- [CVE-2024-52018](CVE-2024/CVE-2024-520xx/CVE-2024-52018.json) (`2024-11-05T15:15:26.757`)
|
|
- [CVE-2024-52019](CVE-2024/CVE-2024-520xx/CVE-2024-52019.json) (`2024-11-05T15:15:26.833`)
|
|
- [CVE-2024-52020](CVE-2024/CVE-2024-520xx/CVE-2024-52020.json) (`2024-11-05T15:15:26.917`)
|
|
- [CVE-2024-52021](CVE-2024/CVE-2024-520xx/CVE-2024-52021.json) (`2024-11-05T15:15:26.997`)
|
|
- [CVE-2024-52022](CVE-2024/CVE-2024-520xx/CVE-2024-52022.json) (`2024-11-05T15:15:27.070`)
|
|
- [CVE-2024-52023](CVE-2024/CVE-2024-520xx/CVE-2024-52023.json) (`2024-11-05T15:15:27.157`)
|
|
- [CVE-2024-52024](CVE-2024/CVE-2024-520xx/CVE-2024-52024.json) (`2024-11-05T15:15:27.233`)
|
|
- [CVE-2024-52025](CVE-2024/CVE-2024-520xx/CVE-2024-52025.json) (`2024-11-05T15:15:27.313`)
|
|
- [CVE-2024-52026](CVE-2024/CVE-2024-520xx/CVE-2024-52026.json) (`2024-11-05T15:15:27.397`)
|
|
- [CVE-2024-52028](CVE-2024/CVE-2024-520xx/CVE-2024-52028.json) (`2024-11-05T15:15:27.483`)
|
|
- [CVE-2024-52029](CVE-2024/CVE-2024-520xx/CVE-2024-52029.json) (`2024-11-05T15:15:27.573`)
|
|
- [CVE-2024-52030](CVE-2024/CVE-2024-520xx/CVE-2024-52030.json) (`2024-11-05T15:15:27.660`)
|
|
|
|
|
|
### CVEs modified in the last Commit
|
|
|
|
Recently modified CVEs: `165`
|
|
|
|
- [CVE-2024-51522](CVE-2024/CVE-2024-515xx/CVE-2024-51522.json) (`2024-11-05T16:04:26.053`)
|
|
- [CVE-2024-51523](CVE-2024/CVE-2024-515xx/CVE-2024-51523.json) (`2024-11-05T16:04:26.053`)
|
|
- [CVE-2024-51524](CVE-2024/CVE-2024-515xx/CVE-2024-51524.json) (`2024-11-05T16:04:26.053`)
|
|
- [CVE-2024-51525](CVE-2024/CVE-2024-515xx/CVE-2024-51525.json) (`2024-11-05T16:04:26.053`)
|
|
- [CVE-2024-51526](CVE-2024/CVE-2024-515xx/CVE-2024-51526.json) (`2024-11-05T16:04:26.053`)
|
|
- [CVE-2024-51527](CVE-2024/CVE-2024-515xx/CVE-2024-51527.json) (`2024-11-05T16:04:26.053`)
|
|
- [CVE-2024-51528](CVE-2024/CVE-2024-515xx/CVE-2024-51528.json) (`2024-11-05T16:04:26.053`)
|
|
- [CVE-2024-51529](CVE-2024/CVE-2024-515xx/CVE-2024-51529.json) (`2024-11-05T16:04:26.053`)
|
|
- [CVE-2024-51530](CVE-2024/CVE-2024-515xx/CVE-2024-51530.json) (`2024-11-05T16:04:26.053`)
|
|
- [CVE-2024-51734](CVE-2024/CVE-2024-517xx/CVE-2024-51734.json) (`2024-11-05T16:04:26.053`)
|
|
- [CVE-2024-51744](CVE-2024/CVE-2024-517xx/CVE-2024-51744.json) (`2024-11-05T16:04:26.053`)
|
|
- [CVE-2024-5578](CVE-2024/CVE-2024-55xx/CVE-2024-5578.json) (`2024-11-05T16:04:26.053`)
|
|
- [CVE-2024-7059](CVE-2024/CVE-2024-70xx/CVE-2024-7059.json) (`2024-11-05T16:15:19.097`)
|
|
- [CVE-2024-7429](CVE-2024/CVE-2024-74xx/CVE-2024-7429.json) (`2024-11-05T16:04:26.053`)
|
|
- [CVE-2024-7876](CVE-2024/CVE-2024-78xx/CVE-2024-7876.json) (`2024-11-05T16:35:59.460`)
|
|
- [CVE-2024-7877](CVE-2024/CVE-2024-78xx/CVE-2024-7877.json) (`2024-11-05T16:35:59.660`)
|
|
- [CVE-2024-9178](CVE-2024/CVE-2024-91xx/CVE-2024-9178.json) (`2024-11-05T16:04:26.053`)
|
|
- [CVE-2024-9443](CVE-2024/CVE-2024-94xx/CVE-2024-9443.json) (`2024-11-05T16:04:26.053`)
|
|
- [CVE-2024-9459](CVE-2024/CVE-2024-94xx/CVE-2024-9459.json) (`2024-11-05T16:04:26.053`)
|
|
- [CVE-2024-9657](CVE-2024/CVE-2024-96xx/CVE-2024-9657.json) (`2024-11-05T16:04:26.053`)
|
|
- [CVE-2024-9667](CVE-2024/CVE-2024-96xx/CVE-2024-9667.json) (`2024-11-05T16:04:26.053`)
|
|
- [CVE-2024-9689](CVE-2024/CVE-2024-96xx/CVE-2024-9689.json) (`2024-11-05T16:36:00.010`)
|
|
- [CVE-2024-9867](CVE-2024/CVE-2024-98xx/CVE-2024-9867.json) (`2024-11-05T16:04:26.053`)
|
|
- [CVE-2024-9878](CVE-2024/CVE-2024-98xx/CVE-2024-9878.json) (`2024-11-05T16:04:26.053`)
|
|
- [CVE-2024-9883](CVE-2024/CVE-2024-98xx/CVE-2024-9883.json) (`2024-11-05T16:36:00.220`)
|
|
|
|
|
|
## Download and Usage
|
|
|
|
There are several ways you can work with the data in this repository:
|
|
|
|
### 1) Release Data Feed Packages
|
|
|
|
The most straightforward approach is to obtain the latest Data Feed release packages [here](https://github.com/fkie-cad/nvd-json-data-feeds/releases/latest).
|
|
|
|
Each day at 00:00 AM UTC we package and upload JSON files that aim to reconstruct the legacy NVD CVE Data Feeds.
|
|
Those are aggregated by the `year` part of the CVE identifier:
|
|
|
|
```
|
|
# CVE-<YEAR>.json
|
|
CVE-1999.json
|
|
CVE-2001.json
|
|
CVE-2002.json
|
|
CVE-2003.json
|
|
[...]
|
|
CVE-2023.json
|
|
CVE-2024.json
|
|
```
|
|
|
|
We also upload the well-known `Recent` and `Modified` feeds.
|
|
Furthermore, we provide the `All` feed, which contains a recent snapshot of all NVD records.
|
|
Once your local copy is synchronized and the last synchronization is no older than 8 days, you can rely on these to stay up to date:
|
|
|
|
```plain
|
|
CVE-Recent.json # CVEs that were added in the previous eight days
|
|
CVE-Modified.json # CVEs that were modified or added in the previous eight days
|
|
```
|
|
|
|
Note that all feeds are distributed in `xz`-compressed format to save storage and bandwidth.
|
|
For decompression execute:
|
|
|
|
```sh
|
|
xz -d -k <feed>.json.xz
|
|
```
|
|
|
|
#### Automation using Release Data Feed Packages
|
|
|
|
You can fetch the latest releases for each package with the following static link layout:
|
|
|
|
```sh
|
|
https://github.com/fkie-cad/nvd-json-data-feeds/releases/latest/download/CVE-<YEAR>.json.xz
|
|
```
|
|
|
|
Example:
|
|
|
|
```sh
|
|
wget https://github.com/fkie-cad/nvd-json-data-feeds/releases/latest/download/CVE-2024.json.xz
|
|
xz -d -k CVE-2024.json.xz
|
|
```
|
|
|
|
### 2) Clone the Repository (with Git History)
|
|
|
|
As you can see by browsing this repository, there is a slight difference between the release packages format and the repository folder structure.
|
|
This is because we want to maintain explorability of the dataset.
|
|
|
|
Each CVE gets its own JSON file, e.g., `CVE-1999-0001.json`.
|
|
Here, each file is put into a folder layout that first sorts by CVE `year` identifier part and then by `number` part.
|
|
We mask (`xx`) the last two digits to create easily navigable folders that hold a maximum of 100 CVE JSON files:
|
|
|
|
```plain
|
|
.
|
|
├── CVE-1999
|
|
│ ├── CVE-1999-00xx
|
|
│ │ ├── CVE-1999-0001.json
|
|
│ │ ├── CVE-1999-0002.json
|
|
│ │ └── [...]
|
|
│ ├── CVE-1999-01xx
|
|
│ │ ├── CVE-1999-0101.json
|
|
│ │ └── [...]
|
|
│ └── [...]
|
|
├── CVE-2000
|
|
│ ├── CVE-2000-00xx
|
|
│ ├── CVE-2000-01xx
|
|
│ └── [...]
|
|
└── [...]
|
|
```
|
|
|
|
A byproduct of managing and continuously updating this dataset via Git is that we can track changes over time through the Git history.
|
|
|
|
If you are interested in having the NVD data as organized above, including the historical data of changes, just clone this repository (large!):
|
|
|
|
```sh
|
|
git clone https://github.com/fkie-cad/nvd-json-data-feeds.git
|
|
```
|
|
|
|
#### (Optional) Meta Files
|
|
|
|
Similar to the old official feeds, we provide meta files with each release. They can be fetched for each feed via:
|
|
|
|
```sh
|
|
https://github.com/fkie-cad/nvd-json-data-feeds/releases/latest/download/CVE-<YEAR>.meta
|
|
```
|
|
|
|
The structure is as follows:
|
|
|
|
```plain
|
|
lastModifiedDate:1970-01-01T00:00:00.000+00:00 # ISO 8601 timestamp of last CVE modification
|
|
size:1000 # size of uncompressed feed (bytes)
|
|
xzSize:100 # size of lzma-compressed feed (bytes)
|
|
sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 # sha256 hexdigest of uncompressed feed
|
|
```
|
|
|
|
### 3) Clone the Repository (without Git History)
|
|
|
|
Don't need the history? Then create a shallow copy:
|
|
|
|
```sh
|
|
git clone --depth 1 -b main https://github.com/fkie-cad/nvd-json-data-feeds.git
|
|
```
|
|
|
|
|
|
## Update Timetable
|
|
|
|
* NVD Synchronization: `Bi-Hourly`, starting with `00:00:00Z`
|
|
* Release Packages: `Daily`, at `00:00:00Z`
|
|
* NVD Rebuilds: `Weekly`, at `Sun, 02:30:00Z`
|
|
|
|
|
|
## Motivation
|
|
|
|
On 2023-12-15, the NIST deprecated all [JSON-based NVD Data Feeds](https://nvd.nist.gov/vuln/data-feeds#divRetirementBanner-1).
|
|
The new [NVD CVE API 2.0](https://nvd.nist.gov/developers/vulnerabilities) is, without a doubt, a great way to obtain CVE information.
|
|
However, we from [Fraunhofer FKIE - Cyber Analysis and Defense](https://www.fkie.fraunhofer.de/en/departments/cad.html) believe that the API does not cover a variety of use cases.
|
|
|
|
The legacy NVD Data Feeds provided a convenient way to quickly obtain a complete, file-based offline database snapshot; just download the `CVE-<YEAR>.tar.gz`, decompress it, and use it as you please, e.g.:
|
|
|
|
- Put the JSON feed into a document-based database and quickly leverage upon that data in your software project, ...
|
|
- Parse and analyze it using your favorite programming language, ...
|
|
- Put it on a USB stick and transfer it to a system without internet access, or ...
|
|
- Query the file using `jq`!
|
|
|
|
Unfortunately, the new NVD API 2.0 adds complexity to this process.
|
|
We want to preserve ease of use by reconstructing these data sources.
|
|
|
|
## Non-Endorsement Clause
|
|
|
|
This project uses and redistributes data from the NVD API but is not endorsed or certified by the NVD. |