Awesome-Cybersecurity-Datasets - A curated list of amazingly awesome Cybersecurity

项目说明

Awesome-Cybersecurity-Datasets

A curated list of amazingly awesome Cybersecurity datasets.

Please contribute to this list with new datasets by sending me a pull request or by contacting me at .

Happy learning!

Table of contents

* Network traffic
* Malware
* WebApps
* Software
* URLs & Domain Names
* Host
* Email
* Fraud
* Honeypots
* Binaries
* Phishing
* Passwords
* MISC

Datasets

Network traffic

* Unified Host and Network Dataset - The Unified Host and Network Dataset is a subset of network and computer (host) events collected from the Los Alamos National Laboratory enterprise network over the course of approximately 90 days. The host event logs originated from most enterprise computers running the Microsoft Windows operating system on Los Alamos National Laboratory's (LANL) enterprise network. The network event data originated from many of the internal enterprise routers within the LANL enterprise network.
* Comprehensi Cyber-Security Events - This data set represents 58 consecutive days of de-identified event data collected from fi within Los Alamos National Laboratory's corporate, internal computer network.
* User-Computer Authentication Associations in Time - This anonymized data set encompasses 9 continuous months and represents 708,304,516 successful authentication events from users to computers collected from the Los Alamos National Laboratory (LANL) enterprise network.
* Canadian Institute for Cybersecurity datasets - Canadian Institute for Cybersecurity datasets are used around the world by uni, private industry and independent researchers.
* KDD Cup 1999 Data - This database contains a standard set of data to be audited, which includes a wide of intrusions simulated in a military network en.
* 2017-SUEE-data-set - The data sets contain traffic in and out of the web server of the Student Union for Electrical Engineering (Fachbereichs Elektrotechnik) at Ulm Uni. Internal hosts are hosts from within the uni network, some of them are cable bound, others connect through one of two wifi services on campus (eduroam and welcome). The data was mixed with attack traffic.
* CTU-13 Dataset - A Labeled Dataset with Botnet, Normal and Background traffic.
* PCAP files - Malware Traffic, Network Forensics, SCADA/ICS Network Captures, Packet Injection Attacks / Man-on-the-Side Attacks...
* pcapt - Big repository of PCAP files.
* Project Sonar - Project Sonar produces multiple UDP datasets every month. This data is gathered by sending protocol-specific UDP probes across the entire IPv4 address space. The types of probes sent each week continues to expand as the project matures.
* IoT devices captures.html) - This dataset represents the traffic emitted during the setup of 31 smart home IoT devices of 27 different types (4 types are represented by 2 devices each). Each setup was repeated at least 20 times per de.

Malware

* UNSW-NB15 data set - This data set has nine families of attacks, namely, Fuzzers, Analysis, Backdoors, DoS, Exploits, Generic, Reconnaissance, Shellcode and Worms. The Argus, Bro-IDS tools are utilised and twel are de to generate totally 49 features with the class label.
* Malware Training Sets - Today (please refers to blog post date) the collected classified datasets is composed by the following samples: APT1 292 Samples, Crypto 2024 Samples, Locker 434 Samples, Zeus 2014 Samples
* The Drebin Dataset - The dataset contains 5,560 applications from 179 different malware families. The samples have been collected in the period of August 2010 to October 2012 and were made a to us by the MobileSandbox project.
* Stratosphere IPS - Malware captures, Normal captures, mixed captures...
* Microsoft Malware Classification Challenge - You are provided with a set of known malware files representing a mix of 9 different families. Each malware file has an Id, a 20 character hash value uniquely identifying the file, and a Class, an integer representing one of 9 family names.

Software

* Ja dataset - Dataset constructed from the information in public databases of the Node Security Project and the Snyk platform, and code fixing patches from GitHub.

WebApps

* West Point NSA Data Sets - Snort Intrusion Detection Log. Domain Name Service Logs. Web Server Logs. Log Ser Log.
* Web Attack Payloads - A collection of web attack payloads.
* Machine-Learning-driwall - Set of good and bad queries to a web application firewall.
* Internet-Wide Scan Data Repository - The Censys Projects publishes daily snapshots of what we know about each IPv4 host, Alexa Top Million website, and known X.509 certificate. These datasets contain structured, non-ephemeral JSON records that identify a host's configuration.
* 500K HTTP Headers - Recently we crawled the Top 500K sites (as ranked by Alexa). Following requests from readers we are making a the HTTP Headers for research purposes.
* HTTP DATASET CSIC 2010 - The HTTP dataset CSIC 2010 contains thousands of web requests automatically generated. It can be used for the testing of web attack protection systems. It was de at the Information Security Institute of CSIC (Spanish Research National Council).
* ISOT datasets - The ISOT Lab has collected through different projects datasets some of which are a for public sharing. ISOT Web Interactions Dataset (Mouse/Keystroke/Site Actions), ISOT Botnet Dataset...
* Web Logs Secrepo - Web logs generated by secrepo community and secrepo web application
* Common Crawl - The Common Crawl corpus contains petabytes of data collected over the last 7 years. It contains raw web page data, extracted metadata and text extractions.
* Website Classification Dataset - The entire selecti is manually curated, including classification of sites into a two-tiered subject hierarchy. We have made this manually-generated classification information a as an open dataset, in tab-separated column format.
* AZSecure-data - The AZSecure-data PORTAL currently provides access to Web forums, Internet phishing websites, Twitter data, and other data.

URLs & Domain Names

* Malicious URLs Dataset - The data set consists of about 2.4 million URLs (examples) and 3.2 million features.
* cybercrime-tracker - List of labeled malicious URLs.
* Malware Domain List - Malware Domain List.
* ZeuS Tracker - ZeuS Tracker tracks ZeuS Command&Control servers (hosts) around the world and provides you a domain- and a IP-blocklist.
* Feodo Tracker - List of Feodo botnet C&C servers
* Ransomware Tracker - Ransomware Tracker offers types of blocklists that allows you to block Ransomware botnet C&C traffic.
* URLhaus - URLhaus is a project from abuse.ch with the goal of sharing malicious URLs that are being used for malware distribution.
* Alexa Top 1 Million - CS with the most popular sites by Alexa.
* OpenDNS Top Domains List - The OpenDNS Top Domains List is the top 10,000 domain names our resolvers all over the globe are receiving queries for, sorted by popularity.
* The Majestic Million - The million domains we find with the most referring subnets.
* StopForumSpam - The data provided here represents what we believe will only ever ben used to abuse. IP Addresses, domains and usernames listed here will be returned in API results as "blacklisted".

Host

* The ADFA Intrusion Detection Datasets - This dataset provides a contemporary Linux dataset for e by traditional HIDS. This dataset provides a contemporary Windows dataset for e by HIDS.
* Unified Host and Network Dataset - The Unified Host and Network Dataset is a subset of network and computer (host) events collected from the Los Alamos National Laboratory enterprise network over the course of approximately 90 days. The host event logs originated from most enterprise computers running the Microsoft Windows operating system on Los Alamos National Laboratory's (LANL) enterprise network. The network event data originated from many of the internal enterprise routers within the LANL enterprise network.
* Public Security Log Sharing Site - This site contains free shareable log samples from systems, security and network devices, applications, etc. The logs are collected from real systems, some contain e of compromise and other malicious activity. Where, the logs are NOT sanitized, anonymized or modified in any way (just as they came from the logging system).
* Aktaion2 Data - The project is meant to be a learning/teaching tool on how to blend multiple security signals and behaviors into an expressi for intrusion detection.

Email

* 2007 TREC Public Spam Corpus - The corpus trec07p contains 75,419 messages: 25220 ham and 50199 spam.
* SPAM list - List of SPAM messages.

Fraud

* Credit Card Fraud - The datasets contains transactions made by credit cards in September 2013 by european cardholders. This dataset presents transactions that occurred in two days, where we have 492 frauds out of 284,807 transactions. The dataset is highly unbalanced, the positi (frauds) account for 0.172% of all transactions.

Honeypots

* DDS Dataset Collection - A tar/gzip CSV file from a collection of AWS honeypots. A zip CSV file of domains and a high le of dga or legit along with a subclass of either legit, cryptolocker, gox or newgoz.
* Threat_Research - Centralized repository to dump threat research data gathered from my network of honeypots.

Binaries

* The ember dataset - The ember dataset is a collection of 1.1 million sha256 hashes from PE files that were scanned sometime in 2017. This repository makes it easy to reproducibly train the benchmark model, extend the provided feature set, or classify new PE files with the benchmark model.

Phishing

* Phishing Websites Data Set - In this dataset, we shed light on the important features that ha to be sound and effective in predicting phishing websites. In addition, we propose some new features.

Passwords

* Yahoo Password Frequency Corpus - This dataset includes sanitized password frequency lists collected from Yahoo in May 2011.

MISC

* SecRepo - Samples of Security Related Data.
* PANDA SHARE - This site stores recordings of executions produced by the PANDA dynamic analysis platform. The goal is to make dyanamic analysis repeatable. Any analysis dynamic analysis, run on the same replay, will produce the same results.
* SHERLOCK - The dataset is essentially a massi dataset spanning nearly every single kind of software and hardware sensor that can be sampled from a Samsung Galaxy S5 smartphone, without root pri. The dataset contains over 600 billion data points in over 10 billion data records.
* WerdLists - Wordlists, Dictionaries and Other Data Sets for Writing Software Security Test Cases.

项目信息

开发语言：未知

Star 数：2089

技术要点

该项目属于病毒分析方向的开源资源，代码结构清晰，适合安全研究人员学习参考。项目围绕A curated list of amazingly awesome Cybersecurity datasets展开，提供了可运行的实现，对理解相关安全机制、工具原理与攻防技术具有较高的研究价值。

从技术实现角度看，此类项目的核心在于对底层原理的深入理解与工程化落地。开发者在研究过程中可以结合官方文档与社区讨论，梳理项目的初始化流程、核心模块职责与数据流转，逐步掌握其中的技术细节与设计思路。

使用与学习建议

1. 下载源码压缩包，解压到本地环境。

2. 根据项目类型准备对应的运行环境与依赖。

3. 按照 README 中的步骤完成配置与部署。

4. 在隔离的测试环境中运行验证，避免影响生产系统。

免责声明

本资源来源于开源社区，仅供安全研究、技术学习与合法授权范围内的攻防演练使用，请勿用于任何非法或侵害他人权益的用途。使用本项目产生的一切后果由使用者自行承担。