« Three Simple BGP Rules
1. messages are forwarded to neighbors, after adding the ASN
2. only the shortest AS path is forwarded
3. packets are sent to the most specific prefix
[...]
Routing Information Service (RIS)
• 13 BGP collectors all over the world
• 263 BGP peers
• BGP messages dumped into binary files
• 550 GB per year
[...]
https://github.com/ANSSI-FR/parsifal
Parsifal is an OCaml-based parsing engine.
Parsifal is a collection of binary parsers and tools. The development is at an early stage (which explains the 0.1 version).
There are several file formats or network protocols currently (at least partially) described:
X.509 certificates
SSL/TLS messages
DNS messages
MRT/BGP messages
Portable Executables
UEFI Firmwares
PKCS#1 keys and containers
PKCS#7 containers
Kerberos messages
OpenPGP messages
DVI documents
PNG images
PCAP/IP/TCP/UDP rudimentary support
NTP messages
[...]
http://discoproject.org/
Disco is a lightweight, open-source framework for distributed computing based on the MapReduce paradigm.
Disco is powerful and easy to use, thanks to Python. Disco distributes and replicates your data, and schedules your jobs efficiently. Disco even includes the tools you need to index billions of data points and query them in real-time.
[...]
https://github.com/spotify/luigi
Luigi is a Python (2.7, 3.3, 3.4) package that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization, handling failures, command line integration, and much more. [...] The purpose of Luigi is to address all the plumbing typically associated with long-running batch processes. You want to chain many tasks, automate them, and failures will happen. These tasks can be anything, but are typically long running things like Hadoop jobs, dumping data to/from databases, running machine learning algorithms, or anything else.
There are other software packages that focus on lower level aspects of data processing, like Hive, Pig, or Cascading. Luigi is not a framework to replace these. Instead it helps you stitch many tasks together, where each task can be a Hive query, a Hadoop job in Java, a Spark job in Scala or Python a Python snippet, dumping a table from a database, or anything else. It's easy to build up long-running pipelines that comprise thousands of tasks and take days or weeks to complete. Luigi takes care of a lot of the workflow management so that you can focus on the tasks themselves and their dependencies.
[...]
<hadron> 2a04:8000::/29 is announced from multiple origins:
<hadron> SFR-BUSINESS-TEAM (AS12566)
<hadron> Ukraine-AS (AS200000)
<hadron> First originated from SFR-BUSINESS-TEAM (AS12566)
Analysis Result
• 2a04:8000::/29 belongs to the Ukrainian operator
• 2a04: 0 800::/29 belongs to the French operator
• French operator made a mistake in its BGP configuration
It was a false positive, the route6 object was created a few days later by the Ukrainian operator. »