Apache NiFi (see Introduction to NiFi) is a free open-source tool for managing the flow of data between systems.
In this second post, we build a working NiFi demo, with a couple of simplified use cases, allowing us to see it in action and learn by experimenting. The demo runs in a Docker container and comes with batch and real time event DataFlows and basic test data.
Continue reading
When I had a need to visualise telemetry data from a home project, the ELK stack was my go-to solution. The ELK stack (Elasticsearch, Logstash, Kibana) is an open-source-ish[i] tool for ingesting, searching, and visualising data.
Continue readingRecently, I had a need to understand IP fragmentation better, so I built a lab to experiment with. I wanted it to be easy to setup, and built in a way that is repeatable by others, so I designed automation to stand it up with virtual machines in a hypervisor. The lab network topology is shown in Figure 1.
Figure 1 – Network Diagram for IP Fragmentation Lab
This blog post is for network experimenters who want to export flow records from an Ubuntu Linux host bridging multiple network segments. Such a network might look like this:
An Ubuntu Linux host is bridges two network segments and traffic passing through the bridge is recorded as flow records. Continue reading
This blog post is for network experimenters who want to collect (receive) NetFlow or IPFIX flow records using the nfdump package (which includes nfcapd). An example use case, building on previous blog post NetFlow on OpenWRT, is shown in diagram below (highlighted boxes):
Flow records can be useful for various applications such as network visibility and security alerting. Continue reading
In part 2 of this blog post, we cover off how to install the necessary components to build virtual SDN labs with Vagrant. Continue reading
I’ve been experimenting with Vagrant to automate the creation of virtual Software-Defined Networking (SDN) labs. This blog explains how create SDN labs with Vagrant.
Why SDN labs? Maybe you’re a network student or engineer learning new skills. Maybe you want to develop the next killer SDN app. Perhaps you’re doing SDN research. Virtual labs are a great way to test ideas without having to invest in SDN switch hardware, and can be set up quickly. Continue reading
Software-defined networking (SDN) separates network control from packet forwarding. SDN is great for experimenters, as we get to tinker with how the network runs, without having to worry about moving packets.
To play with SDN in your home network you’ll need a device to do the packet forwarding, under control of your software.
I’ve added instructions on how to build a home SDN lab that leverages a common consumer-grade TP-Link home router repurposed as an OpenFlow switch, including Wi-Fi.
Bits 'n Bytes 