The Power of the Walk-Through

Looking down through the trees in Wellington Botanic Gardens as the sun sets over house-clad hills in the distance

There are many cognitive biases waiting to trip us up. Sunk Cost Fallacy, The Curse of Knowledge, Confirmation Bias, the list goes on[1]. A cognitive bias is a common flaw in our thinking that leads to an irrational judgement or decision.

I think I’ve found a new cognitive bias.

My experience tells me that people fail to read documents, even when they know they should and would benefit from doing so. Yet, despite this, I still hold an unfounded expectation that when I write a document, people will read it. I suspect others do too. Is this a cognitive bias?

Let’s look at the underlying issue:

Continue reading

Experimenting with NiFi

Apache NiFi (see Introduction to NiFi) is a free open-source tool for managing the flow of data between systems.

In this second post, we build a working NiFi demo, with a couple of simplified use cases, allowing us to see it in action and learn by experimenting. The demo runs in a Docker container and comes with batch and real time event DataFlows and basic test data.

Continue reading

Collecting NetFlow with nfcapd and nfdump

This blog post is for network experimenters who want to collect (receive) NetFlow or IPFIX flow records using the nfdump package (which includes nfcapd). An example use case, building on previous blog post NetFlow on OpenWRT, is shown in diagram below (highlighted boxes):

Collecting_NetFlow_with_nfcapd_and_nfdump

Flow records can be useful for various applications such as network visibility and security alerting. Continue reading