This is an important bugfix release. DstNet* values were classified using the
source address instead of the destination address.

• 🩹 orchestrator: fix DstNet* values
• 🌱 inlet: if available, use sFlow for DstASPath
• 🌱 docker: update Kafka UI image

Docker image: docker pull ghcr.io/akvorado/akvorado:1.7.1
Full changelog: v1.7.0...v1.7.1

⚠️ This version has an important bug. Upgrade to 1.7.1 instead.

This version introduces the ability to customize the data schema used by
Akvorado. This change is quite invasive and you should be cautious when
deploying it. It requires a restart of ClickHouse after upgrading the
orchestrator. It also takes some time to reduce the storage size for SrcPort
and DstPort.

The orchestrator automatically defines the TTL for the system log tables (like
system.query_log). The default TTL is 30 days. You can disable that by setting
orchestrator.clickhouse.system-logs-ttl to 0.

• ✨ inlet: add schema.enabled, schema.disabled, schema.main-table-only,
  and schema.not-main-table-only to alter collected data
• ✨ inlet: add the following collected data (disabled by default):
  • SrcAddrNAT and DstAddrNAT
  • SrcPortNAT and DstPortNAT
  • SrcMAC and DstMAC
  • SrcVlan and DstVlan
• 🩹 inlet: handle correctly interfaces with high indexes for sFlow
• 🩹 docker: fix Kafka healthcheck
• 🌱 inlet: improve decoding/encoding performance (twice faster!)
• 🌱 orchestrator: set TTL for ClickHouse system log tables and exporters table
• 🌱 orchestrator: reduce storage size for SrcPort and DstPort
• 🌱 orchestrator: add clickhouse.kafka.engine-settings to configure additional settings for the Kafka engine
• 🌱 common: Go profiler endpoints are enabled by default

Docker image: docker pull ghcr.io/akvorado/akvorado:1.7.0
Full changelog: v1.6.4...v1.7.0

There is a schema update in this version: you also have to restart ClickHouse
after upgrading for it to pick the new schema.

This version also introduces a cache for some HTTP requests, notably those to
plot the graphs in the “Visualize” tab. The default backend is in-memory,
however the shipped akvorado.yaml configuration file is using Redis instead.
The docker-compose setup has also been updated to start a Redis container for
this usage. Use of Redis is preferred but on upgrade, you need to enable it
explicitely by adding console.http.cache in your configuration.

• ✨ console: cache some costly requests to the backend
• ✨ console: add SrcNetPrefix and DstNetPrefix (as a dimension and a filter attribute)
• ✨ inlet: add inlet.flow.inputs.use-src-addr-for-exporter-addr to override exporter address
• 🌱 console: add limit and graph-type to console.default-visualize-options
• 🌱 docker: published docker-compose.yml file pins Akvorado image to the associated release
• 🌱 docker: update Zookeeper and Kafka images (this upgrade is optional)

Docker image: docker pull ghcr.io/akvorado/akvorado:1.6.4
Full changelog: v1.6.3...v1.6.4

New Contributors

• @NoifP made their first contribution in #316
• @margau made their first contribution in #329

• ✨ console: add 100% stacked graph type
• 🩹 inlet: handle non-fatal BMP decoding errors more gracefully
• 🩹 inlet: fix a small memory leak in BMP collector
• 🩹 console: fix selection of the aggregate table to not get empty graphs
• 🩹 console: use configured dimensions limit for “Visualize” tab
• 🌱 inlet: optimize BMP CPU usage, memory usage, and lock times
• 🌱 inlet: replace LRU cache for classifiers by a time-based cache
• 🌱 inlet: add TLS support for Kafka transport
• 🌱 console: Ctrl-Enter or Cmd-Enter when editing a filter now applies the changes
• 🌱 console: switch to TypeScript for the frontend code

Docker image: docker pull ghcr.io/akvorado/akvorado:1.6.3
Full changelog: v1.6.2...v1.6.3

• ✨ orchestrator: add orchestrator.network-sources to fetch network attributes with HTTP
• ✨ console: add console.database.saved-filters to populate filters from the configuration file
• 🩹 doc: durations must be written using a suffix (like 5s)
• 🌱 docker: provider a tarball with essential files to install or upgrade a docker-compose setup
• 🌱 inlet: skip unknown AFI/SAFI in BMP route monitoring messages

Docker image: docker pull ghcr.io/akvorado/akvorado:1.6.2
Full changelog: v1.6.1...v1.6.2

• 🩹 inlet: fix SrcAS when receiving flows with sFlow
• 🩹 inlet: do not half-close BMP connection (a remote IOS XR closes its own end)
• 🌱 docker: split demo exporters out of docker-compose.yml
• 🌱 console: make the upper limit for dimensions configurable
  (console.dimensions-limit)

Docker image: docker pull ghcr.io/akvorado/akvorado:1.6.1
Full changelog: v1.6.0...v1.6.1

This release features a BMP collector to grab BGP routes from one or
several routers. The routes can be used to determine source and
destination AS (instead of using GeoIP or information from the flows)
but also the AS paths and the communities. Check inlet.bmp and
inlet.core configuration settings for more information.

• ✨ inlet: BMP collector to get AS numbers, AS paths, and communities from BGP PR #155
• ✨ inlet: add inlet.snmp.agents to override exporter IP address for SNMP queries
• 🩹 inlet: handle sFlow specific interface number for locally
  originated/terminated traffic, discarded traffic and traffic sent to
  multiple interfaces.
• 🌱 build: Docker image is built using Nix instead of Alpine

Docker image: docker pull ghcr.io/akvorado/akvorado:1.6.0
Full changelog: v1.5.8...v1.6.0

This release bumps the minimal required version for ClickHouse to
22.4. The docker-compose file has been updated to use ClickHouse
22.8 (which is a long term version). Moreover, Akvorado now has its
own organisation and the code is hosted at
akvorado/akvorado.

• 💥 console: make ClickHouse interpolate missing values (ClickHouse 22.4+ is required)
• 🩹 orchestrator: validate configuration of other services on start
• 🩹 inlet: correctly parse inlet.snmp.communities when it is just a string
• 🌱 cmd: print a shorter message when an internal error happens when parsing configuration
• 🌱 inlet: add inlet.snmp.ports to configure SNMP exporter ports

Docker image: docker pull ghcr.io/akvorado/akvorado:1.5.8
Full changelog: v1.5.7...v1.5.8

• ✨ inlet: add support for flow rate-limiting with inlet.flow.rate-limit
• 🌱 inlet: improve performance of GeoIP lookup
• 🌱 inlet: add inlet.core.asn-providers to specify how to get AS
  numbers. inlet.core.ignore-asn-from-flow is deprecated and mapped
  to geoip.

Docker image: docker pull ghcr.io/vincentbernat/akvorado:1.5.7
Full changelog: v1.5.6...v1.5.7

• ✨ inlet: add support for SNMPv3 protocol
• 🌱 inlet: inlet.snmp.default-community is now deprecated
• 🌱 console: make “previous period” line more visible
• 🩹 geoip: fix inlet.geoip.country-database rename to inlet.geoip.geo-database

Docker image: docker pull ghcr.io/vincentbernat/akvorado:1.5.6
Full changelog: v1.5.5...v1.5.6