How to use the command "ipaggmanip" (with examples)

The “ipaggmanip” command is used to manipulate aggregate statistics that are produced by the “ipaggcreate” command. It allows users to combine labels, remove labels based on certain criteria, and replace label counts with a specific value.

Use case 1: Combine labels equal in their high-order bits

Code:

ipaggmanip --prefix 16 path/to/file

Motivation:

The motivation for combining labels that are equal in their high-order bits is to simplify the statistical analysis of aggregated data. By grouping labels with similar high-order bits together, users can gain insights into larger trends and patterns within their data.

Explanation:

• --prefix 16: Specifies that labels should be combined if they have the same high-order 16 bits. Users can adjust the “16” value based on their specific needs.

Example output:

Label         Count
------------------
192.168.0.0   100
192.168.1.0   200
192.168.2.0   150
192.168.3.0   75

In this example, labels with the same high-order 16 bits (e.g., 192.168) have been combined, resulting in simplified output for analysis.

Use case 2: Remove labels with a count smaller than a given number of bytes and output a random sample of such labels

Code:

ipaggmanip --cut-smaller 100 --cull-labels 5 path/to/file

Motivation:

The motivation for removing labels with a small count and outputting a random sample is to focus on the most significant and impactful data. By filtering out labels with low counts, users can reduce noise and concentrate on labels that have a more significant presence.

Explanation:

• --cut-smaller 100: Specifies that labels with a count smaller than 100 should be removed.
• --cull-labels 5: Specifies that a random sample of 5 labels, which meet the --cut-smaller criterion, should be outputted.

Example output:

Label         Count
------------------
192.168.1.0   200
192.168.2.0   150
192.168.5.0   120
10.0.0.0      180
10.0.1.0      250

In this example, labels with counts smaller than 100 have been removed, and a random sample of 5 such labels has been outputted. The remaining labels can now be analyzed with reduced noise.

Use case 3: Replace each label’s count with 1 if it is non-zero

Code:

ipaggmanip --posterize path/to/file

Motivation:

The motivation for replacing each label’s count with 1 if it is non-zero is to convert aggregate statistics into binary data. This simplification can aid in further analysis, such as pattern recognition and classification tasks.

Explanation:

• --posterize: Specifies that each label’s count should be replaced with 1 if it is non-zero.

Example output:

Label         Count
------------------
192.168.0.0   1
192.168.1.0   1
192.168.2.0   0
192.168.3.0   1

In this example, each label’s count has been replaced with 1 if it is non-zero. This binary representation can now be used for specific analysis purposes, such as identifying labels with any presence.