Information Theory of Bayesian network

class pyAgrum.InformationTheory(*args)

This class gathers information theory concepts for subsets named X,Y and Z computed with only one (optimized) inference.

it=pyAgrum.InformationTheory(ie,X,Y,Z)

Parameters:

• ie (InferenceEngine) – the inference algorithme to use (for instance, pyAgrum.LazyPropagation)

• X (int or str or iterable[int or str]) – a first nodeset

• Y (int or str or iterable[int or str]) – a second nodeset

• Z (: int or str or iterable[int or str] (optional)) – a third (an optional) nodeset

Example

import pyAgrum as gum
bn=pyAgrum.fastBN('A->B<-C<-D->E<-F->G->A')
ie=pyAgrum.LazyPropagation(bn)
it=pyAgrum.InformationTheory(ie,'A',['B','G'],['C'])
print(f'Entropy(A)={it.entropyX()}'')
print(f'MutualInformation(A;B,G)={it.mutualInformationXY()}')
print(f'MutualInformation(A;B,G| C)={it.mutualInformationXYgivenZ()}')
print(f'VariationOfInformation(A;B,G)={it.variationOfInformationXY()}')

entropyX()

Returns:

The entropy of nodeset X.

Return type:

float

entropyXY()

Return type:

float

Returns:

float

The entropy of nodeset, union of X and Y.

entropyXYgivenZ()

Return type:

float

entropyXgivenY()

Return type:

float

Returns:

float

The conditional entropy of nodeset X conditionned by nodeset Y

entropyY()

Return type:

float

Returns:

float

The entropy of nodeset X.

entropyYgivenX()

Return type:

float

Returns:

float

The conditional entropy of nodeset Y conditionned by nodeset X

mutualInformationXY()

Return type:

float

mutualInformationXYgivenZ()

Return type:

float

Returns:

float

The conditional mutual information between nodeset X and nodeset Y conditionned by nodeset Z

variationOfInformationXY()

Return type:

float

Returns:

float

The variation of information between nodeset X and nodeset Y