I believe that we are taking obviously non-fundamental axioms to be the basis of information theory. This is a bit of a tongue in cheek statement because I have absolutely no knowledge of Information Theory - but what the heck eh? Why should I let a minor issue like that stop me?
As I understand it, contemporary Information Theory builds on the representation of binary or character data. BUT, methinks data representation takes a much more fundamental form.
Isn't the most basic representation of data, the strength and direction of an electric field? The physical manifestation of data in the human brain would be in the form of synaptic configurations characterized by the strength and direction of an E-M Field. Even the storage of binarised data in modern computers is at its most basic level characterized by the strength and direction of an E-M Field.
SO the conclusion: Any Theory on Information has to be based on Electro Magnetic Theory - Not on pure statistical quantization!
Note to self - Investigate Information Theory.
3:49 PM