|
|
|
|
|
by ukj
1019 days ago
|
|
You say “restricted” I say “better defined”. Either way - A constructive setting is more expressive. So express your English adjectives in Mathematics. What do you mean by “restricted” when you are characterising a function? Show me the decider… for “classical” and “non-classical” objects. That is the definition of information; is it not? The answer to a yes/no questions Is the object classical? Yes/no. |
|
Sure, whatever - the point is that they're different objects, and results about one are not results about the other.
> What do you mean by “restricted” when you are characterising a function?
I mean whatever the word "function" means in a given setting. A classical function X -> Y is a relation such that if `(x, y1)` and `(x, y2)` hold then `y1 = y2`. A function in intuitionistic type theory is a well-typed lambda term. A function in the categorical semantics of a type theory is an exponential object. And so on.
> Show me the decider… for “classical” and “non-classical” objects.
No such thing: it's a metatheoretical judgement, not a theorem. Same story as type errors: within the language, `stringToUpperCase (5 :: Int) :: String` isn't a false statement, it's just inexpressible nonsense. There is no such object as `stringToUpperCase 5` and so nothing can be said about it internally. When we talk about it, we're talking, from outside the language, about a syntactic construct.
> That is the definition of information; is it not? The answer to a yes/no questions
No. Self-information of a given outcome with respect to a random variable, which is probably the most common sense of the word, is the negative log of its probability. Shannon entropy, also often called information, is the expected self-information of a random variable. Mutual information is the KL divergence of a joint distribution and the product of the respective marginals. There are other notions.