Mathematical language just uses a different set of symbols. Like sentences, some constructions are valid and some are invalid.
I can write down the symbols "15/0" and say the words "fifteen divided by zero." Doesn't mean that refers to any real quantity.