It is shown that paradoxes arise in conditional probability calculations, due to incomplete specification of the problem at hand. This is illustrated with the Borel and the Kac-Slepian type paradoxes. These are significant in applications including Bayesian inference. Also Rényi's axiomatic setup does not resolve them. An open problem on calculation of conditional probabilities in the continuous case is noted.