Reasoning under uncertainty with limited resources and incomplete knowledge plays a big role in everyday situations and also in many technical applications of AI. Probabilistic reasoning is the modern AI method for solving these problems. After a brief introduction to probability theory we present the powerful method of maximum entropy and Bayesian networks which are used in many applications. The medical diagnosis expert system Lexmed, developed by the author, is used to demonstrate the power of these formalisms.