Sample space, Field and Probability Measure. Axiomatic definition of Probability. Bayes' theorem. Repeated trials. Continuous and discrete random variables and their probability distribution and density functions. Functions of random variables and their distribution and density functions. Expectation, variance and higher order moments. Characteristic and generating functions. Vector formulation of random variables and their parameters. Mean square estimation and orthogonality principle. Criteria for estimators. Introduction to random processes: distribution and density functions; Ensemble and time averages; correlation functions and spectral densities. Classification of random processes. Random processes through linear systems. Weiner filters and Kalman filters.