We generalize the notions of Khatri-Rao sums for matrices and tensor sums for Hilbert space operators to KhatriRao sums for Hilbert space operators. This kind of operator sum is compatible with algebraic operations and order relations. We investigate its analytic properties, including continuity, convergence, and norm bounds. We also discuss the role of selection operator that relates Khatri-Rao sums to Tracy-Singh sums and Khatri-Rao products. Binomial theorem involving Khatri-Rao sums and its consequences are then established.