Many interesting families of rapidly convergent series representations for the Riemann Zeta function $\zeta (2n+1)$ $(n\in {\Bbb N})$ were considered recently by various authors. In this survey-cum-expository paper, the author presents a systematic (and historical) investigation of these series representations. Relevant connections of the results presented here with several other known series representations for $\zeta (2n+1)$ $(n\in {\Bbb N})$ are also pointed out. In one of many computationally useful special cases presented here, it is observed that $\zeta (3)$ can be represented by means of a series which converges much faster than that in Euler's celebrated formula as well as the series used recently by Ap\'{e}ry in his proof of the irrationality of $\zeta (3)$. Symbolic and numerical computations using Mathematica (Version 4.0) for Linux show, among other things, that only 50 terms of this series are capable of producing an accuracy of seven decimal places.