An atomic streak camera is developed to study the ultrafast ionization dynamics of Rydberg atoms excited by short laser pulses in an electric field. The electron flux released in the ionization process is imaged on a position sensitive detector. The atomic streak camera converts the time of ionization into a displacement on the detector. A sub-picosecond temporal resolution is obtained. The properties of the atomic streak camera are discussed in detail.