We probe the response of viscous and viscoelastic fluids on micrometer and microsecond length and time scales using two optically trapped beads. In this way we resolve the flow field, which exhibits clear effects of fluid inertia. Specifically, we resolve the short-time vortex flow and the corresponding evolution of this vortex, which propagates diffusively for simple liquids. For viscoelastic fluids, this propagation is shown to be faster than diffusive and the displacement correlations reflect the frequency-dependent shear modulus of the medium.