The use of coherent light in conventional holographic phase microscopy (HPM) poses three major drawbacks: poor spatial resolution, weak depth sectioning, and fixed pattern noise due to unwanted diffraction. Here, we report a technique which can overcome these drawbacks, but maintains the advantage of phase microscopy - high contrast live cell imaging and 3D imaging. A speckle beam of a complex spatial pattern is used for illumination to reduce fixed pattern noise and to improve optical sectioning capability. By recording of the electric field of speckle, we demonstrate high contrast 3D live cell imaging without the need for axial scanning - neither objective lens nor sample stage. This technique has great potential in studying biological samples with improved sensitivity, resolution and optical sectioning capability.