Initial baseline noise at beginning of HPLC Chromatogram

When doing analysis by HPLC, often in the first minute there is a lot of noise on the baseline. What causes it? Something to do with the injection?