For your situation, if you are not using perforated PVC pipe gravel backfill is not necessary. Just backfill with clean fill with no large rocks or organic material (remove from the trenched material before backfill). What is important is installing the pipe with an adequate slope on the pipe...