Have you thought about optimizing your feature extraction prior to segmentation? Improving the original representation can be very beneficial at times. Make sure your manually labeled data is extremely clean and diverse for DCL training.