the plant is using the nutrients in those big fan leaves to feed your buds. i think it's ok just let them fall off and depending on how many days of flowering you have left i wouldnt feed them any nutes just pure water. that will flush them out and help the taste. goodluck man