Sound like you are dealing with mold problem. Following that brown leaf to check if there is mold on the bud.