What those granules actually are
The grit in your gutter is your roof's sunscreen.
Every asphalt shingle is built in layers. At the core is a mat soaked in asphalt, which is what actually waterproofs your home. Asphalt by itself hates the sun: raw, exposed asphalt dries out, hardens, and cracks fast under ultraviolet light. So the manufacturer coats the top surface in a dense layer of ceramic-coated mineral granules. That granule layer is the shingle's armor. It blocks UV from reaching the asphalt, helps the roof shed water, adds a measure of fire and impact resistance, and gives the roof its color. The dark sand washing into your gutter is that armor, shed off the shingles above.
So losing granules is not a cosmetic problem. Granules are the one thing standing between Florida's sun and the asphalt that keeps your living room dry. Once a patch of shingle goes bald and the asphalt is exposed, that spot ages far faster than the shingle around it. The sun bakes it, it dries and cracks, and it sheds even more granules. It becomes a downward spiral: the more asphalt shows, the faster the shingle breaks down, and the faster the next round of granules lets go. That is why a roofer takes granule loss seriously even when the roof still looks fine from the street.
Here is the part that keeps homeowners calm: a brand-new shingle roof sheds loose granules too, and that is completely normal. During manufacturing and shipping, extra granules that never bonded to the asphalt ride along on the surface. For the first few months and the first several rainstorms after a new roof goes on, those loose granules rinse off into the gutters. It looks alarming the first time you see it. It is not. As long as it tapers off and does not keep getting worse month after month, a little grit from a young roof is just the roof settling in.